-- Logs begin at Fri 2022-01-28 01:12:56 UTC, end at Fri 2022-01-28 02:13:16 UTC. -- Jan 28 01:43:26.748273 dv-cinder-824978-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jan 28 01:43:26.755563 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jan 28 01:43:26.760819 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 01:43:26 2022] *** Jan 28 01:43:26.760819 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 01:43:26.760819 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 01:43:26.760819 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: nodename: dv-cinder-824978-1-iscsi Jan 28 01:43:26.760819 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: machine: x86_64 Jan 28 01:43:26.760819 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: clock source: unix Jan 28 01:43:26.760819 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: pcre jit disabled Jan 28 01:43:26.760819 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: detected number of CPU cores: 4 Jan 28 01:43:26.760819 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: current working directory: / Jan 28 01:43:26.760819 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: detected binary path: /usr/bin/uwsgi-core Jan 28 01:43:26.760819 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: your processes number limit is 47680 Jan 28 01:43:26.760819 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: your memory page size is 4096 bytes Jan 28 01:43:26.760819 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: detected max file descriptor number: 2048 Jan 28 01:43:26.760819 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: lock engine: pthread robust mutexes Jan 28 01:43:26.760819 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: thunder lock: enabled Jan 28 01:43:26.760819 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jan 28 01:43:26.760819 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 01:43:26.803434 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: Python main interpreter initialized at 0x5630c81579c0 Jan 28 01:43:26.803434 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: python threads support enabled Jan 28 01:43:26.803434 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: your server socket listen backlog is limited to 100 connections Jan 28 01:43:26.803434 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: your mercy for graceful operations on workers is 90 seconds Jan 28 01:43:26.803761 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 01:43:26.803826 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: *** Operational MODE: preforking *** Jan 28 01:43:26.804085 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: *** uWSGI is running in multiple interpreter mode *** Jan 28 01:43:26.804085 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: spawned uWSGI master process (pid: 79467) Jan 28 01:43:26.804280 dv-cinder-824978-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jan 28 01:43:26.805272 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: spawned uWSGI worker 1 (pid: 79481, cores: 1) Jan 28 01:43:26.805272 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: spawned uWSGI worker 2 (pid: 79482, cores: 1) Jan 28 01:43:26.805432 dv-cinder-824978-1-iscsi devstack@keystone.service[79467]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 01:43:31.903129 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:43:31.903129 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: from cryptography.utils import int_from_bytes Jan 28 01:43:31.903908 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:43:31.903908 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: from cryptography.utils import int_from_bytes Jan 28 01:43:31.906162 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:43:31.906162 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: from cryptography.utils import int_from_bytes Jan 28 01:43:31.906636 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:43:31.906636 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: from cryptography.utils import int_from_bytes Jan 28 01:43:31.952066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:43:31.952249 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:43:31.952423 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] command line args: [] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:43:31.952687 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:43:31.952886 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ================================================================================ {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:43:31.953138 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] admin_token = **** {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.953381 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] config_dir = [] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.953565 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.953744 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] config_source = [] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.953920 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] debug = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.954115 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.955299 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.955396 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:43:31.955467 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.955532 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:43:31.955532 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] command line args: [] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:43:31.955653 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.955653 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.955768 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:43:31.955768 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ================================================================================ {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:43:31.955882 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] list_limit = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.955882 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] log_config_append = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.956001 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] admin_token = **** {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.956075 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.956139 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] config_dir = [] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.956203 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] log_dir = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.956261 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.956318 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] log_file = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.956385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] config_source = [] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.956449 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.956512 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] debug = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.956576 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.956639 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.956732 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.956936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.956936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.957065 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.957065 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.957180 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.957254 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.957378 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.957470 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.957607 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] list_limit = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.957692 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.957777 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] log_config_append = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.957897 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.957983 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.958109 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] log_dir = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.958185 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.958309 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] log_file = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.958393 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.958497 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.958582 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.958748 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.958836 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.958997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.959091 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.959245 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.959325 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.959450 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.959585 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.959743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.96/identity {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.959834 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.959907 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] publish_errors = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.960064 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.960196 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.960283 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.960356 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.960510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.960595 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.960740 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.960854 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.961000 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.961078 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.961230 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] standard_threads = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.961315 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.961457 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.961546 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.961701 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.961839 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.961928 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.962156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] use_journal = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.962308 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] use_json = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.962495 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.96/identity {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.962638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] use_stderr = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.962777 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] publish_errors = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.962929 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] use_syslog = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.963066 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.963177 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.963259 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.963374 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.963451 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.963534 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.963613 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.963691 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.963768 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.963846 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.963923 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] standard_threads = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.964030 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.964116 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.964265 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.964360 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.964499 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.964572 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.964676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] use_journal = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.964762 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.964869 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] use_json = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.964985 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.965065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] use_stderr = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.965222 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] use_syslog = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.965389 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.965471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:43:31.965549 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.965684 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.965762 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.965927 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.966034 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.966155 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.966232 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.966400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.966477 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.966645 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.966735 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.966878 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.966957 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.967129 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.967214 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.967366 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.967444 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.967593 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.967670 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.967842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.967930 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.968095 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.968174 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.968332 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.968415 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.968574 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.968651 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.968848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.968942 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.969047 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.969125 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.969273 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.969352 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.969503 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.969582 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.969746 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.969824 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.969989 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.970075 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.970218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.970298 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.970442 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.970526 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.970682 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.970761 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.970909 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.970989 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.971143 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.971227 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.971386 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.971471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.971612 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.971691 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.971840 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.971918 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.972066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.972149 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.972294 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.972374 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.972519 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.972604 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.972743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.972840 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.973021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.973101 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.973252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.973332 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.973495 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.973572 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.973721 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.973801 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.973953 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.974031 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.974179 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.974262 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.974407 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.974487 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.974635 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.974713 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.974878 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.974990 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.975100 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.975200 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.975326 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.975432 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.975555 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.975669 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.975791 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.976060 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.976277 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.976516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.976751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.977013 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.977218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.977299 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.977481 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.977560 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.978228 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.978384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.978493 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.978667 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.978747 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.978821 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.978939 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.979025 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.979198 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.979278 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.979435 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.979525 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.979700 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.979843 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.979971 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.980110 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.980235 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.980359 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.980482 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.980605 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.980729 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.980905 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.981045 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.981181 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.981315 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.981443 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.981570 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.981703 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.981832 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.981958 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.982091 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.982222 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.982345 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.982491 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.982620 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.982747 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.982891 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.983018 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.983148 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.983282 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.983408 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.983535 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.983661 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.983785 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.983918 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.984124 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.984251 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.984379 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.984506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.984506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.984756 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.984948 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.985078 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.985205 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.985338 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.985466 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.985591 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.985726 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.985852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.985980 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.986112 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.986240 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.986364 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.986513 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.986647 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.986775 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.986902 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.987029 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.987161 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.987301 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.987446 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.987576 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.987703 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.987831 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] auth.external = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.987958 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.988091 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.988224 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.988365 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.988494 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.988628 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.988756 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.988931 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] auth.password = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.989067 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.989196 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] auth.token = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.989323 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.989456 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.989584 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] auth.external = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.989712 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.989847 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.989976 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.990114 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.990249 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.990382 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.990510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.990645 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] auth.password = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.990772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.990899 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] auth.token = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.991026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.991154 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.991280 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] credential.caching = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.991415 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.991543 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.991671 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.991798 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.991936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.992068 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.992224 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.992362 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.992499 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.992628 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.992756 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.992948 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.993078 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] credential.caching = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.993206 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.993346 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.994079 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.994212 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.994360 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.994490 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.994689 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.994926 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.995057 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.995192 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.995322 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.995452 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.995593 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.995721 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.995849 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.995977 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.996101 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.996240 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.996388 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] federation.caching = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.996388 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.996629 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.996757 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.996910 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.997039 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.997177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.997305 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.997433 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.997560 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.997698 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.997831 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.997971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.998114 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.998242 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] federation.caching = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.998376 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.998511 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.998637 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.998637 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.998884 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.999012 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.999140 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.999268 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] identity.caching = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.999395 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.999532 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.999661 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.999789 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:31.999933 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.000061 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.000144 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.000353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.000484 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.000613 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.000740 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.000884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.001012 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.001154 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.001284 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.001410 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.001537 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] identity.caching = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.001676 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.001803 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.001939 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.002066 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.002200 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.002329 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.002457 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.002591 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.002729 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.002865 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.002993 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.003121 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.003248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.003376 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.003524 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.003652 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.003781 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.003908 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.004035 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.004160 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.004252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.004382 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.004504 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.004632 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.004759 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.004889 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.004970 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.005033 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.005092 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.005151 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.005209 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.005266 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.005333 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.005394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.005453 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.005453 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.005557 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.005623 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.005683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.005742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.005800 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.005857 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.005915 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.005981 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.006042 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.006100 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.006157 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.006215 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.007208 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.007348 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.007475 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.007600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.007724 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.007848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.007972 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.008114 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.008251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.008251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.008491 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.008616 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.008616 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.008884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.009045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.009045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.009045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.009045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.009045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.009667 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.009816 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.009816 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.010058 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.010182 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.010307 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.010438 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.010563 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.010686 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.010810 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.010933 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.011057 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.011189 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.011320 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.011444 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.011586 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.011715 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.011843 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.011975 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.012103 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.012103 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.012337 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.012467 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.user = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.012596 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.012728 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.012894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.013027 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.013154 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.013281 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.013418 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.user = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.013553 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.013688 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.013818 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.013950 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.014077 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.014205 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.014341 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.014471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.014597 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.014723 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.014849 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.014983 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.015127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.015257 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.015385 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.015513 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.015641 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.015766 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.015902 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.016030 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.016156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.016284 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.016412 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.016540 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.016675 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.016823 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.016959 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.017088 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.017216 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.017345 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.017484 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.017615 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.017743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.017871 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.017999 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.018127 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.018259 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.018390 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.018514 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.018639 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.018772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.018902 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.019033 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.019158 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.019283 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.019406 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.019531 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.019661 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.019794 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.019794 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.020033 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.020163 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.020316 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.020449 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.020583 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.020709 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.020855 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.020980 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.021108 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.021246 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.021369 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.021498 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.021627 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.021755 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.021883 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.022025 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] resource.caching = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.022153 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.022291 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.022419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.022553 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.022688 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.022828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.022959 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.023087 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.023214 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] resource.caching = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.023342 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.023469 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.023625 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.023751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.023880 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.024008 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.024152 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.024281 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.024486 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.024641 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.024845 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] role.caching = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.025028 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.025209 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] role.driver = sql {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.025339 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.025475 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.025601 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.025727 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.026114 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.026239 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.026375 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] role.caching = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.026509 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.026640 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] role.driver = sql {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.026764 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.026903 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.027033 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.027163 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.027294 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.027430 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.027562 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.027692 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.027816 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.027941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.028082 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.028226 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.028359 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.028483 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.028608 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.028732 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.028923 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.029056 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.029184 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.029312 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.029312 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.029555 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.029693 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.029823 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.029962 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.030092 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.030220 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.030355 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.030355 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.030597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.030726 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.030809 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.030869 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.031022 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.031151 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.031279 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.031406 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.031542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.031669 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.031805 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.031933 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.032062 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.032189 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.032312 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.032440 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.032440 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.032693 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.032693 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.032947 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.033077 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.033215 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.033355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.033485 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.033612 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.033741 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.033741 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.033983 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.034120 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] token.caching = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.034250 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.034378 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.034505 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.034633 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.034761 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.034897 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.035040 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.035169 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.035297 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.035424 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.035552 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] token.caching = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.035688 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.035816 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.035944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.036073 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.036204 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.036333 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.036472 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.036602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.036730 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.036932 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.037059 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.037189 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.037330 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.037459 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.037584 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.037711 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.037838 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.037966 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.038101 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.038231 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.038362 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.038489 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.038627 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.038754 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.038890 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.connection = **** {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.039019 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.039147 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.039275 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.039404 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.039531 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.039667 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.039796 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.039922 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.040049 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.040176 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.040789 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.connection = **** {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.040948 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.041029 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.041102 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.041175 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.041247 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.041318 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.041399 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.041474 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.041547 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.041619 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.041690 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.041770 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.041853 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.041935 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.042009 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.042088 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.042162 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.042234 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.042305 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.042385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.042459 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.042531 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.042660 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.042752 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.042828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.042828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:43:32.042967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.042967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.042967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.042967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.042967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.042967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:43:32.042967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:43:32.067057 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.067282 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.067367 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.067506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.067592 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.067824 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.076134 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.076616 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.104814 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.105042 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.105215 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.105447 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.159290 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.159455 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.210157 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.210394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.211492 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.211723 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.367174 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.367399 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.367618 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.367832 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.368069 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.368258 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.371694 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.371924 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.372146 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.372365 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.372583 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.372814 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.391346 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.391574 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.391769 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.391853 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.392001 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.392082 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.392216 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.392298 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.392427 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.392509 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.392638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.392727 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.392877 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.393094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.404870 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.404992 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.418284 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.418415 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.418496 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.418558 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.418668 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.418750 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.418884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.418966 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.419096 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.419176 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.419305 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.419393 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.419514 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.419594 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:43:32.436852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.436992 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.437130 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 28 01:43:32.437229 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 28 01:43:32.437380 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.437462 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.437579 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 28 01:43:32.437660 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 28 01:43:32.437848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.437930 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.438105 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.438185 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.438360 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.438440 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.438613 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.438693 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.449312 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.449411 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.449584 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.449681 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.449851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.449934 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.450130 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.450211 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.458044 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.458160 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.461264 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.461421 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.461542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.461623 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.461825 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.461908 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.462665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.462794 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.462956 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.463102 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.463335 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.463418 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.463607 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.463690 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.463874 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.463957 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.464144 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.464270 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.464412 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.464540 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.464677 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.464759 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.490958 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.491206 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.492537 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.492832 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.492921 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.493127 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.498294 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.498400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.498573 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.498661 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.498851 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.498934 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.505884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.506009 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.506163 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.506251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.510504 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.510704 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.510790 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.510990 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.511075 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.511273 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.511357 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.511557 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.511649 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.511823 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.511905 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.512087 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.512175 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.512346 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.512439 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.512615 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.531348 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.531615 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.531706 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.531900 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.536045 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.536318 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.539690 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.539824 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.539979 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.540117 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.545619 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.545835 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.549117 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.549243 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.552616 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.552949 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.553233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.553509 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.553778 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.554054 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.554558 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.554864 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.555148 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.555444 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.555721 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.556031 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.572680 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.572976 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.573239 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.573498 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.574624 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.574916 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.575280 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.575548 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.581205 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.583354 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.584533 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.584834 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.585102 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.585380 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.588515 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.588924 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.589142 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.589278 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.589430 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.589699 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.589859 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.589969 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.590079 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.590261 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.604332 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.604601 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.604695 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.604916 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.605001 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.605198 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.605283 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.605480 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.605572 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.605752 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.605846 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.606024 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.606106 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.606302 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.623348 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.624101 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.626503 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.627284 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.629862 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.630534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.631392 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.632090 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.632986 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.633261 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.633551 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.633701 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.634551 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.634973 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.641618 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.642687 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.643164 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.644242 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.646510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.646809 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.647091 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.647363 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.647447 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.647692 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.647976 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.648256 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.657530 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.657839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.658124 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.662181 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.662483 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.662766 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.666197 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.666468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.666745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.667030 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.667298 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.667566 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.667835 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.668107 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.668417 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.668654 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.668954 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.669214 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.669474 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.669729 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.670505 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:43:32.670785 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.671062 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.671345 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.671617 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.671884 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.672156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.672421 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.672704 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.673007 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.673290 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.673550 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.673829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.674086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:43:32.706822 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5630c81579c0 pid: 79481 (default app) Jan 28 01:43:32.710114 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bd37e-9656-4733-a48d-902a083eedd7 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:32.710400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bd37e-9656-4733-a48d-902a083eedd7 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:32.710673 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bd37e-9656-4733-a48d-902a083eedd7 None None] PATH_INFO: `/v3` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:32.715772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1/1] 10.222.0.96 () {50 vars in 791 bytes} [Fri Jan 28 01:43:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:32.716006 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5630c81579c0 pid: 79482 (default app) Jan 28 01:43:40.428869 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fb533-eea9-44a4-a95e-d0a2978d927e None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:40.429486 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fb533-eea9-44a4-a95e-d0a2978d927e None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:40.429486 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fb533-eea9-44a4-a95e-d0a2978d927e None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:40.432777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 2/2] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:43:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:43:40.441728 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c3ee6-8918-4633-9f42-7ac754937397 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:40.442190 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c3ee6-8918-4633-9f42-7ac754937397 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:40.442274 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c3ee6-8918-4633-9f42-7ac754937397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:40.475126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG oslo_db.sqlalchemy.engines [None req-aa6c3ee6-8918-4633-9f42-7ac754937397 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:43:40.676471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG passlib.handlers.bcrypt [None req-aa6c3ee6-8918-4633-9f42-7ac754937397 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79482) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 28 01:43:40.676986 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG passlib.handlers.bcrypt [None req-aa6c3ee6-8918-4633-9f42-7ac754937397 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79482) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 28 01:43:40.734039 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-aa6c3ee6-8918-4633-9f42-7ac754937397 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:43:40.735548 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-aa6c3ee6-8918-4633-9f42-7ac754937397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:43:40.885400 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1/3] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:43:40 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:43:41.019248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fb533-eea9-44a4-a95e-d0a2978d927e None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:41.053398 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG oslo_db.sqlalchemy.engines [None req-843fb533-eea9-44a4-a95e-d0a2978d927e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79481) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:43:41.186036 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fb533-eea9-44a4-a95e-d0a2978d927e None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:41.190359 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de564d1a-d958-44ed-84e3-3cddf9425a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:41.191017 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de564d1a-d958-44ed-84e3-3cddf9425a66 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:41.191292 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de564d1a-d958-44ed-84e3-3cddf9425a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:41.191559 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de564d1a-d958-44ed-84e3-3cddf9425a66 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:41.200336 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de564d1a-d958-44ed-84e3-3cddf9425a66 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:41.253706 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.common.rbac_enforcer.enforcer [None req-de564d1a-d958-44ed-84e3-3cddf9425a66 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 28 01:43:41.254048 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de564d1a-d958-44ed-84e3-3cddf9425a66 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:41.264385 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 3/4] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:43:41 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:43:41.271651 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c3ee6-8918-4633-9f42-7ac754937397 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:41.286683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c3ee6-8918-4633-9f42-7ac754937397 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:41.291943 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6d27b-18ac-4353-a139-56420a24a299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:41.293092 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6d27b-18ac-4353-a139-56420a24a299 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:41.293379 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6d27b-18ac-4353-a139-56420a24a299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:41.293657 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6d27b-18ac-4353-a139-56420a24a299 admin admin] PATH_INFO: `/v3/projects/7ed2a96df227403c8d2cdfcff229008d` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:41.297413 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6d27b-18ac-4353-a139-56420a24a299 admin admin] RBAC: Authorizing `identity:get_project(project_id=7ed2a96df227403c8d2cdfcff229008d)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:41.348499 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7cc6d27b-18ac-4353-a139-56420a24a299 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 28 01:43:41.348863 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6d27b-18ac-4353-a139-56420a24a299 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:41.354139 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 2/5] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:43:41 2022] GET /identity/v3/projects/7ed2a96df227403c8d2cdfcff229008d => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:43.539393 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda572c-472e-4d84-8c93-9b0a97ce6e84 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:43.540021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda572c-472e-4d84-8c93-9b0a97ce6e84 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:43.540021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda572c-472e-4d84-8c93-9b0a97ce6e84 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:43.544983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 4/6] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:43:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:43:43.552935 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829b8e2-e5f3-4883-8a31-7bc13b0485cc None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:43.553345 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829b8e2-e5f3-4883-8a31-7bc13b0485cc None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:43.553493 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829b8e2-e5f3-4883-8a31-7bc13b0485cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:43.576232 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-f829b8e2-e5f3-4883-8a31-7bc13b0485cc None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:43:43.577804 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-f829b8e2-e5f3-4883-8a31-7bc13b0485cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:43:43.585737 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 3/7] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:43:43 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:43:43.610384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda572c-472e-4d84-8c93-9b0a97ce6e84 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:43.622902 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda572c-472e-4d84-8c93-9b0a97ce6e84 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:43.627192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a40849-c0f0-408a-bb96-6b9a30d78cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:43.627826 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a40849-c0f0-408a-bb96-6b9a30d78cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:43.628105 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a40849-c0f0-408a-bb96-6b9a30d78cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:43.628376 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a40849-c0f0-408a-bb96-6b9a30d78cb2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:43.637109 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a40849-c0f0-408a-bb96-6b9a30d78cb2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:43.638883 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a40849-c0f0-408a-bb96-6b9a30d78cb2 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:43.647842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 5/8] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:43:43 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:43:43.654718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829b8e2-e5f3-4883-8a31-7bc13b0485cc None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:43.663833 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829b8e2-e5f3-4883-8a31-7bc13b0485cc None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:43.668675 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78695b21-6416-4a7f-a27a-98966552f2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:43.669583 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78695b21-6416-4a7f-a27a-98966552f2aa admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:43.669867 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78695b21-6416-4a7f-a27a-98966552f2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:43.670143 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78695b21-6416-4a7f-a27a-98966552f2aa admin admin] PATH_INFO: `/v3/users/4d8d6d5762e340d2aeb3219a15d43128` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:43.671663 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78695b21-6416-4a7f-a27a-98966552f2aa admin admin] RBAC: Authorizing `identity:get_user(user_id=4d8d6d5762e340d2aeb3219a15d43128)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:43.673529 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78695b21-6416-4a7f-a27a-98966552f2aa admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:43.675155 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 4/9] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:43:43 2022] GET /identity/v3/users/4d8d6d5762e340d2aeb3219a15d43128 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:45.967173 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68563c-c725-40e0-8f38-960bad5389ed None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:45.967673 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68563c-c725-40e0-8f38-960bad5389ed None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:45.967673 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68563c-c725-40e0-8f38-960bad5389ed None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:45.969455 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27142da1-8d98-4ea4-865f-df2455f7aab4 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:45.969957 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27142da1-8d98-4ea4-865f-df2455f7aab4 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:45.970122 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 6/10] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:43:45.970209 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27142da1-8d98-4ea4-865f-df2455f7aab4 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:45.972016 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 5/11] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:43:45.976902 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110ebd7-dcbf-4e3c-8474-0aeed46cb337 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:45.977192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110ebd7-dcbf-4e3c-8474-0aeed46cb337 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:45.977494 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110ebd7-dcbf-4e3c-8474-0aeed46cb337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:45.980164 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041ca0e-66c6-4250-be1b-5b24a405ac02 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:45.980485 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041ca0e-66c6-4250-be1b-5b24a405ac02 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:45.980760 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041ca0e-66c6-4250-be1b-5b24a405ac02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:45.997743 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-8041ca0e-66c6-4250-be1b-5b24a405ac02 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:43:45.998924 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-8041ca0e-66c6-4250-be1b-5b24a405ac02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:43:46.006293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 6/12] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:43:45 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:43:46.019476 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG passlib.handlers.bcrypt [None req-6110ebd7-dcbf-4e3c-8474-0aeed46cb337 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79481) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 28 01:43:46.019922 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG passlib.handlers.bcrypt [None req-6110ebd7-dcbf-4e3c-8474-0aeed46cb337 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79481) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 28 01:43:46.030706 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041ca0e-66c6-4250-be1b-5b24a405ac02 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:46.042244 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041ca0e-66c6-4250-be1b-5b24a405ac02 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:46.046574 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a36bee-d2dd-4c31-8af0-3150d50b9f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:46.047193 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a36bee-d2dd-4c31-8af0-3150d50b9f69 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:46.047471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a36bee-d2dd-4c31-8af0-3150d50b9f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:46.047738 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a36bee-d2dd-4c31-8af0-3150d50b9f69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:46.055246 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a36bee-d2dd-4c31-8af0-3150d50b9f69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:46.057575 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a36bee-d2dd-4c31-8af0-3150d50b9f69 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:46.065998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 7/13] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:43:46 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:43:46.069415 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-6110ebd7-dcbf-4e3c-8474-0aeed46cb337 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:43:46.069677 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-6110ebd7-dcbf-4e3c-8474-0aeed46cb337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:43:46.073245 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a36bee-d2dd-4c31-8af0-3150d50b9f69 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:46.081910 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a36bee-d2dd-4c31-8af0-3150d50b9f69 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:46.086250 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b9644-b197-47ce-bea3-bea68b81f8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:46.087232 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b9644-b197-47ce-bea3-bea68b81f8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:46.087723 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b9644-b197-47ce-bea3-bea68b81f8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:46.088006 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b9644-b197-47ce-bea3-bea68b81f8c7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:46.089204 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b9644-b197-47ce-bea3-bea68b81f8c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:46.090886 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b9644-b197-47ce-bea3-bea68b81f8c7 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:46.092435 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 8/14] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:43:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:43:46.108578 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 7/15] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:43:45 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:43:46.135436 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b9644-b197-47ce-bea3-bea68b81f8c7 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:46.145663 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b9644-b197-47ce-bea3-bea68b81f8c7 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:46.150703 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50f521-c566-48dc-8310-ad3ebfe96dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:46.151777 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50f521-c566-48dc-8310-ad3ebfe96dff admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:46.152058 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50f521-c566-48dc-8310-ad3ebfe96dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:46.152330 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50f521-c566-48dc-8310-ad3ebfe96dff admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:46.167784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50f521-c566-48dc-8310-ad3ebfe96dff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:43:46.174752 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-6a50f521-c566-48dc-8310-ad3ebfe96dff admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:43:46.176045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 9/16] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:43:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:43:46.183723 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110ebd7-dcbf-4e3c-8474-0aeed46cb337 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:46.193093 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110ebd7-dcbf-4e3c-8474-0aeed46cb337 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:46.197594 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6402c7-1f95-4ec1-93e0-9cebcc53e29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:46.198593 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6402c7-1f95-4ec1-93e0-9cebcc53e29b admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:46.198876 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6402c7-1f95-4ec1-93e0-9cebcc53e29b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:46.199150 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6402c7-1f95-4ec1-93e0-9cebcc53e29b admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:46.200053 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6402c7-1f95-4ec1-93e0-9cebcc53e29b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:43:46.200357 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6402c7-1f95-4ec1-93e0-9cebcc53e29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:46.202200 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING py.warnings [None req-6d6402c7-1f95-4ec1-93e0-9cebcc53e29b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:43:46.202200 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: warnings.warn(msg) Jan 28 01:43:46.202200 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: Jan 28 01:43:46.203125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6402c7-1f95-4ec1-93e0-9cebcc53e29b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:46.220187 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 8/17] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:43:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:46.226458 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50f521-c566-48dc-8310-ad3ebfe96dff admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:46.237706 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50f521-c566-48dc-8310-ad3ebfe96dff admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:46.242177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf747307-61d7-42d4-b444-7f6141a903b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:46.243707 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf747307-61d7-42d4-b444-7f6141a903b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:46.244121 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf747307-61d7-42d4-b444-7f6141a903b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:46.244621 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf747307-61d7-42d4-b444-7f6141a903b2 admin admin] PATH_INFO: `/v3/users/4d8d6d5762e340d2aeb3219a15d43128` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:46.245867 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf747307-61d7-42d4-b444-7f6141a903b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=4d8d6d5762e340d2aeb3219a15d43128)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:46.247707 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf747307-61d7-42d4-b444-7f6141a903b2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:46.249347 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 10/18] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:43:46 2022] GET /identity/v3/users/4d8d6d5762e340d2aeb3219a15d43128 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:46.255398 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6402c7-1f95-4ec1-93e0-9cebcc53e29b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:46.265197 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6402c7-1f95-4ec1-93e0-9cebcc53e29b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:46.269795 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59e748-8d1d-4cad-a0dd-16a007747ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:46.270578 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59e748-8d1d-4cad-a0dd-16a007747ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:46.270858 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59e748-8d1d-4cad-a0dd-16a007747ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:46.271138 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59e748-8d1d-4cad-a0dd-16a007747ea2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:46.272522 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59e748-8d1d-4cad-a0dd-16a007747ea2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:46.274299 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59e748-8d1d-4cad-a0dd-16a007747ea2 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:46.276275 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 9/19] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:43:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:46.283044 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf747307-61d7-42d4-b444-7f6141a903b2 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:46.293746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf747307-61d7-42d4-b444-7f6141a903b2 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:46.298291 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e93b52-2c8c-41b9-aca0-ae43b4e8f270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:46.298933 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e93b52-2c8c-41b9-aca0-ae43b4e8f270 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:46.299213 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e93b52-2c8c-41b9-aca0-ae43b4e8f270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:46.299485 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e93b52-2c8c-41b9-aca0-ae43b4e8f270 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:46.300314 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e93b52-2c8c-41b9-aca0-ae43b4e8f270 admin admin] RBAC: Adding query filter params (role.id=253c0a1dc8d6421298a7987caaa55676, scope.domain.id=default, user.id=4d8d6d5762e340d2aeb3219a15d43128) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:43:46.300620 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e93b52-2c8c-41b9-aca0-ae43b4e8f270 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:46.302385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-40e93b52-2c8c-41b9-aca0-ae43b4e8f270 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:43:46.302385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:43:46.302385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:43:46.303551 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e93b52-2c8c-41b9-aca0-ae43b4e8f270 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:46.311115 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 11/20] 10.222.0.96 () {56 vars in 1343 bytes} [Fri Jan 28 01:43:46 2022] GET /identity/v3/role_assignments?user.id=4d8d6d5762e340d2aeb3219a15d43128&scope.domain.id=default&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 233 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:48.940627 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a7a77-9aa5-4d94-9e52-06a87f9b4688 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:48.941142 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a7a77-9aa5-4d94-9e52-06a87f9b4688 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:48.941142 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a7a77-9aa5-4d94-9e52-06a87f9b4688 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:48.943055 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 10/21] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:43:48.956598 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05217078-bf49-47bf-aa2c-9b9ca97930c9 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:48.957568 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05217078-bf49-47bf-aa2c-9b9ca97930c9 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:48.958076 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05217078-bf49-47bf-aa2c-9b9ca97930c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:48.980376 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-05217078-bf49-47bf-aa2c-9b9ca97930c9 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:43:48.981978 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-05217078-bf49-47bf-aa2c-9b9ca97930c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:43:48.987131 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa87ea-a228-49d9-b8a8-513e9e237e99 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:48.987723 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa87ea-a228-49d9-b8a8-513e9e237e99 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:48.988218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa87ea-a228-49d9-b8a8-513e9e237e99 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:48.990534 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 11/22] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:43:49.000246 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 12/23] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:43:48 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:43:49.001676 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c057f6-366a-413d-92ed-82b78486cc19 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:49.002182 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c057f6-366a-413d-92ed-82b78486cc19 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:49.002647 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c057f6-366a-413d-92ed-82b78486cc19 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:49.004637 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 12/24] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:43:49.019268 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08031f-b062-4798-b028-cca4133665a7 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:49.019567 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08031f-b062-4798-b028-cca4133665a7 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:49.019818 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08031f-b062-4798-b028-cca4133665a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:49.022856 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368b4ea-618f-4ff0-a0b6-36325bc73456 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:49.023388 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368b4ea-618f-4ff0-a0b6-36325bc73456 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:49.023853 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368b4ea-618f-4ff0-a0b6-36325bc73456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:49.047840 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-ef08031f-b062-4798-b028-cca4133665a7 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:43:49.049018 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-ef08031f-b062-4798-b028-cca4133665a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:43:49.055018 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-3368b4ea-618f-4ff0-a0b6-36325bc73456 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:43:49.056753 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-3368b4ea-618f-4ff0-a0b6-36325bc73456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:43:49.066936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 13/25] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:43:49 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:43:49.067806 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08031f-b062-4798-b028-cca4133665a7 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:49.081355 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 13/26] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:43:49 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:43:49.086632 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08031f-b062-4798-b028-cca4133665a7 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:49.097439 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dbbde-fe00-4394-8224-bf1555ad7645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:49.098245 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dbbde-fe00-4394-8224-bf1555ad7645 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:49.098527 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dbbde-fe00-4394-8224-bf1555ad7645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:49.098799 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dbbde-fe00-4394-8224-bf1555ad7645 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:49.115519 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dbbde-fe00-4394-8224-bf1555ad7645 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:49.117463 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dbbde-fe00-4394-8224-bf1555ad7645 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:49.129055 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368b4ea-618f-4ff0-a0b6-36325bc73456 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:49.142634 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368b4ea-618f-4ff0-a0b6-36325bc73456 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:49.150033 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-d24dbbde-fe00-4394-8224-bf1555ad7645 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:43:49.152061 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 14/27] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:43:49.153817 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591c5b2-cf11-44e7-930b-cb3ad4d7b8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:49.154166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dbbde-fe00-4394-8224-bf1555ad7645 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:49.154837 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591c5b2-cf11-44e7-930b-cb3ad4d7b8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:49.155347 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591c5b2-cf11-44e7-930b-cb3ad4d7b8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:49.155763 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591c5b2-cf11-44e7-930b-cb3ad4d7b8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:49.156668 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591c5b2-cf11-44e7-930b-cb3ad4d7b8e4 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:49.158063 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING py.warnings [None req-e591c5b2-cf11-44e7-930b-cb3ad4d7b8e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:43:49.158063 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: warnings.warn(msg) Jan 28 01:43:49.158063 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: Jan 28 01:43:49.159261 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591c5b2-cf11-44e7-930b-cb3ad4d7b8e4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:49.164718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dbbde-fe00-4394-8224-bf1555ad7645 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:49.175642 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f4ff3-6a2d-4bfd-8731-bfafb9f28846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:49.177166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4ff3-6a2d-4bfd-8731-bfafb9f28846 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:49.178385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4ff3-6a2d-4bfd-8731-bfafb9f28846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:49.179012 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4ff3-6a2d-4bfd-8731-bfafb9f28846 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:49.217380 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f4ff3-6a2d-4bfd-8731-bfafb9f28846 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:43:49.224985 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-4f8f4ff3-6a2d-4bfd-8731-bfafb9f28846 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:43:49.226856 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 15/28] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:43:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:43:49.228752 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f4ff3-6a2d-4bfd-8731-bfafb9f28846 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:49.240701 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f4ff3-6a2d-4bfd-8731-bfafb9f28846 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:49.266352 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab70ecd-8aa4-43e1-93a0-51e8d2721a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:49.267028 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab70ecd-8aa4-43e1-93a0-51e8d2721a5a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:49.267314 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab70ecd-8aa4-43e1-93a0-51e8d2721a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:49.267590 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab70ecd-8aa4-43e1-93a0-51e8d2721a5a admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:49.268324 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab70ecd-8aa4-43e1-93a0-51e8d2721a5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:43:49.268632 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab70ecd-8aa4-43e1-93a0-51e8d2721a5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:49.269692 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-4ab70ecd-8aa4-43e1-93a0-51e8d2721a5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:43:49.269692 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:43:49.269692 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:43:49.270611 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab70ecd-8aa4-43e1-93a0-51e8d2721a5a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:49.315445 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 16/29] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:49.316329 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab70ecd-8aa4-43e1-93a0-51e8d2721a5a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:49.333927 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab70ecd-8aa4-43e1-93a0-51e8d2721a5a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:49.350436 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3c4be-f384-4a35-bba3-a3bbc1123fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:49.351117 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3c4be-f384-4a35-bba3-a3bbc1123fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:49.351407 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3c4be-f384-4a35-bba3-a3bbc1123fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:49.351682 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3c4be-f384-4a35-bba3-a3bbc1123fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:49.353048 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3c4be-f384-4a35-bba3-a3bbc1123fe3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:43:49.353358 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3c4be-f384-4a35-bba3-a3bbc1123fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:49.354400 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-06c3c4be-f384-4a35-bba3-a3bbc1123fe3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:43:49.354400 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:43:49.354400 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:43:49.355333 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3c4be-f384-4a35-bba3-a3bbc1123fe3 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:49.385482 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 17/30] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:43:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:49.387049 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3c4be-f384-4a35-bba3-a3bbc1123fe3 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:49.411263 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3c4be-f384-4a35-bba3-a3bbc1123fe3 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:49.427234 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef695d13-7364-445b-812c-571f0c972c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:49.427904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef695d13-7364-445b-812c-571f0c972c3c admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:49.428189 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef695d13-7364-445b-812c-571f0c972c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:49.428536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef695d13-7364-445b-812c-571f0c972c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:49.429309 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef695d13-7364-445b-812c-571f0c972c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:49.430334 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-ef695d13-7364-445b-812c-571f0c972c3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:43:49.430334 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:43:49.430334 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:43:49.432508 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef695d13-7364-445b-812c-571f0c972c3c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:49.435253 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 14/31] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:43:49 2022] POST /identity/v3/roles => generated 219 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:43:49.436472 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591c5b2-cf11-44e7-930b-cb3ad4d7b8e4 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:49.460775 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591c5b2-cf11-44e7-930b-cb3ad4d7b8e4 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:49.472926 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a834c7-6683-47a3-9032-1e586f24d6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:49.474183 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a834c7-6683-47a3-9032-1e586f24d6fc admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:49.474669 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a834c7-6683-47a3-9032-1e586f24d6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:49.475141 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a834c7-6683-47a3-9032-1e586f24d6fc admin admin] PATH_INFO: `/v3/users/4d8d6d5762e340d2aeb3219a15d43128` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:49.482574 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a834c7-6683-47a3-9032-1e586f24d6fc admin admin] RBAC: Authorizing `identity:get_user(user_id=4d8d6d5762e340d2aeb3219a15d43128)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:49.485162 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a834c7-6683-47a3-9032-1e586f24d6fc admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:49.487803 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 15/32] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:43:49 2022] GET /identity/v3/users/4d8d6d5762e340d2aeb3219a15d43128 => generated 247 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:49.508427 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a834c7-6683-47a3-9032-1e586f24d6fc admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:49.526362 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a834c7-6683-47a3-9032-1e586f24d6fc admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:49.544081 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94864b3-9db0-4d08-8f43-4f0644be0c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:49.550362 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94864b3-9db0-4d08-8f43-4f0644be0c66 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:49.550882 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94864b3-9db0-4d08-8f43-4f0644be0c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:49.551376 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94864b3-9db0-4d08-8f43-4f0644be0c66 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:49.557889 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94864b3-9db0-4d08-8f43-4f0644be0c66 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:49.559916 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94864b3-9db0-4d08-8f43-4f0644be0c66 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:49.561997 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 16/33] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:43:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:43:49.575543 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94864b3-9db0-4d08-8f43-4f0644be0c66 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:49.593294 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94864b3-9db0-4d08-8f43-4f0644be0c66 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:49.605692 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22785711-c72c-4a4d-9161-19e6712d99f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:49.606637 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22785711-c72c-4a4d-9161-19e6712d99f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:49.606919 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22785711-c72c-4a4d-9161-19e6712d99f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:49.607197 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22785711-c72c-4a4d-9161-19e6712d99f0 admin admin] PATH_INFO: `/v3/domains/default/users/4d8d6d5762e340d2aeb3219a15d43128/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:49.612600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22785711-c72c-4a4d-9161-19e6712d99f0 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4d8d6d5762e340d2aeb3219a15d43128, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:49.614182 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING py.warnings [None req-22785711-c72c-4a4d-9161-19e6712d99f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:43:49.614182 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: warnings.warn(msg) Jan 28 01:43:49.614182 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: Jan 28 01:43:49.620627 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22785711-c72c-4a4d-9161-19e6712d99f0 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:49.645109 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 17/34] 10.222.0.96 () {58 vars in 1382 bytes} [Fri Jan 28 01:43:49 2022] PUT /identity/v3/domains/default/users/4d8d6d5762e340d2aeb3219a15d43128/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:43:49.766846 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 18/35] 10.222.0.96 () {60 vars in 1162 bytes} [Fri Jan 28 01:43:49 2022] POST /identity/v3/projects => generated 301 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:43:49.814670 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62ce0d-39b0-4563-8287-a0ca501d8f95 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:49.815310 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62ce0d-39b0-4563-8287-a0ca501d8f95 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:49.815954 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62ce0d-39b0-4563-8287-a0ca501d8f95 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:49.818254 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 18/36] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:43:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:43:49.827665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96545026-b5b7-4398-962a-b198470ec1b2 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:49.828010 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96545026-b5b7-4398-962a-b198470ec1b2 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:49.828247 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96545026-b5b7-4398-962a-b198470ec1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:49.859748 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-96545026-b5b7-4398-962a-b198470ec1b2 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:43:49.861479 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-96545026-b5b7-4398-962a-b198470ec1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:43:49.944820 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 19/37] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:43:49 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:43:49.986222 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62ce0d-39b0-4563-8287-a0ca501d8f95 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:50.003265 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62ce0d-39b0-4563-8287-a0ca501d8f95 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:50.011248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c50fc-8a82-4154-bf51-bc5d2280b2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:50.011987 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c50fc-8a82-4154-bf51-bc5d2280b2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:50.012268 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c50fc-8a82-4154-bf51-bc5d2280b2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:50.012569 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c50fc-8a82-4154-bf51-bc5d2280b2e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:50.013884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c50fc-8a82-4154-bf51-bc5d2280b2e8 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:50.015577 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c50fc-8a82-4154-bf51-bc5d2280b2e8 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:50.034556 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 19/38] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:43:49 2022] POST /identity/v3/roles => generated 225 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:43:50.218082 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb6e47-a54e-41fe-b70c-0e3c149f2015 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:50.219120 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb6e47-a54e-41fe-b70c-0e3c149f2015 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:50.219628 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb6e47-a54e-41fe-b70c-0e3c149f2015 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:50.221769 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 20/39] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:43:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:43:50.231725 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62751e8b-f7ed-4890-9b59-13c27a839055 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:50.232333 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62751e8b-f7ed-4890-9b59-13c27a839055 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:50.232896 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62751e8b-f7ed-4890-9b59-13c27a839055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:50.258523 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-62751e8b-f7ed-4890-9b59-13c27a839055 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:43:50.260571 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-62751e8b-f7ed-4890-9b59-13c27a839055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:43:50.269303 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 20/40] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:43:50 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:43:50.295328 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb6e47-a54e-41fe-b70c-0e3c149f2015 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:50.309414 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb6e47-a54e-41fe-b70c-0e3c149f2015 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:50.314060 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049f8e3-6a7d-48dd-a9b9-f0c64c7dd5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:50.314850 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049f8e3-6a7d-48dd-a9b9-f0c64c7dd5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:50.315136 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049f8e3-6a7d-48dd-a9b9-f0c64c7dd5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:50.315412 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049f8e3-6a7d-48dd-a9b9-f0c64c7dd5f6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:50.316603 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5049f8e3-6a7d-48dd-a9b9-f0c64c7dd5f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:50.318514 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5049f8e3-6a7d-48dd-a9b9-f0c64c7dd5f6 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:50.320423 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 21/41] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:43:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:43:50.327282 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62751e8b-f7ed-4890-9b59-13c27a839055 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:50.336462 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62751e8b-f7ed-4890-9b59-13c27a839055 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:50.341612 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc71f2d-8477-43b6-a210-c7b21d7e4e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:50.342288 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc71f2d-8477-43b6-a210-c7b21d7e4e1f admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:50.342558 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc71f2d-8477-43b6-a210-c7b21d7e4e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:50.342838 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc71f2d-8477-43b6-a210-c7b21d7e4e1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:50.343558 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc71f2d-8477-43b6-a210-c7b21d7e4e1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:50.344586 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING py.warnings [None req-6fc71f2d-8477-43b6-a210-c7b21d7e4e1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:43:50.344586 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: warnings.warn(msg) Jan 28 01:43:50.344586 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: Jan 28 01:43:50.345844 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc71f2d-8477-43b6-a210-c7b21d7e4e1f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:50.383824 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 21/42] 10.222.0.96 () {60 vars in 1162 bytes} [Fri Jan 28 01:43:50 2022] POST /identity/v3/projects => generated 312 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:43:50.632840 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd47fcc-94e1-43d4-9678-bb17a73adc67 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:50.633171 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd47fcc-94e1-43d4-9678-bb17a73adc67 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:50.633401 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd47fcc-94e1-43d4-9678-bb17a73adc67 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:50.635728 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 22/43] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:43:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:43:50.646381 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a54f8-c3de-45c3-a9d8-2aed9685c4cf None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:50.646765 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a54f8-c3de-45c3-a9d8-2aed9685c4cf None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:50.646925 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a54f8-c3de-45c3-a9d8-2aed9685c4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:50.666298 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-f86a54f8-c3de-45c3-a9d8-2aed9685c4cf None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:43:50.667691 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-f86a54f8-c3de-45c3-a9d8-2aed9685c4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:43:50.741996 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 22/44] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:43:50 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:43:50.766024 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd47fcc-94e1-43d4-9678-bb17a73adc67 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:50.780350 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd47fcc-94e1-43d4-9678-bb17a73adc67 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:50.785106 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e10b5-078a-4ddd-bba6-6bd0a13db5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:50.785369 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e10b5-078a-4ddd-bba6-6bd0a13db5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:50.785651 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e10b5-078a-4ddd-bba6-6bd0a13db5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:50.785927 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e10b5-078a-4ddd-bba6-6bd0a13db5f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:50.786684 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e10b5-078a-4ddd-bba6-6bd0a13db5f4 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:50.787788 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-896e10b5-078a-4ddd-bba6-6bd0a13db5f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:43:50.787788 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:43:50.787788 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:43:50.788675 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e10b5-078a-4ddd-bba6-6bd0a13db5f4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:50.804718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 23/45] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:43:50 2022] POST /identity/v3/roles => generated 223 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:43:52.205026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91038229-79b2-47e5-820e-9aadd21fc194 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:52.206234 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91038229-79b2-47e5-820e-9aadd21fc194 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:52.206234 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91038229-79b2-47e5-820e-9aadd21fc194 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:52.207384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 23/46] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:43:52.215323 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae16336-bc8a-4edd-bda5-7ac7da8a43f8 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:52.220359 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae16336-bc8a-4edd-bda5-7ac7da8a43f8 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:52.220359 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae16336-bc8a-4edd-bda5-7ac7da8a43f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:52.237080 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-1ae16336-bc8a-4edd-bda5-7ac7da8a43f8 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:43:52.238353 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-1ae16336-bc8a-4edd-bda5-7ac7da8a43f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:43:52.249412 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 24/47] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:43:52 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:43:52.273360 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91038229-79b2-47e5-820e-9aadd21fc194 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:52.288962 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91038229-79b2-47e5-820e-9aadd21fc194 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:52.294034 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8368e58-c304-4ab4-a1ab-adbbe1551de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:52.294857 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8368e58-c304-4ab4-a1ab-adbbe1551de9 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:52.295139 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8368e58-c304-4ab4-a1ab-adbbe1551de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:52.295412 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8368e58-c304-4ab4-a1ab-adbbe1551de9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:52.307998 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8368e58-c304-4ab4-a1ab-adbbe1551de9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:43:52.314882 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-c8368e58-c304-4ab4-a1ab-adbbe1551de9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:43:52.316113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 24/48] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:43:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:43:52.322603 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae16336-bc8a-4edd-bda5-7ac7da8a43f8 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:52.331976 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae16336-bc8a-4edd-bda5-7ac7da8a43f8 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:52.336537 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfa499-8332-421b-94e4-f5b9a92c0369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:52.337426 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfa499-8332-421b-94e4-f5b9a92c0369 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:52.337618 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfa499-8332-421b-94e4-f5b9a92c0369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:52.337897 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfa499-8332-421b-94e4-f5b9a92c0369 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:52.338647 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfa499-8332-421b-94e4-f5b9a92c0369 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:43:52.338954 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfa499-8332-421b-94e4-f5b9a92c0369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:52.340569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfa499-8332-421b-94e4-f5b9a92c0369 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:52.350670 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 25/49] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:43:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:52.358163 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8368e58-c304-4ab4-a1ab-adbbe1551de9 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:52.374723 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8368e58-c304-4ab4-a1ab-adbbe1551de9 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:52.379436 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be0ceb-2178-4627-b6a1-1d9797ccd44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:52.380309 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be0ceb-2178-4627-b6a1-1d9797ccd44c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:52.380594 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be0ceb-2178-4627-b6a1-1d9797ccd44c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:52.380902 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be0ceb-2178-4627-b6a1-1d9797ccd44c admin admin] PATH_INFO: `/v3/users/4d8d6d5762e340d2aeb3219a15d43128` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:52.382125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be0ceb-2178-4627-b6a1-1d9797ccd44c admin admin] RBAC: Authorizing `identity:get_user(user_id=4d8d6d5762e340d2aeb3219a15d43128)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:52.384626 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be0ceb-2178-4627-b6a1-1d9797ccd44c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:52.386328 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 25/50] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:43:52 2022] GET /identity/v3/users/4d8d6d5762e340d2aeb3219a15d43128 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:52.392688 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfa499-8332-421b-94e4-f5b9a92c0369 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:52.403434 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfa499-8332-421b-94e4-f5b9a92c0369 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:52.408174 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f27a9-ecd1-4c4b-b523-9ee754f2c244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:52.409002 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f27a9-ecd1-4c4b-b523-9ee754f2c244 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:52.410416 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f27a9-ecd1-4c4b-b523-9ee754f2c244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:52.410416 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f27a9-ecd1-4c4b-b523-9ee754f2c244 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:52.410733 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f27a9-ecd1-4c4b-b523-9ee754f2c244 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:52.412431 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f27a9-ecd1-4c4b-b523-9ee754f2c244 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:52.414083 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 26/51] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:43:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:52.421208 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be0ceb-2178-4627-b6a1-1d9797ccd44c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:52.433954 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be0ceb-2178-4627-b6a1-1d9797ccd44c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:52.438564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef18dd2-8456-4824-bbbd-6e5fb9a90cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:52.439225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef18dd2-8456-4824-bbbd-6e5fb9a90cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:52.439513 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef18dd2-8456-4824-bbbd-6e5fb9a90cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:52.439796 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef18dd2-8456-4824-bbbd-6e5fb9a90cb1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:52.440657 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef18dd2-8456-4824-bbbd-6e5fb9a90cb1 admin admin] RBAC: Adding query filter params (role.id=253c0a1dc8d6421298a7987caaa55676, scope.domain.id=default, user.id=4d8d6d5762e340d2aeb3219a15d43128) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:43:52.441005 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef18dd2-8456-4824-bbbd-6e5fb9a90cb1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:52.442022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING py.warnings [None req-9ef18dd2-8456-4824-bbbd-6e5fb9a90cb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:43:52.442022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: warnings.warn(msg) Jan 28 01:43:52.442022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: Jan 28 01:43:52.443196 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef18dd2-8456-4824-bbbd-6e5fb9a90cb1 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:52.450903 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 26/52] 10.222.0.96 () {56 vars in 1343 bytes} [Fri Jan 28 01:43:52 2022] GET /identity/v3/role_assignments?user.id=4d8d6d5762e340d2aeb3219a15d43128&scope.domain.id=default&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 530 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:52.721014 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f5704-acbd-4fe6-a51a-f598d49e802c None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:52.721302 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f5704-acbd-4fe6-a51a-f598d49e802c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:52.721576 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f5704-acbd-4fe6-a51a-f598d49e802c None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:52.723356 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 27/53] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:43:52.731307 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce6346-29a2-473d-9356-685b6caa1740 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:52.731599 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce6346-29a2-473d-9356-685b6caa1740 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:52.731877 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce6346-29a2-473d-9356-685b6caa1740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:52.750306 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-e0ce6346-29a2-473d-9356-685b6caa1740 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:43:52.751506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-e0ce6346-29a2-473d-9356-685b6caa1740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:43:52.759687 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 27/54] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:43:52 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:43:52.783789 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f5704-acbd-4fe6-a51a-f598d49e802c None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:52.796766 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f5704-acbd-4fe6-a51a-f598d49e802c None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:52.801185 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae8623-a1c7-4267-91d2-7f98f5765942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:52.801910 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae8623-a1c7-4267-91d2-7f98f5765942 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:52.802195 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae8623-a1c7-4267-91d2-7f98f5765942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:52.802469 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae8623-a1c7-4267-91d2-7f98f5765942 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:52.803635 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae8623-a1c7-4267-91d2-7f98f5765942 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:52.805429 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae8623-a1c7-4267-91d2-7f98f5765942 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:52.807019 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 28/55] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:43:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:52.813367 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce6346-29a2-473d-9356-685b6caa1740 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:52.823609 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce6346-29a2-473d-9356-685b6caa1740 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:52.828095 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad69564-bea9-4439-b665-1f7b0c71d57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:52.828752 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad69564-bea9-4439-b665-1f7b0c71d57f admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:52.829087 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad69564-bea9-4439-b665-1f7b0c71d57f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:52.829361 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad69564-bea9-4439-b665-1f7b0c71d57f admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:52.830083 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad69564-bea9-4439-b665-1f7b0c71d57f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:52.832025 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad69564-bea9-4439-b665-1f7b0c71d57f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:52.858522 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 28/56] 10.222.0.96 () {60 vars in 1161 bytes} [Fri Jan 28 01:43:52 2022] POST /identity/v3/projects => generated 298 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:43:55.041274 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5292e-b08b-4171-9330-4ae70bca57c4 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:55.041791 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5292e-b08b-4171-9330-4ae70bca57c4 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:55.041910 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5292e-b08b-4171-9330-4ae70bca57c4 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:55.043796 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 29/57] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:43:55.051162 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f25ce2-e3e5-42c9-be02-21a191046ac1 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:55.051617 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f25ce2-e3e5-42c9-be02-21a191046ac1 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:55.051701 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f25ce2-e3e5-42c9-be02-21a191046ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:55.069781 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-07f25ce2-e3e5-42c9-be02-21a191046ac1 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:43:55.071008 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-07f25ce2-e3e5-42c9-be02-21a191046ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:43:55.128082 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 29/58] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:43:55 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:43:55.153189 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5292e-b08b-4171-9330-4ae70bca57c4 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:55.165504 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5292e-b08b-4171-9330-4ae70bca57c4 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:55.169838 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a211358-270d-4734-91c9-48c2b02cbda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:55.170610 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a211358-270d-4734-91c9-48c2b02cbda7 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:55.170891 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a211358-270d-4734-91c9-48c2b02cbda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:55.171162 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a211358-270d-4734-91c9-48c2b02cbda7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:55.172315 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a211358-270d-4734-91c9-48c2b02cbda7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:55.174037 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a211358-270d-4734-91c9-48c2b02cbda7 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:55.175614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 30/59] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:43:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:55.182422 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f25ce2-e3e5-42c9-be02-21a191046ac1 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:55.191243 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f25ce2-e3e5-42c9-be02-21a191046ac1 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:55.195606 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583d97c-9109-4046-98a4-7aa238d0af51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:55.196446 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583d97c-9109-4046-98a4-7aa238d0af51 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:55.196919 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583d97c-9109-4046-98a4-7aa238d0af51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:55.197206 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583d97c-9109-4046-98a4-7aa238d0af51 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:55.197910 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583d97c-9109-4046-98a4-7aa238d0af51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:55.198919 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING py.warnings [None req-d583d97c-9109-4046-98a4-7aa238d0af51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:43:55.198919 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: warnings.warn(msg) Jan 28 01:43:55.198919 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: Jan 28 01:43:55.200146 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583d97c-9109-4046-98a4-7aa238d0af51 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:55.224993 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 30/60] 10.222.0.96 () {60 vars in 1153 bytes} [Fri Jan 28 01:43:55 2022] POST /identity/v3/users => generated 275 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:43:58.703206 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d584b-d299-4508-9e1a-1e9f4d4ab6f0 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:58.704207 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d584b-d299-4508-9e1a-1e9f4d4ab6f0 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:58.704689 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d584b-d299-4508-9e1a-1e9f4d4ab6f0 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:58.707236 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 31/61] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:43:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:43:58.715523 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4e9cf-32c1-43ed-9d26-125704dde19c None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:58.716017 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4e9cf-32c1-43ed-9d26-125704dde19c None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:58.716118 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4e9cf-32c1-43ed-9d26-125704dde19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:58.734933 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-2fe4e9cf-32c1-43ed-9d26-125704dde19c None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:43:58.736137 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2fe4e9cf-32c1-43ed-9d26-125704dde19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:43:58.751679 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 31/62] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:43:58 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:43:58.787512 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d584b-d299-4508-9e1a-1e9f4d4ab6f0 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:58.814425 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcca78-cdba-4525-b936-7393c3985bbe None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:58.814710 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d584b-d299-4508-9e1a-1e9f4d4ab6f0 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:58.815188 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcca78-cdba-4525-b936-7393c3985bbe None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:58.815833 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcca78-cdba-4525-b936-7393c3985bbe None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:58.821514 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 32/63] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:43:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:43:58.823416 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd562ae-103f-4fb4-bc49-f59613bc43eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:58.824308 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd562ae-103f-4fb4-bc49-f59613bc43eb admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:58.824619 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd562ae-103f-4fb4-bc49-f59613bc43eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:58.824936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd562ae-103f-4fb4-bc49-f59613bc43eb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:58.828951 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025415a6-7030-4bf3-bb9f-87c5f704b39f None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:58.832326 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025415a6-7030-4bf3-bb9f-87c5f704b39f None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:58.832945 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025415a6-7030-4bf3-bb9f-87c5f704b39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:58.848725 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd562ae-103f-4fb4-bc49-f59613bc43eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:43:58.856216 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-bdd562ae-103f-4fb4-bc49-f59613bc43eb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:43:58.867640 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-025415a6-7030-4bf3-bb9f-87c5f704b39f None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:43:58.868917 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-025415a6-7030-4bf3-bb9f-87c5f704b39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:43:58.870097 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 32/64] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:43:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:43:58.877066 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd562ae-103f-4fb4-bc49-f59613bc43eb admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:58.891646 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd562ae-103f-4fb4-bc49-f59613bc43eb admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:58.894535 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 33/65] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:43:58 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:43:58.905014 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f00b5d-255b-4856-a406-499bdfb81c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:58.905696 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f00b5d-255b-4856-a406-499bdfb81c0c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:58.905987 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f00b5d-255b-4856-a406-499bdfb81c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:58.906265 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f00b5d-255b-4856-a406-499bdfb81c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:58.907024 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f00b5d-255b-4856-a406-499bdfb81c0c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:43:58.907330 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f00b5d-255b-4856-a406-499bdfb81c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:58.908988 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f00b5d-255b-4856-a406-499bdfb81c0c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:58.918597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 33/66] 10.222.0.96 () {56 vars in 1122 bytes} [Fri Jan 28 01:43:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:43:58.924854 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025415a6-7030-4bf3-bb9f-87c5f704b39f None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:58.928291 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896d97e-5fb8-4901-8b73-fdbadcb02d86 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:58.928852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896d97e-5fb8-4901-8b73-fdbadcb02d86 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:58.929349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896d97e-5fb8-4901-8b73-fdbadcb02d86 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:58.931710 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 34/67] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:43:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:43:58.932705 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896d97e-5fb8-4901-8b73-fdbadcb02d86 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:58.935539 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025415a6-7030-4bf3-bb9f-87c5f704b39f None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:58.941877 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7a308-e3b9-41cc-9881-6955d07e664f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:58.943199 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7a308-e3b9-41cc-9881-6955d07e664f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:58.943971 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7a308-e3b9-41cc-9881-6955d07e664f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:58.944464 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7a308-e3b9-41cc-9881-6955d07e664f admin admin] PATH_INFO: `/v3/users/7c40b316521b482c91d30172096a90c4` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:58.953244 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896d97e-5fb8-4901-8b73-fdbadcb02d86 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:58.958014 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853a524-af40-4371-a763-bc0339fca17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:58.958837 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853a524-af40-4371-a763-bc0339fca17d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:58.959119 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853a524-af40-4371-a763-bc0339fca17d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:58.959392 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853a524-af40-4371-a763-bc0339fca17d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:58.966273 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7a308-e3b9-41cc-9881-6955d07e664f admin admin] RBAC: Authorizing `identity:get_user(user_id=7c40b316521b482c91d30172096a90c4)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:58.969026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7a308-e3b9-41cc-9881-6955d07e664f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:58.971176 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 34/68] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:43:58 2022] GET /identity/v3/users/7c40b316521b482c91d30172096a90c4 => generated 275 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:58.972663 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853a524-af40-4371-a763-bc0339fca17d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:43:58.972953 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e2f72-c975-4767-9adf-60a271725d67 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:58.973458 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e2f72-c975-4767-9adf-60a271725d67 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:58.973944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e2f72-c975-4767-9adf-60a271725d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:58.980161 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-8853a524-af40-4371-a763-bc0339fca17d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:43:58.981692 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 35/69] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:43:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:43:58.982739 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853a524-af40-4371-a763-bc0339fca17d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:58.994322 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853a524-af40-4371-a763-bc0339fca17d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:58.995652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-369e2f72-c975-4767-9adf-60a271725d67 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:43:58.997206 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-369e2f72-c975-4767-9adf-60a271725d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:43:58.999128 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebeb374-2496-4c83-ac27-2835d39dc95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:58.999872 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebeb374-2496-4c83-ac27-2835d39dc95d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.000147 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebeb374-2496-4c83-ac27-2835d39dc95d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.000585 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebeb374-2496-4c83-ac27-2835d39dc95d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.006326 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 35/70] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:43:58 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:43:59.007395 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e2f72-c975-4767-9adf-60a271725d67 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.015706 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebeb374-2496-4c83-ac27-2835d39dc95d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.017373 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e2f72-c975-4767-9adf-60a271725d67 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.017505 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebeb374-2496-4c83-ac27-2835d39dc95d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.022264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b099103-e789-4297-a005-78a1cf2df6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.023168 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b099103-e789-4297-a005-78a1cf2df6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.023650 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b099103-e789-4297-a005-78a1cf2df6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.024157 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b099103-e789-4297-a005-78a1cf2df6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.025207 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b099103-e789-4297-a005-78a1cf2df6c0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:43:59.025719 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b099103-e789-4297-a005-78a1cf2df6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.027783 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b099103-e789-4297-a005-78a1cf2df6c0 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.034724 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 36/71] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:43:58 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:43:59.037906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 36/72] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:59.045594 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84628147-9f58-4952-8768-bd5e2db02d65 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.046077 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84628147-9f58-4952-8768-bd5e2db02d65 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.046492 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84628147-9f58-4952-8768-bd5e2db02d65 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.047115 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b099103-e789-4297-a005-78a1cf2df6c0 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.048920 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 37/73] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:43:59.049806 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84628147-9f58-4952-8768-bd5e2db02d65 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.059871 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b099103-e789-4297-a005-78a1cf2df6c0 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.064304 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84628147-9f58-4952-8768-bd5e2db02d65 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.064486 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfef924-f6f7-41a4-b424-bb6c5c3ee8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.065226 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfef924-f6f7-41a4-b424-bb6c5c3ee8ca admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.065509 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfef924-f6f7-41a4-b424-bb6c5c3ee8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.065838 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfef924-f6f7-41a4-b424-bb6c5c3ee8ca admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.067677 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfef924-f6f7-41a4-b424-bb6c5c3ee8ca admin admin] RBAC: Authorizing `identity:get_project(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.069795 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfef924-f6f7-41a4-b424-bb6c5c3ee8ca admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.072101 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8848a-454b-4733-94c1-6699cabd41b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.072258 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 37/74] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:59.076934 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfef924-f6f7-41a4-b424-bb6c5c3ee8ca admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.077058 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8848a-454b-4733-94c1-6699cabd41b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.077058 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8848a-454b-4733-94c1-6699cabd41b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.077058 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8848a-454b-4733-94c1-6699cabd41b3 admin admin] PATH_INFO: `/v3/users/4d8d6d5762e340d2aeb3219a15d43128` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.078012 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8848a-454b-4733-94c1-6699cabd41b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=4d8d6d5762e340d2aeb3219a15d43128)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.079956 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf8848a-454b-4733-94c1-6699cabd41b3 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.081632 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 38/75] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/users/4d8d6d5762e340d2aeb3219a15d43128 => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:59.082806 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef24915-87ed-462b-b8dc-532ce3a575f0 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.083080 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef24915-87ed-462b-b8dc-532ce3a575f0 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.083352 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef24915-87ed-462b-b8dc-532ce3a575f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.090454 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfef924-f6f7-41a4-b424-bb6c5c3ee8ca admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.094989 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70515072-8602-4103-8b4f-89417e115c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.095799 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70515072-8602-4103-8b4f-89417e115c0a admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.096083 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70515072-8602-4103-8b4f-89417e115c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.096362 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70515072-8602-4103-8b4f-89417e115c0a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.101554 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-2ef24915-87ed-462b-b8dc-532ce3a575f0 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:43:59.103258 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-2ef24915-87ed-462b-b8dc-532ce3a575f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:43:59.108521 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70515072-8602-4103-8b4f-89417e115c0a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:43:59.111016 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 39/76] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:43:59 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:43:59.111604 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef24915-87ed-462b-b8dc-532ce3a575f0 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.117039 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-70515072-8602-4103-8b4f-89417e115c0a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:43:59.117334 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 38/77] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:43:59.119387 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70515072-8602-4103-8b4f-89417e115c0a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.123816 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef24915-87ed-462b-b8dc-532ce3a575f0 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.129208 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805f543-4d31-4803-9b5c-59de1ebec3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.129980 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805f543-4d31-4803-9b5c-59de1ebec3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.130331 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805f543-4d31-4803-9b5c-59de1ebec3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.130671 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805f543-4d31-4803-9b5c-59de1ebec3e1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.131900 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805f543-4d31-4803-9b5c-59de1ebec3e1 admin admin] RBAC: Adding query filter params (role.id=0a6e12c9b8034527a8aa1988febe09ac, scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3, user.id=7c40b316521b482c91d30172096a90c4) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:43:59.132282 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805f543-4d31-4803-9b5c-59de1ebec3e1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.134483 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805f543-4d31-4803-9b5c-59de1ebec3e1 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.135961 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70515072-8602-4103-8b4f-89417e115c0a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.141244 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca7d98-7e4f-47d8-8cb3-baa9cbb92899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.141431 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca7d98-7e4f-47d8-8cb3-baa9cbb92899 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.141641 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 40/78] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/role_assignments?user.id=7c40b316521b482c91d30172096a90c4&scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3&role.id=0a6e12c9b8034527a8aa1988febe09ac => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:59.141740 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca7d98-7e4f-47d8-8cb3-baa9cbb92899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.141982 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca7d98-7e4f-47d8-8cb3-baa9cbb92899 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.142408 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805f543-4d31-4803-9b5c-59de1ebec3e1 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.152267 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca7d98-7e4f-47d8-8cb3-baa9cbb92899 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.154211 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca7d98-7e4f-47d8-8cb3-baa9cbb92899 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.154948 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805f543-4d31-4803-9b5c-59de1ebec3e1 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.160683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4a557-7c09-472f-b0a7-22205fc8ea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.161773 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4a557-7c09-472f-b0a7-22205fc8ea6f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.162100 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4a557-7c09-472f-b0a7-22205fc8ea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.162380 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4a557-7c09-472f-b0a7-22205fc8ea6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.163163 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4a557-7c09-472f-b0a7-22205fc8ea6f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:43:59.163468 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4a557-7c09-472f-b0a7-22205fc8ea6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.164266 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 39/79] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:43:59.166312 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4a557-7c09-472f-b0a7-22205fc8ea6f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.166504 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca7d98-7e4f-47d8-8cb3-baa9cbb92899 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.176054 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca7d98-7e4f-47d8-8cb3-baa9cbb92899 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.177110 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 41/80] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:59.178094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4a557-7c09-472f-b0a7-22205fc8ea6f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.182253 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d371a-86b7-416c-9f63-2b935a293b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.183222 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d371a-86b7-416c-9f63-2b935a293b8b admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.183573 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d371a-86b7-416c-9f63-2b935a293b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.183919 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d371a-86b7-416c-9f63-2b935a293b8b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.190233 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4a557-7c09-472f-b0a7-22205fc8ea6f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.196236 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703322a-27ea-4a95-976e-58fd24dd030a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.197124 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d371a-86b7-416c-9f63-2b935a293b8b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:43:59.197243 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703322a-27ea-4a95-976e-58fd24dd030a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.197433 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703322a-27ea-4a95-976e-58fd24dd030a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.197708 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703322a-27ea-4a95-976e-58fd24dd030a admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.198990 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703322a-27ea-4a95-976e-58fd24dd030a admin admin] RBAC: Authorizing `identity:get_project(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.201104 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703322a-27ea-4a95-976e-58fd24dd030a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.202856 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 42/81] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:59.203629 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703322a-27ea-4a95-976e-58fd24dd030a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.204979 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-c26d371a-86b7-416c-9f63-2b935a293b8b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:43:59.206461 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 40/82] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:43:59.214113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d371a-86b7-416c-9f63-2b935a293b8b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.214465 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703322a-27ea-4a95-976e-58fd24dd030a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.219721 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2db17-ae3e-4af4-a200-71b2914128a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.221303 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2db17-ae3e-4af4-a200-71b2914128a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.221694 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2db17-ae3e-4af4-a200-71b2914128a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.221985 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2db17-ae3e-4af4-a200-71b2914128a2 admin admin] PATH_INFO: `/v3/users/7c40b316521b482c91d30172096a90c4` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.223782 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2db17-ae3e-4af4-a200-71b2914128a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=7c40b316521b482c91d30172096a90c4)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.225677 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d371a-86b7-416c-9f63-2b935a293b8b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.226046 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2db17-ae3e-4af4-a200-71b2914128a2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.228461 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 43/83] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/users/7c40b316521b482c91d30172096a90c4 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:59.229498 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2db17-ae3e-4af4-a200-71b2914128a2 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.231925 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd86116-78e5-4d7e-982f-93226eaedd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.232710 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd86116-78e5-4d7e-982f-93226eaedd15 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.233422 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd86116-78e5-4d7e-982f-93226eaedd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.233825 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd86116-78e5-4d7e-982f-93226eaedd15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.234702 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd86116-78e5-4d7e-982f-93226eaedd15 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:43:59.235112 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd86116-78e5-4d7e-982f-93226eaedd15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.236959 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd86116-78e5-4d7e-982f-93226eaedd15 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.240204 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2db17-ae3e-4af4-a200-71b2914128a2 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.247284 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13499b-1f4b-42b7-98e6-7703fe695b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.248241 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13499b-1f4b-42b7-98e6-7703fe695b61 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.248525 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13499b-1f4b-42b7-98e6-7703fe695b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.248838 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13499b-1f4b-42b7-98e6-7703fe695b61 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.256718 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 41/84] 10.222.0.96 () {56 vars in 1122 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:59.256718 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd86116-78e5-4d7e-982f-93226eaedd15 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.257034 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13499b-1f4b-42b7-98e6-7703fe695b61 admin admin] RBAC: Adding query filter params (role.id=253c0a1dc8d6421298a7987caaa55676, scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3, user.id=4d8d6d5762e340d2aeb3219a15d43128) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:43:59.257034 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13499b-1f4b-42b7-98e6-7703fe695b61 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.257034 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13499b-1f4b-42b7-98e6-7703fe695b61 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.269092 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 44/85] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/role_assignments?user.id=4d8d6d5762e340d2aeb3219a15d43128&scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:59.270351 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13499b-1f4b-42b7-98e6-7703fe695b61 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.270584 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd86116-78e5-4d7e-982f-93226eaedd15 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.277075 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c74428-a06d-4849-b9a1-fd3150b27095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.277846 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c74428-a06d-4849-b9a1-fd3150b27095 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.278087 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c74428-a06d-4849-b9a1-fd3150b27095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.278372 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c74428-a06d-4849-b9a1-fd3150b27095 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.284189 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13499b-1f4b-42b7-98e6-7703fe695b61 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.287670 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c74428-a06d-4849-b9a1-fd3150b27095 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.290569 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c74428-a06d-4849-b9a1-fd3150b27095 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.291918 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7809b68-89c9-4d1a-8269-e27918b380b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.293095 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7809b68-89c9-4d1a-8269-e27918b380b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.293583 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7809b68-89c9-4d1a-8269-e27918b380b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.294118 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7809b68-89c9-4d1a-8269-e27918b380b3 admin admin] PATH_INFO: `/v3/users/7c40b316521b482c91d30172096a90c4` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.295967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7809b68-89c9-4d1a-8269-e27918b380b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=7c40b316521b482c91d30172096a90c4)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.299446 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7809b68-89c9-4d1a-8269-e27918b380b3 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.301736 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 42/87] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:43:59.301924 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 45/87] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/users/7c40b316521b482c91d30172096a90c4 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:59.310070 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c74428-a06d-4849-b9a1-fd3150b27095 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.315570 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7809b68-89c9-4d1a-8269-e27918b380b3 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.331698 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7809b68-89c9-4d1a-8269-e27918b380b3 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.332782 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c74428-a06d-4849-b9a1-fd3150b27095 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.342198 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11770187-44e9-4994-b02e-8691857e10f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.342866 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11770187-44e9-4994-b02e-8691857e10f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.343148 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11770187-44e9-4994-b02e-8691857e10f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.343419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11770187-44e9-4994-b02e-8691857e10f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.344711 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b1c84-63f7-455e-85e4-9018b47326bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.345639 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b1c84-63f7-455e-85e4-9018b47326bb admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.345914 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b1c84-63f7-455e-85e4-9018b47326bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.346186 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b1c84-63f7-455e-85e4-9018b47326bb admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.348084 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b1c84-63f7-455e-85e4-9018b47326bb admin admin] RBAC: Authorizing `identity:get_project(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.350356 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b1c84-63f7-455e-85e4-9018b47326bb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.358724 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 43/88] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 298 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:59.364262 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11770187-44e9-4994-b02e-8691857e10f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.365833 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b1c84-63f7-455e-85e4-9018b47326bb admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.377429 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11770187-44e9-4994-b02e-8691857e10f5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.390800 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b1c84-63f7-455e-85e4-9018b47326bb admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.394647 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 46/89] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:43:59.399248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262fa78-ebca-4ad6-bef8-a760d6c25074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.400655 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262fa78-ebca-4ad6-bef8-a760d6c25074 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.402167 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11770187-44e9-4994-b02e-8691857e10f5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.403831 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262fa78-ebca-4ad6-bef8-a760d6c25074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.404343 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262fa78-ebca-4ad6-bef8-a760d6c25074 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.406330 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262fa78-ebca-4ad6-bef8-a760d6c25074 admin admin] RBAC: Adding query filter params (role.id=fb4c25e67ee749378e33ec4843ae1dbf, scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3, user.id=7c40b316521b482c91d30172096a90c4) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:43:59.407921 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262fa78-ebca-4ad6-bef8-a760d6c25074 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.412028 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262fa78-ebca-4ad6-bef8-a760d6c25074 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.421785 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11770187-44e9-4994-b02e-8691857e10f5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.436907 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 44/90] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/role_assignments?user.id=7c40b316521b482c91d30172096a90c4&scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3&role.id=fb4c25e67ee749378e33ec4843ae1dbf => generated 259 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:43:59.437989 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ba173-63c0-451b-a7e0-dff5a2f34bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.439251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ba173-63c0-451b-a7e0-dff5a2f34bda admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.439792 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ba173-63c0-451b-a7e0-dff5a2f34bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.440275 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ba173-63c0-451b-a7e0-dff5a2f34bda admin admin] PATH_INFO: `/v3/projects/08318c7216804a7bafefeb9cfcce3f64` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.446332 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ba173-63c0-451b-a7e0-dff5a2f34bda admin admin] RBAC: Authorizing `identity:get_project(project_id=08318c7216804a7bafefeb9cfcce3f64)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.449654 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ba173-63c0-451b-a7e0-dff5a2f34bda admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.452031 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 47/91] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/projects/08318c7216804a7bafefeb9cfcce3f64 => generated 312 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:59.459112 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262fa78-ebca-4ad6-bef8-a760d6c25074 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.479333 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262fa78-ebca-4ad6-bef8-a760d6c25074 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.491017 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82eccf4-921e-40a9-8031-5de3b5048668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.491697 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82eccf4-921e-40a9-8031-5de3b5048668 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.491982 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82eccf4-921e-40a9-8031-5de3b5048668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.492259 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82eccf4-921e-40a9-8031-5de3b5048668 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.494386 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82eccf4-921e-40a9-8031-5de3b5048668 admin admin] RBAC: Adding query filter params (role.id=0a6e12c9b8034527a8aa1988febe09ac, scope.project.id=08318c7216804a7bafefeb9cfcce3f64, user.id=7c40b316521b482c91d30172096a90c4) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:43:59.494709 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82eccf4-921e-40a9-8031-5de3b5048668 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.496609 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82eccf4-921e-40a9-8031-5de3b5048668 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.511491 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 45/92] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/role_assignments?user.id=7c40b316521b482c91d30172096a90c4&scope.project.id=08318c7216804a7bafefeb9cfcce3f64&role.id=0a6e12c9b8034527a8aa1988febe09ac => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:59.528610 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bfd95-62fa-4abe-9ade-2f1306df27b0 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.530149 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bfd95-62fa-4abe-9ade-2f1306df27b0 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.530149 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bfd95-62fa-4abe-9ade-2f1306df27b0 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.531081 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 48/93] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:43:59.542797 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc3d0a-ce08-4790-9bcb-cd2d4e85af21 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.543254 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc3d0a-ce08-4790-9bcb-cd2d4e85af21 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.543637 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc3d0a-ce08-4790-9bcb-cd2d4e85af21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.564454 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-7cbc3d0a-ce08-4790-9bcb-cd2d4e85af21 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:43:59.565875 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-7cbc3d0a-ce08-4790-9bcb-cd2d4e85af21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:43:59.576091 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 46/94] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:43:59 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:43:59.601471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bfd95-62fa-4abe-9ade-2f1306df27b0 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.615425 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bfd95-62fa-4abe-9ade-2f1306df27b0 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.620396 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6da82-edc6-4b9a-95b3-879edef86982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.621252 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6da82-edc6-4b9a-95b3-879edef86982 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.621569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6da82-edc6-4b9a-95b3-879edef86982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.621854 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6da82-edc6-4b9a-95b3-879edef86982 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.623226 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6da82-edc6-4b9a-95b3-879edef86982 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.625028 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6da82-edc6-4b9a-95b3-879edef86982 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.626931 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 49/95] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:43:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:43:59.634207 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc3d0a-ce08-4790-9bcb-cd2d4e85af21 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:43:59.643738 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc3d0a-ce08-4790-9bcb-cd2d4e85af21 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:43:59.648684 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329b56e-099f-4b37-910e-066ee97b1e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:43:59.649974 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329b56e-099f-4b37-910e-066ee97b1e04 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:43:59.650255 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329b56e-099f-4b37-910e-066ee97b1e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:43:59.650536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329b56e-099f-4b37-910e-066ee97b1e04 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:43:59.651538 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329b56e-099f-4b37-910e-066ee97b1e04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:43:59.653611 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329b56e-099f-4b37-910e-066ee97b1e04 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:43:59.683772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 47/96] 10.222.0.96 () {60 vars in 1162 bytes} [Fri Jan 28 01:43:59 2022] POST /identity/v3/projects => generated 302 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:44:01.717426 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7f0ba-9b5e-440a-9189-986120d1ddd8 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:01.718027 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7f0ba-9b5e-440a-9189-986120d1ddd8 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:01.718027 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7f0ba-9b5e-440a-9189-986120d1ddd8 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:01.719936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 50/97] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:01.728037 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d329dc-161a-42d6-8b08-b6f434d56378 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:01.728854 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d329dc-161a-42d6-8b08-b6f434d56378 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:01.728854 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d329dc-161a-42d6-8b08-b6f434d56378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:01.754089 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-a2d329dc-161a-42d6-8b08-b6f434d56378 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:01.755351 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-a2d329dc-161a-42d6-8b08-b6f434d56378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:01.841956 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 48/98] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:01 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:01.894967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7f0ba-9b5e-440a-9189-986120d1ddd8 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:01.909363 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7f0ba-9b5e-440a-9189-986120d1ddd8 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:01.916497 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82d0d2-5a88-40eb-9a00-ec5cda7e94ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:01.917337 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82d0d2-5a88-40eb-9a00-ec5cda7e94ba admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:01.917612 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82d0d2-5a88-40eb-9a00-ec5cda7e94ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:01.917885 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82d0d2-5a88-40eb-9a00-ec5cda7e94ba admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:01.921951 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c94a4f-268b-44a0-ba1a-3dd80bd0829d None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:01.922240 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c94a4f-268b-44a0-ba1a-3dd80bd0829d None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:01.922521 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c94a4f-268b-44a0-ba1a-3dd80bd0829d None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:01.924367 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 49/99] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:01.932464 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ce2ed-cafd-4cb8-a4ca-a48cd64ed117 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:01.932751 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ce2ed-cafd-4cb8-a4ca-a48cd64ed117 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:01.933038 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ce2ed-cafd-4cb8-a4ca-a48cd64ed117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:01.959135 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82d0d2-5a88-40eb-9a00-ec5cda7e94ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:01.962486 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-401ce2ed-cafd-4cb8-a4ca-a48cd64ed117 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:01.963940 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-401ce2ed-cafd-4cb8-a4ca-a48cd64ed117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:01.967346 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-2c82d0d2-5a88-40eb-9a00-ec5cda7e94ba admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:44:01.968739 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 51/100] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:01.975056 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82d0d2-5a88-40eb-9a00-ec5cda7e94ba admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:01.977789 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 50/101] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:01 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:01.989946 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82d0d2-5a88-40eb-9a00-ec5cda7e94ba admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:02.001502 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b3f3b-5a1a-4eb2-a921-ee5b3ca222ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:02.002076 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ce2ed-cafd-4cb8-a4ca-a48cd64ed117 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:02.002193 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b3f3b-5a1a-4eb2-a921-ee5b3ca222ff admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.002452 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b3f3b-5a1a-4eb2-a921-ee5b3ca222ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.002726 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b3f3b-5a1a-4eb2-a921-ee5b3ca222ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.003488 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b3f3b-5a1a-4eb2-a921-ee5b3ca222ff admin admin] RBAC: Adding query filter params (name=member) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:02.003790 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b3f3b-5a1a-4eb2-a921-ee5b3ca222ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:02.005442 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b3f3b-5a1a-4eb2-a921-ee5b3ca222ff admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:02.013239 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ce2ed-cafd-4cb8-a4ca-a48cd64ed117 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:02.017797 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ffd73-98c1-4394-9ac9-1bb0ddd71a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:02.018934 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ffd73-98c1-4394-9ac9-1bb0ddd71a30 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.019216 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ffd73-98c1-4394-9ac9-1bb0ddd71a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.019489 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ffd73-98c1-4394-9ac9-1bb0ddd71a30 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.020231 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 52/102] 10.222.0.96 () {56 vars in 1122 bytes} [Fri Jan 28 01:44:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:02.033511 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b3f3b-5a1a-4eb2-a921-ee5b3ca222ff admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:02.043927 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ffd73-98c1-4394-9ac9-1bb0ddd71a30 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:02.054512 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-332ffd73-98c1-4394-9ac9-1bb0ddd71a30 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:44:02.056227 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 51/103] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:02.062470 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b3f3b-5a1a-4eb2-a921-ee5b3ca222ff admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:02.067494 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ffd73-98c1-4394-9ac9-1bb0ddd71a30 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:02.074687 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef63b7-56cc-4d0d-9aab-88bf7a4b5205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:02.075584 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef63b7-56cc-4d0d-9aab-88bf7a4b5205 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.075862 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef63b7-56cc-4d0d-9aab-88bf7a4b5205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.076132 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef63b7-56cc-4d0d-9aab-88bf7a4b5205 admin admin] PATH_INFO: `/v3/users/7c40b316521b482c91d30172096a90c4` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.079763 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef63b7-56cc-4d0d-9aab-88bf7a4b5205 admin admin] RBAC: Authorizing `identity:get_user(user_id=7c40b316521b482c91d30172096a90c4)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:02.082082 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef63b7-56cc-4d0d-9aab-88bf7a4b5205 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:02.084094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 53/104] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:44:02 2022] GET /identity/v3/users/7c40b316521b482c91d30172096a90c4 => generated 275 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:02.091419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef63b7-56cc-4d0d-9aab-88bf7a4b5205 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:02.094622 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ffd73-98c1-4394-9ac9-1bb0ddd71a30 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:02.099546 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2ae3f-d8a9-4c38-966e-fdb23605690a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:02.100549 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2ae3f-d8a9-4c38-966e-fdb23605690a admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.101066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2ae3f-d8a9-4c38-966e-fdb23605690a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.101564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2ae3f-d8a9-4c38-966e-fdb23605690a admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.101664 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef63b7-56cc-4d0d-9aab-88bf7a4b5205 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:02.103024 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2ae3f-d8a9-4c38-966e-fdb23605690a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:02.103718 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2ae3f-d8a9-4c38-966e-fdb23605690a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:02.106074 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2ae3f-d8a9-4c38-966e-fdb23605690a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:02.106285 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6fac4-d63f-4d83-87be-5f0467496485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:02.107066 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6fac4-d63f-4d83-87be-5f0467496485 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.107344 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6fac4-d63f-4d83-87be-5f0467496485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.107618 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6fac4-d63f-4d83-87be-5f0467496485 admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.112822 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6fac4-d63f-4d83-87be-5f0467496485 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:02.112822 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6fac4-d63f-4d83-87be-5f0467496485 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:02.117383 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 54/105] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:02 2022] GET /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:02.120322 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6fac4-d63f-4d83-87be-5f0467496485 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:02.130989 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6fac4-d63f-4d83-87be-5f0467496485 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:02.133099 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 52/106] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:02.141264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2ae3f-d8a9-4c38-966e-fdb23605690a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:02.142189 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336302c6-3c71-4016-994f-c8b76c31dec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:02.143094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336302c6-3c71-4016-994f-c8b76c31dec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.143373 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336302c6-3c71-4016-994f-c8b76c31dec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.143644 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336302c6-3c71-4016-994f-c8b76c31dec1 admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3/users/7c40b316521b482c91d30172096a90c4/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.145648 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336302c6-3c71-4016-994f-c8b76c31dec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3, user_id=7c40b316521b482c91d30172096a90c4, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:02.146677 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-336302c6-3c71-4016-994f-c8b76c31dec1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:02.146677 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:44:02.146677 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:44:02.152821 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336302c6-3c71-4016-994f-c8b76c31dec1 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:02.162769 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2ae3f-d8a9-4c38-966e-fdb23605690a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:02.173006 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 55/107] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:44:02 2022] PUT /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3/users/7c40b316521b482c91d30172096a90c4/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:44:02.259249 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac75cbd-93f3-48ea-8e78-5846aa139568 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.259572 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac75cbd-93f3-48ea-8e78-5846aa139568 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.260463 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac75cbd-93f3-48ea-8e78-5846aa139568 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.264735 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 56/108] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:02.272737 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cab09-25ab-4ef2-9a44-12145a189208 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.273070 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cab09-25ab-4ef2-9a44-12145a189208 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.273335 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cab09-25ab-4ef2-9a44-12145a189208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.278578 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbe2c8-79c4-4c8b-a3ff-9f177c5b130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:02.279852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbe2c8-79c4-4c8b-a3ff-9f177c5b130a admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.280368 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbe2c8-79c4-4c8b-a3ff-9f177c5b130a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.280874 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbe2c8-79c4-4c8b-a3ff-9f177c5b130a admin admin] PATH_INFO: `/v3/users/4d8d6d5762e340d2aeb3219a15d43128` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.282309 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbe2c8-79c4-4c8b-a3ff-9f177c5b130a admin admin] RBAC: Authorizing `identity:get_user(user_id=4d8d6d5762e340d2aeb3219a15d43128)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:02.288826 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbe2c8-79c4-4c8b-a3ff-9f177c5b130a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:02.291221 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 53/109] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:44:02 2022] GET /identity/v3/users/4d8d6d5762e340d2aeb3219a15d43128 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:02.306166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-2e7cab09-25ab-4ef2-9a44-12145a189208 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:02.307517 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-2e7cab09-25ab-4ef2-9a44-12145a189208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:02.310005 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbe2c8-79c4-4c8b-a3ff-9f177c5b130a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:02.319836 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 57/110] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:02 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:02.319836 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda71dd-de40-4c38-acb9-cb876870785a None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.319836 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda71dd-de40-4c38-acb9-cb876870785a None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.319836 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda71dd-de40-4c38-acb9-cb876870785a None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.320227 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 58/111] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:02.330133 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d426b50-48ab-4bb0-a53c-50b82aa5a245 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.330456 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d426b50-48ab-4bb0-a53c-50b82aa5a245 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.330690 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d426b50-48ab-4bb0-a53c-50b82aa5a245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.331338 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbe2c8-79c4-4c8b-a3ff-9f177c5b130a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:02.341077 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1295d3-cf5e-439c-8488-3e481485ef8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:02.342339 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1295d3-cf5e-439c-8488-3e481485ef8f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.342848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1295d3-cf5e-439c-8488-3e481485ef8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.343345 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1295d3-cf5e-439c-8488-3e481485ef8f admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.344986 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1295d3-cf5e-439c-8488-3e481485ef8f admin admin] RBAC: Authorizing `identity:get_project(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:02.347344 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1295d3-cf5e-439c-8488-3e481485ef8f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:02.349520 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 54/112] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:02 2022] GET /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:02.361001 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-6d426b50-48ab-4bb0-a53c-50b82aa5a245 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:02.362700 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-6d426b50-48ab-4bb0-a53c-50b82aa5a245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:02.363280 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1295d3-cf5e-439c-8488-3e481485ef8f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:02.372067 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 59/113] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:02 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:02.376103 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d426b50-48ab-4bb0-a53c-50b82aa5a245 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:02.380091 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1295d3-cf5e-439c-8488-3e481485ef8f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:02.395008 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b167f-d1fe-49a4-b222-679e72690de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:02.396512 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b167f-d1fe-49a4-b222-679e72690de2 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.397011 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b167f-d1fe-49a4-b222-679e72690de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.397461 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b167f-d1fe-49a4-b222-679e72690de2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.399643 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d426b50-48ab-4bb0-a53c-50b82aa5a245 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:02.406007 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a8dce-0d98-4265-a9d6-b218e1068303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:02.407382 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a8dce-0d98-4265-a9d6-b218e1068303 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.408182 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a8dce-0d98-4265-a9d6-b218e1068303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.408664 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a8dce-0d98-4265-a9d6-b218e1068303 admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3/users/4d8d6d5762e340d2aeb3219a15d43128/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.410979 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a8dce-0d98-4265-a9d6-b218e1068303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3, user_id=4d8d6d5762e340d2aeb3219a15d43128, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:02.413244 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b167f-d1fe-49a4-b222-679e72690de2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:02.414226 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a8dce-0d98-4265-a9d6-b218e1068303 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:02.421901 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-887b167f-d1fe-49a4-b222-679e72690de2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:44:02.423235 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 55/114] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:44:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:02.424461 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b167f-d1fe-49a4-b222-679e72690de2 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:02.435447 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 60/115] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:44:02 2022] PUT /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3/users/4d8d6d5762e340d2aeb3219a15d43128/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:44:02.437697 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a8dce-0d98-4265-a9d6-b218e1068303 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:02.440728 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b167f-d1fe-49a4-b222-679e72690de2 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:02.516406 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a8dce-0d98-4265-a9d6-b218e1068303 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:02.521520 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740d1a0-b6ef-4a4c-ac81-e91b6476ad91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:02.522200 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740d1a0-b6ef-4a4c-ac81-e91b6476ad91 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.522480 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740d1a0-b6ef-4a4c-ac81-e91b6476ad91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.523544 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740d1a0-b6ef-4a4c-ac81-e91b6476ad91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.524608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740d1a0-b6ef-4a4c-ac81-e91b6476ad91 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:02.524967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740d1a0-b6ef-4a4c-ac81-e91b6476ad91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:02.527462 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740d1a0-b6ef-4a4c-ac81-e91b6476ad91 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:02.537756 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d04ae-5ee5-464c-a5bd-0655260211ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:02.539134 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d04ae-5ee5-464c-a5bd-0655260211ce admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.540921 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d04ae-5ee5-464c-a5bd-0655260211ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.541665 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d04ae-5ee5-464c-a5bd-0655260211ce admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.544174 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 61/116] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:02.551418 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740d1a0-b6ef-4a4c-ac81-e91b6476ad91 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:02.560693 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d04ae-5ee5-464c-a5bd-0655260211ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:02.564086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740d1a0-b6ef-4a4c-ac81-e91b6476ad91 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:02.568872 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de6de7-5e0e-409a-b268-f4c7bdb12383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:02.569821 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de6de7-5e0e-409a-b268-f4c7bdb12383 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.570104 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de6de7-5e0e-409a-b268-f4c7bdb12383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.570361 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-c41d04ae-5ee5-464c-a5bd-0655260211ce admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:44:02.570483 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de6de7-5e0e-409a-b268-f4c7bdb12383 admin admin] PATH_INFO: `/v3/users/7c40b316521b482c91d30172096a90c4` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.572648 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de6de7-5e0e-409a-b268-f4c7bdb12383 admin admin] RBAC: Authorizing `identity:get_user(user_id=7c40b316521b482c91d30172096a90c4)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:02.573350 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 56/117] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:02.574990 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de6de7-5e0e-409a-b268-f4c7bdb12383 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:02.576775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 62/118] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:44:02 2022] GET /identity/v3/users/7c40b316521b482c91d30172096a90c4 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:02.579864 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d04ae-5ee5-464c-a5bd-0655260211ce admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:02.582872 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de6de7-5e0e-409a-b268-f4c7bdb12383 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:02.592578 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de6de7-5e0e-409a-b268-f4c7bdb12383 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:02.593360 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d04ae-5ee5-464c-a5bd-0655260211ce admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:02.597311 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7076059-c158-4946-aac5-33851378ba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:02.598101 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7076059-c158-4946-aac5-33851378ba26 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.598369 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7076059-c158-4946-aac5-33851378ba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.598643 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7076059-c158-4946-aac5-33851378ba26 admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.599834 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7076059-c158-4946-aac5-33851378ba26 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:02.600409 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cec22a-fd16-469a-998a-77d9ee0c8e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:02.601343 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cec22a-fd16-469a-998a-77d9ee0c8e76 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.601863 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cec22a-fd16-469a-998a-77d9ee0c8e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.601976 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7076059-c158-4946-aac5-33851378ba26 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:02.603378 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cec22a-fd16-469a-998a-77d9ee0c8e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.604349 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cec22a-fd16-469a-998a-77d9ee0c8e76 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:02.604711 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 63/119] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:02 2022] GET /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:02.605166 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cec22a-fd16-469a-998a-77d9ee0c8e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:02.607195 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cec22a-fd16-469a-998a-77d9ee0c8e76 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:02.611005 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7076059-c158-4946-aac5-33851378ba26 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:02.619884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 57/120] 10.222.0.96 () {56 vars in 1122 bytes} [Fri Jan 28 01:44:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:02.626252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cec22a-fd16-469a-998a-77d9ee0c8e76 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:02.627446 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7076059-c158-4946-aac5-33851378ba26 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:02.643818 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cec22a-fd16-469a-998a-77d9ee0c8e76 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:02.646824 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b81db-ba31-4781-9a2d-a7bb3af9c934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:02.648355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b81db-ba31-4781-9a2d-a7bb3af9c934 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.648464 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb089083-3fc6-4f28-b22e-93a43f7daa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:02.649444 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb089083-3fc6-4f28-b22e-93a43f7daa3b admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.649699 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb089083-3fc6-4f28-b22e-93a43f7daa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.649975 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb089083-3fc6-4f28-b22e-93a43f7daa3b admin admin] PATH_INFO: `/v3/users/7c40b316521b482c91d30172096a90c4` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.650438 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b81db-ba31-4781-9a2d-a7bb3af9c934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.651385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b81db-ba31-4781-9a2d-a7bb3af9c934 admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3/users/7c40b316521b482c91d30172096a90c4/roles/fb4c25e67ee749378e33ec4843ae1dbf` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.651569 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb089083-3fc6-4f28-b22e-93a43f7daa3b admin admin] RBAC: Authorizing `identity:get_user(user_id=7c40b316521b482c91d30172096a90c4)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:02.653812 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb089083-3fc6-4f28-b22e-93a43f7daa3b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:02.655759 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 58/121] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:44:02 2022] GET /identity/v3/users/7c40b316521b482c91d30172096a90c4 => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:02.656019 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b81db-ba31-4781-9a2d-a7bb3af9c934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3, user_id=7c40b316521b482c91d30172096a90c4, role_id=fb4c25e67ee749378e33ec4843ae1dbf)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:02.659381 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b81db-ba31-4781-9a2d-a7bb3af9c934 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:02.661765 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb089083-3fc6-4f28-b22e-93a43f7daa3b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:02.672937 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb089083-3fc6-4f28-b22e-93a43f7daa3b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:02.678852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 64/122] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:44:02 2022] PUT /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3/users/7c40b316521b482c91d30172096a90c4/roles/fb4c25e67ee749378e33ec4843ae1dbf => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:44:02.770497 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3242795-1206-4b98-b73d-32e256b41530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:02.771397 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3242795-1206-4b98-b73d-32e256b41530 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.771682 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3242795-1206-4b98-b73d-32e256b41530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.771960 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3242795-1206-4b98-b73d-32e256b41530 admin admin] PATH_INFO: `/v3/projects/08318c7216804a7bafefeb9cfcce3f64` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.773346 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3242795-1206-4b98-b73d-32e256b41530 admin admin] RBAC: Authorizing `identity:get_project(project_id=08318c7216804a7bafefeb9cfcce3f64)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:02.776504 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3242795-1206-4b98-b73d-32e256b41530 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:02.778827 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 59/123] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:02 2022] GET /identity/v3/projects/08318c7216804a7bafefeb9cfcce3f64 => generated 312 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:02.785000 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b81db-ba31-4781-9a2d-a7bb3af9c934 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:02.803364 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b81db-ba31-4781-9a2d-a7bb3af9c934 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:02.821653 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57967ba5-a285-44f6-82a5-3588f5065aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:02.822515 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57967ba5-a285-44f6-82a5-3588f5065aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:02.823026 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57967ba5-a285-44f6-82a5-3588f5065aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:02.823309 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57967ba5-a285-44f6-82a5-3588f5065aa0 admin admin] PATH_INFO: `/v3/projects/08318c7216804a7bafefeb9cfcce3f64/users/7c40b316521b482c91d30172096a90c4/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:02.825556 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57967ba5-a285-44f6-82a5-3588f5065aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08318c7216804a7bafefeb9cfcce3f64, user_id=7c40b316521b482c91d30172096a90c4, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:02.828269 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57967ba5-a285-44f6-82a5-3588f5065aa0 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:02.852893 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 65/124] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:44:02 2022] PUT /identity/v3/projects/08318c7216804a7bafefeb9cfcce3f64/users/7c40b316521b482c91d30172096a90c4/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:44:03.042247 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc98b4-6a57-4a9b-b324-ff11b35964ae None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:03.042639 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc98b4-6a57-4a9b-b324-ff11b35964ae None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:03.042817 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc98b4-6a57-4a9b-b324-ff11b35964ae None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:03.044643 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 60/125] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:03.052764 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff941a-1093-41c1-a2d6-17e78d833e08 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:03.053078 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff941a-1093-41c1-a2d6-17e78d833e08 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:03.053352 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff941a-1093-41c1-a2d6-17e78d833e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:03.077906 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-54ff941a-1093-41c1-a2d6-17e78d833e08 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:03.079229 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-54ff941a-1093-41c1-a2d6-17e78d833e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:03.149933 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 66/126] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:03 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:03.175892 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc98b4-6a57-4a9b-b324-ff11b35964ae None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:03.194148 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc98b4-6a57-4a9b-b324-ff11b35964ae None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:03.200157 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54095528-640c-4de1-a05f-f67c5c9c79dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:03.200992 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54095528-640c-4de1-a05f-f67c5c9c79dc admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:03.201272 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54095528-640c-4de1-a05f-f67c5c9c79dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:03.201547 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54095528-640c-4de1-a05f-f67c5c9c79dc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:03.202719 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54095528-640c-4de1-a05f-f67c5c9c79dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:03.204472 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54095528-640c-4de1-a05f-f67c5c9c79dc admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:03.206427 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 61/127] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:03.212750 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff941a-1093-41c1-a2d6-17e78d833e08 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:03.226026 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff941a-1093-41c1-a2d6-17e78d833e08 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:03.235881 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e7fda-245e-40bc-b66f-85d398bbc8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:03.236559 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e7fda-245e-40bc-b66f-85d398bbc8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:03.236895 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e7fda-245e-40bc-b66f-85d398bbc8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:03.237131 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e7fda-245e-40bc-b66f-85d398bbc8b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:03.237840 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e7fda-245e-40bc-b66f-85d398bbc8b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:03.238863 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-727e7fda-245e-40bc-b66f-85d398bbc8b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:03.238863 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:44:03.238863 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:44:03.240071 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e7fda-245e-40bc-b66f-85d398bbc8b4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:03.276011 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 67/128] 10.222.0.96 () {60 vars in 1153 bytes} [Fri Jan 28 01:44:03 2022] POST /identity/v3/users => generated 283 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:44:05.001126 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8b4d4-78be-436a-a88f-4e0855f36ca6 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.001636 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8b4d4-78be-436a-a88f-4e0855f36ca6 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.001741 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8b4d4-78be-436a-a88f-4e0855f36ca6 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.003446 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 62/129] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:05.011136 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d5f11-bffc-4823-aa88-78aa5c293677 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.011587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d5f11-bffc-4823-aa88-78aa5c293677 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.011804 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d5f11-bffc-4823-aa88-78aa5c293677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.037824 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-b10d5f11-bffc-4823-aa88-78aa5c293677 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:05.039039 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b10d5f11-bffc-4823-aa88-78aa5c293677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:05.047353 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 68/130] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:05 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:05.082065 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8b4d4-78be-436a-a88f-4e0855f36ca6 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:05.094636 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8b4d4-78be-436a-a88f-4e0855f36ca6 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:05.099040 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5d2c4-2635-40b5-97b7-4f31fd74aee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:05.099836 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5d2c4-2635-40b5-97b7-4f31fd74aee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.100118 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5d2c4-2635-40b5-97b7-4f31fd74aee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.100392 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5d2c4-2635-40b5-97b7-4f31fd74aee9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.112413 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5d2c4-2635-40b5-97b7-4f31fd74aee9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:05.119881 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-3df5d2c4-2635-40b5-97b7-4f31fd74aee9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:44:05.121434 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 63/131] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:05.128008 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d5f11-bffc-4823-aa88-78aa5c293677 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:05.137211 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d5f11-bffc-4823-aa88-78aa5c293677 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:05.141751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b427ec3-cfba-4f75-8905-c5c119b01657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:05.142418 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b427ec3-cfba-4f75-8905-c5c119b01657 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.142704 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b427ec3-cfba-4f75-8905-c5c119b01657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.142980 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b427ec3-cfba-4f75-8905-c5c119b01657 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.143726 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b427ec3-cfba-4f75-8905-c5c119b01657 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:05.144035 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b427ec3-cfba-4f75-8905-c5c119b01657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:05.145683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b427ec3-cfba-4f75-8905-c5c119b01657 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:05.157860 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 69/132] 10.222.0.96 () {56 vars in 1122 bytes} [Fri Jan 28 01:44:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:05.163854 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5d2c4-2635-40b5-97b7-4f31fd74aee9 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:05.175652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5d2c4-2635-40b5-97b7-4f31fd74aee9 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:05.180178 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc7554-888e-4aed-a501-378de3ea598a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:05.181661 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc7554-888e-4aed-a501-378de3ea598a admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.181945 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc7554-888e-4aed-a501-378de3ea598a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.182215 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc7554-888e-4aed-a501-378de3ea598a admin admin] PATH_INFO: `/v3/users/7c40b316521b482c91d30172096a90c4` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.183443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc7554-888e-4aed-a501-378de3ea598a admin admin] RBAC: Authorizing `identity:get_user(user_id=7c40b316521b482c91d30172096a90c4)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:05.185631 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc7554-888e-4aed-a501-378de3ea598a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:05.187274 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 64/133] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:44:05 2022] GET /identity/v3/users/7c40b316521b482c91d30172096a90c4 => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:05.193367 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b427ec3-cfba-4f75-8905-c5c119b01657 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:05.203727 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b427ec3-cfba-4f75-8905-c5c119b01657 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:05.208278 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a98490-8d18-4186-8b10-fdd9052117d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:05.209013 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a98490-8d18-4186-8b10-fdd9052117d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.209294 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a98490-8d18-4186-8b10-fdd9052117d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.209563 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a98490-8d18-4186-8b10-fdd9052117d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.218867 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a98490-8d18-4186-8b10-fdd9052117d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:05.220673 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a98490-8d18-4186-8b10-fdd9052117d7 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:05.230594 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 70/134] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:05 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:05.236825 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc7554-888e-4aed-a501-378de3ea598a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:05.246652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc7554-888e-4aed-a501-378de3ea598a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:05.251257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f490f9-1065-4fd1-939c-4bf13614d719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:05.252105 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f490f9-1065-4fd1-939c-4bf13614d719 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.252391 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f490f9-1065-4fd1-939c-4bf13614d719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.252665 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f490f9-1065-4fd1-939c-4bf13614d719 admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.253876 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f490f9-1065-4fd1-939c-4bf13614d719 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:05.255916 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f490f9-1065-4fd1-939c-4bf13614d719 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:05.257623 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 65/135] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:05 2022] GET /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:05.264212 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a98490-8d18-4186-8b10-fdd9052117d7 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:05.273764 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a98490-8d18-4186-8b10-fdd9052117d7 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:05.279434 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26d21f-1a1a-4152-b30b-b61a45ce629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:05.280160 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26d21f-1a1a-4152-b30b-b61a45ce629d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.280439 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26d21f-1a1a-4152-b30b-b61a45ce629d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.280760 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26d21f-1a1a-4152-b30b-b61a45ce629d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.281638 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26d21f-1a1a-4152-b30b-b61a45ce629d admin admin] RBAC: Adding query filter params (role.id=0a6e12c9b8034527a8aa1988febe09ac, scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3, user.id=7c40b316521b482c91d30172096a90c4) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:05.281954 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26d21f-1a1a-4152-b30b-b61a45ce629d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:05.283936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26d21f-1a1a-4152-b30b-b61a45ce629d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:05.291515 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 71/136] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:05 2022] GET /identity/v3/role_assignments?user.id=7c40b316521b482c91d30172096a90c4&scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3&role.id=0a6e12c9b8034527a8aa1988febe09ac => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:05.389116 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664ae75-5c31-4672-b0aa-8dc3d4ffdaef None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.389451 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664ae75-5c31-4672-b0aa-8dc3d4ffdaef None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.389669 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664ae75-5c31-4672-b0aa-8dc3d4ffdaef None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.391445 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 66/137] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:05.400329 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbb543-d15e-4b4b-86b2-5b51cda59f41 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.400685 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbb543-d15e-4b4b-86b2-5b51cda59f41 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.400992 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbb543-d15e-4b4b-86b2-5b51cda59f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.433821 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-50cbb543-d15e-4b4b-86b2-5b51cda59f41 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:05.435045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-50cbb543-d15e-4b4b-86b2-5b51cda59f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:05.445159 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 72/138] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:05 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:05.493595 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664ae75-5c31-4672-b0aa-8dc3d4ffdaef None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:05.509534 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664ae75-5c31-4672-b0aa-8dc3d4ffdaef None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:05.514255 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14157a-0d68-49f5-8b43-abc6d422c5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:05.515181 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14157a-0d68-49f5-8b43-abc6d422c5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.515465 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14157a-0d68-49f5-8b43-abc6d422c5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.515742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14157a-0d68-49f5-8b43-abc6d422c5b9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.528620 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14157a-0d68-49f5-8b43-abc6d422c5b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:05.536250 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-8e14157a-0d68-49f5-8b43-abc6d422c5b9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:44:05.537511 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 67/139] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:44:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:05.544527 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbb543-d15e-4b4b-86b2-5b51cda59f41 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:05.556725 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbb543-d15e-4b4b-86b2-5b51cda59f41 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:05.564552 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe58d93-f904-47bf-83e2-02632c0d21db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:05.565254 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe58d93-f904-47bf-83e2-02632c0d21db admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.565534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe58d93-f904-47bf-83e2-02632c0d21db admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.565807 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe58d93-f904-47bf-83e2-02632c0d21db admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.566616 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe58d93-f904-47bf-83e2-02632c0d21db admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:05.566921 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe58d93-f904-47bf-83e2-02632c0d21db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:05.568646 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe58d93-f904-47bf-83e2-02632c0d21db admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:05.580740 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 73/140] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:05.586958 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14157a-0d68-49f5-8b43-abc6d422c5b9 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:05.595320 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba10cf5-f77a-428a-9d88-be44fa0ec9a8 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.595894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba10cf5-f77a-428a-9d88-be44fa0ec9a8 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.596384 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba10cf5-f77a-428a-9d88-be44fa0ec9a8 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.597111 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14157a-0d68-49f5-8b43-abc6d422c5b9 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:05.599137 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 74/141] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:05.606638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddddb79-a8d7-4aeb-a44c-6a894bd16d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:05.607585 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddddb79-a8d7-4aeb-a44c-6a894bd16d36 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.607916 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddddb79-a8d7-4aeb-a44c-6a894bd16d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.608192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddddb79-a8d7-4aeb-a44c-6a894bd16d36 admin admin] PATH_INFO: `/v3/users/7c40b316521b482c91d30172096a90c4` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.609662 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d32b1-050c-4984-9a33-f84af4876540 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.610157 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d32b1-050c-4984-9a33-f84af4876540 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.610273 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddddb79-a8d7-4aeb-a44c-6a894bd16d36 admin admin] RBAC: Authorizing `identity:get_user(user_id=7c40b316521b482c91d30172096a90c4)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:05.610753 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d32b1-050c-4984-9a33-f84af4876540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.613362 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddddb79-a8d7-4aeb-a44c-6a894bd16d36 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:05.614331 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 68/142] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:44:05 2022] GET /identity/v3/users/7c40b316521b482c91d30172096a90c4 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:05.620915 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddddb79-a8d7-4aeb-a44c-6a894bd16d36 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:05.637087 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddddb79-a8d7-4aeb-a44c-6a894bd16d36 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:05.637798 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-251d32b1-050c-4984-9a33-f84af4876540 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:05.639119 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-251d32b1-050c-4984-9a33-f84af4876540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:05.648137 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ac8c0-4929-4959-9b5b-23291694e160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:05.649750 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ac8c0-4929-4959-9b5b-23291694e160 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.650248 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 75/143] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:05 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:05.650693 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ac8c0-4929-4959-9b5b-23291694e160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.651466 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ac8c0-4929-4959-9b5b-23291694e160 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.664462 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ac8c0-4929-4959-9b5b-23291694e160 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:05.666602 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ac8c0-4929-4959-9b5b-23291694e160 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:05.678781 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 69/144] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:05 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:05.685203 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d32b1-050c-4984-9a33-f84af4876540 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:05.699207 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ac8c0-4929-4959-9b5b-23291694e160 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:05.699375 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d32b1-050c-4984-9a33-f84af4876540 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:05.707787 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba9c91-218d-46af-82f7-619eaa4d531b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:05.708661 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba9c91-218d-46af-82f7-619eaa4d531b admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.708971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba9c91-218d-46af-82f7-619eaa4d531b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.709250 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba9c91-218d-46af-82f7-619eaa4d531b admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.710792 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba9c91-218d-46af-82f7-619eaa4d531b admin admin] RBAC: Authorizing `identity:get_project(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:05.713478 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ac8c0-4929-4959-9b5b-23291694e160 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:05.713676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba9c91-218d-46af-82f7-619eaa4d531b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:05.715690 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 76/145] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:05 2022] GET /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:05.722896 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba9c91-218d-46af-82f7-619eaa4d531b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:05.726592 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c269e-127c-44e5-bcaa-d64d6523e7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:05.727731 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c269e-127c-44e5-bcaa-d64d6523e7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.728269 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c269e-127c-44e5-bcaa-d64d6523e7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.728768 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c269e-127c-44e5-bcaa-d64d6523e7c5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.738944 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba9c91-218d-46af-82f7-619eaa4d531b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:05.749455 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963bf95-96ab-4a8f-a7ce-f7e276d66ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:05.751439 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c269e-127c-44e5-bcaa-d64d6523e7c5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:05.752316 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963bf95-96ab-4a8f-a7ce-f7e276d66ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.752601 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963bf95-96ab-4a8f-a7ce-f7e276d66ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.752925 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963bf95-96ab-4a8f-a7ce-f7e276d66ae9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.753808 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963bf95-96ab-4a8f-a7ce-f7e276d66ae9 admin admin] RBAC: Adding query filter params (role.id=fb4c25e67ee749378e33ec4843ae1dbf, scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3, user.id=7c40b316521b482c91d30172096a90c4) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:05.754119 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963bf95-96ab-4a8f-a7ce-f7e276d66ae9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:05.759976 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963bf95-96ab-4a8f-a7ce-f7e276d66ae9 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:05.766277 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-0f9c269e-127c-44e5-bcaa-d64d6523e7c5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:44:05.768640 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 70/146] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:05.774541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 77/147] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:05 2022] GET /identity/v3/role_assignments?user.id=7c40b316521b482c91d30172096a90c4&scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3&role.id=fb4c25e67ee749378e33ec4843ae1dbf => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:05.786735 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c269e-127c-44e5-bcaa-d64d6523e7c5 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:05.797593 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c269e-127c-44e5-bcaa-d64d6523e7c5 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:05.805132 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60122aa-6a9c-4342-b61a-e1a8831a8753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:05.806136 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60122aa-6a9c-4342-b61a-e1a8831a8753 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.806583 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60122aa-6a9c-4342-b61a-e1a8831a8753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.807036 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60122aa-6a9c-4342-b61a-e1a8831a8753 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.808007 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60122aa-6a9c-4342-b61a-e1a8831a8753 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:05.808522 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60122aa-6a9c-4342-b61a-e1a8831a8753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:05.810404 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60122aa-6a9c-4342-b61a-e1a8831a8753 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:05.825915 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 71/148] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:05.832130 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963bf95-96ab-4a8f-a7ce-f7e276d66ae9 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:05.843507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963bf95-96ab-4a8f-a7ce-f7e276d66ae9 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:05.848741 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ced30-b58c-446f-bb20-d82a84f99e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:05.849915 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ced30-b58c-446f-bb20-d82a84f99e7c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.850333 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ced30-b58c-446f-bb20-d82a84f99e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.850790 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ced30-b58c-446f-bb20-d82a84f99e7c admin admin] PATH_INFO: `/v3/users/4d8d6d5762e340d2aeb3219a15d43128` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.852529 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ced30-b58c-446f-bb20-d82a84f99e7c admin admin] RBAC: Authorizing `identity:get_user(user_id=4d8d6d5762e340d2aeb3219a15d43128)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:05.854709 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ced30-b58c-446f-bb20-d82a84f99e7c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:05.856859 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 78/149] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:44:05 2022] GET /identity/v3/users/4d8d6d5762e340d2aeb3219a15d43128 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:05.865058 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60122aa-6a9c-4342-b61a-e1a8831a8753 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:05.876698 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60122aa-6a9c-4342-b61a-e1a8831a8753 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:05.885910 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497164f-22e1-40cd-abfd-750816060f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:05.886994 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497164f-22e1-40cd-abfd-750816060f44 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.887455 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497164f-22e1-40cd-abfd-750816060f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.887885 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497164f-22e1-40cd-abfd-750816060f44 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.898010 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497164f-22e1-40cd-abfd-750816060f44 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:05.900828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497164f-22e1-40cd-abfd-750816060f44 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:05.911649 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 72/150] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:05 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:05.918050 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ced30-b58c-446f-bb20-d82a84f99e7c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:05.928494 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ced30-b58c-446f-bb20-d82a84f99e7c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:05.934355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccf596-3dd8-424d-a91a-4580b1d304d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:05.935536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccf596-3dd8-424d-a91a-4580b1d304d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.935960 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccf596-3dd8-424d-a91a-4580b1d304d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.936415 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccf596-3dd8-424d-a91a-4580b1d304d6 admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.937911 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccf596-3dd8-424d-a91a-4580b1d304d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:05.940348 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccf596-3dd8-424d-a91a-4580b1d304d6 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:05.942491 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 79/151] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:05 2022] GET /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:05.949529 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497164f-22e1-40cd-abfd-750816060f44 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:05.958990 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497164f-22e1-40cd-abfd-750816060f44 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:05.966823 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593df27-b5f7-49ba-a5a9-1bf17209e729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:05.967877 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593df27-b5f7-49ba-a5a9-1bf17209e729 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.968316 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593df27-b5f7-49ba-a5a9-1bf17209e729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.968732 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593df27-b5f7-49ba-a5a9-1bf17209e729 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.969902 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593df27-b5f7-49ba-a5a9-1bf17209e729 admin admin] RBAC: Adding query filter params (role.id=253c0a1dc8d6421298a7987caaa55676, scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3, user.id=4d8d6d5762e340d2aeb3219a15d43128) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:05.970411 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593df27-b5f7-49ba-a5a9-1bf17209e729 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:05.972609 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593df27-b5f7-49ba-a5a9-1bf17209e729 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:05.980119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 73/152] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:05 2022] GET /identity/v3/role_assignments?user.id=4d8d6d5762e340d2aeb3219a15d43128&scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:05.985042 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edb194-a18b-4ea2-9dc7-09a1830a327a None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.985532 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edb194-a18b-4ea2-9dc7-09a1830a327a None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.985946 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edb194-a18b-4ea2-9dc7-09a1830a327a None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:05.988124 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 80/153] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:05.997476 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a776f-5a47-403c-b44e-9a6171c05220 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:05.997761 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a776f-5a47-403c-b44e-9a6171c05220 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:05.998038 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a776f-5a47-403c-b44e-9a6171c05220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:06.030109 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-980a776f-5a47-403c-b44e-9a6171c05220 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:06.031274 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-980a776f-5a47-403c-b44e-9a6171c05220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:06.042943 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 74/154] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:05 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:06.082881 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edb194-a18b-4ea2-9dc7-09a1830a327a None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:06.099046 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edb194-a18b-4ea2-9dc7-09a1830a327a None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:06.106718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3762e4-1a48-47a6-8da9-7539b2acbf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:06.107823 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3762e4-1a48-47a6-8da9-7539b2acbf14 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:06.108240 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3762e4-1a48-47a6-8da9-7539b2acbf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:06.108736 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3762e4-1a48-47a6-8da9-7539b2acbf14 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:06.130766 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3762e4-1a48-47a6-8da9-7539b2acbf14 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:06.138328 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-2d3762e4-1a48-47a6-8da9-7539b2acbf14 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:44:06.139805 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 81/155] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:06.146642 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a776f-5a47-403c-b44e-9a6171c05220 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:06.162550 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a776f-5a47-403c-b44e-9a6171c05220 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:06.167624 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb8709-7abb-4575-ad5e-92473fa6fc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:06.168311 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb8709-7abb-4575-ad5e-92473fa6fc5a admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:06.168593 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb8709-7abb-4575-ad5e-92473fa6fc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:06.168894 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb8709-7abb-4575-ad5e-92473fa6fc5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:06.169658 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb8709-7abb-4575-ad5e-92473fa6fc5a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:06.169964 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb8709-7abb-4575-ad5e-92473fa6fc5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:06.171572 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb8709-7abb-4575-ad5e-92473fa6fc5a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:06.185792 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 75/156] 10.222.0.96 () {56 vars in 1122 bytes} [Fri Jan 28 01:44:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:06.192521 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3762e4-1a48-47a6-8da9-7539b2acbf14 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:06.203799 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3762e4-1a48-47a6-8da9-7539b2acbf14 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:06.213194 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5bb8f-701f-4f17-9b6a-5a6cad5570c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:06.214089 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5bb8f-701f-4f17-9b6a-5a6cad5570c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:06.214374 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5bb8f-701f-4f17-9b6a-5a6cad5570c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:06.214644 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5bb8f-701f-4f17-9b6a-5a6cad5570c8 admin admin] PATH_INFO: `/v3/users/7c40b316521b482c91d30172096a90c4` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:06.215927 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5bb8f-701f-4f17-9b6a-5a6cad5570c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=7c40b316521b482c91d30172096a90c4)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:06.218141 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5bb8f-701f-4f17-9b6a-5a6cad5570c8 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:06.219868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 82/157] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:44:06 2022] GET /identity/v3/users/7c40b316521b482c91d30172096a90c4 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:06.226400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb8709-7abb-4575-ad5e-92473fa6fc5a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:06.236565 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb8709-7abb-4575-ad5e-92473fa6fc5a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:06.245472 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75aa21-eb15-4d36-b746-b143a6f54072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:06.246133 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75aa21-eb15-4d36-b746-b143a6f54072 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:06.246418 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75aa21-eb15-4d36-b746-b143a6f54072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:06.246699 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75aa21-eb15-4d36-b746-b143a6f54072 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:06.261600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75aa21-eb15-4d36-b746-b143a6f54072 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:06.263399 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75aa21-eb15-4d36-b746-b143a6f54072 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:06.280285 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 76/158] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:06 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:06.286712 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5bb8f-701f-4f17-9b6a-5a6cad5570c8 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:06.297180 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5bb8f-701f-4f17-9b6a-5a6cad5570c8 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:06.305931 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bedef-0995-4f38-ae72-19e67cdfb1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:06.306985 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bedef-0995-4f38-ae72-19e67cdfb1ca admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:06.307265 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bedef-0995-4f38-ae72-19e67cdfb1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:06.307536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bedef-0995-4f38-ae72-19e67cdfb1ca admin admin] PATH_INFO: `/v3/projects/08318c7216804a7bafefeb9cfcce3f64` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:06.313573 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467bedef-0995-4f38-ae72-19e67cdfb1ca admin admin] RBAC: Authorizing `identity:get_project(project_id=08318c7216804a7bafefeb9cfcce3f64)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:06.315665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467bedef-0995-4f38-ae72-19e67cdfb1ca admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:06.317637 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 83/159] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:06 2022] GET /identity/v3/projects/08318c7216804a7bafefeb9cfcce3f64 => generated 312 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:06.325192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75aa21-eb15-4d36-b746-b143a6f54072 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:06.334629 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75aa21-eb15-4d36-b746-b143a6f54072 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:06.345113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19e4c4-a336-46b9-b173-ddabf2de833b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:06.345790 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19e4c4-a336-46b9-b173-ddabf2de833b admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:06.346074 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19e4c4-a336-46b9-b173-ddabf2de833b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:06.346353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19e4c4-a336-46b9-b173-ddabf2de833b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:06.347208 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19e4c4-a336-46b9-b173-ddabf2de833b admin admin] RBAC: Adding query filter params (role.id=0a6e12c9b8034527a8aa1988febe09ac, scope.project.id=08318c7216804a7bafefeb9cfcce3f64, user.id=7c40b316521b482c91d30172096a90c4) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:06.347533 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19e4c4-a336-46b9-b173-ddabf2de833b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:06.349460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19e4c4-a336-46b9-b173-ddabf2de833b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:06.361919 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 77/160] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:06 2022] GET /identity/v3/role_assignments?user.id=7c40b316521b482c91d30172096a90c4&scope.project.id=08318c7216804a7bafefeb9cfcce3f64&role.id=0a6e12c9b8034527a8aa1988febe09ac => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:07.351769 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179b5c0-a8b2-4eb1-a88c-b0197ec292d3 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:07.352830 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179b5c0-a8b2-4eb1-a88c-b0197ec292d3 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:07.352910 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179b5c0-a8b2-4eb1-a88c-b0197ec292d3 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:07.354837 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 84/161] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:07.362520 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e55ae-328b-4f0a-82ce-7a17e867e016 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:07.362957 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e55ae-328b-4f0a-82ce-7a17e867e016 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:07.363196 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e55ae-328b-4f0a-82ce-7a17e867e016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:07.381377 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-2f3e55ae-328b-4f0a-82ce-7a17e867e016 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:07.382573 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2f3e55ae-328b-4f0a-82ce-7a17e867e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:07.396900 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 78/162] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:07 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:07.416922 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179b5c0-a8b2-4eb1-a88c-b0197ec292d3 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:07.429096 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179b5c0-a8b2-4eb1-a88c-b0197ec292d3 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:07.433887 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c67e00-780d-403a-88d4-42827aabeb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:07.434739 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c67e00-780d-403a-88d4-42827aabeb17 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:07.435022 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c67e00-780d-403a-88d4-42827aabeb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:07.435291 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c67e00-780d-403a-88d4-42827aabeb17 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:07.446330 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c67e00-780d-403a-88d4-42827aabeb17 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:07.453129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-60c67e00-780d-403a-88d4-42827aabeb17 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:44:07.454434 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 85/163] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:07.460983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e55ae-328b-4f0a-82ce-7a17e867e016 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:07.471100 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e55ae-328b-4f0a-82ce-7a17e867e016 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:07.475635 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72f200-d32a-4e58-9954-a268b37951c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:07.476300 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72f200-d32a-4e58-9954-a268b37951c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:07.476580 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72f200-d32a-4e58-9954-a268b37951c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:07.476884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72f200-d32a-4e58-9954-a268b37951c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:07.478076 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72f200-d32a-4e58-9954-a268b37951c1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:07.478383 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72f200-d32a-4e58-9954-a268b37951c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:07.479998 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72f200-d32a-4e58-9954-a268b37951c1 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:07.488957 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 79/164] 10.222.0.96 () {56 vars in 1122 bytes} [Fri Jan 28 01:44:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:07.496128 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c67e00-780d-403a-88d4-42827aabeb17 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:07.506378 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c67e00-780d-403a-88d4-42827aabeb17 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:07.511541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b1f61-fdc3-44eb-bfdc-1f1aad683eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:07.512387 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b1f61-fdc3-44eb-bfdc-1f1aad683eeb admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:07.512668 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b1f61-fdc3-44eb-bfdc-1f1aad683eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:07.512978 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b1f61-fdc3-44eb-bfdc-1f1aad683eeb admin admin] PATH_INFO: `/v3/users/a76edb4be4ed4cb1ace2740887f5f01d` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:07.526736 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b1f61-fdc3-44eb-bfdc-1f1aad683eeb admin admin] RBAC: Authorizing `identity:get_user(user_id=a76edb4be4ed4cb1ace2740887f5f01d)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:07.534067 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b1f61-fdc3-44eb-bfdc-1f1aad683eeb admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:07.535993 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 86/165] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:44:07 2022] GET /identity/v3/users/a76edb4be4ed4cb1ace2740887f5f01d => generated 283 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:07.542347 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72f200-d32a-4e58-9954-a268b37951c1 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:07.557569 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72f200-d32a-4e58-9954-a268b37951c1 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:07.562086 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8a16b-e040-46a2-9a22-4e8e5b299028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:07.562737 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a16b-e040-46a2-9a22-4e8e5b299028 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:07.563019 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a16b-e040-46a2-9a22-4e8e5b299028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:07.563295 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a16b-e040-46a2-9a22-4e8e5b299028 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:07.572100 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8a16b-e040-46a2-9a22-4e8e5b299028 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:07.573896 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8a16b-e040-46a2-9a22-4e8e5b299028 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:07.583112 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 80/166] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:07 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:07.589536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b1f61-fdc3-44eb-bfdc-1f1aad683eeb admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:07.599238 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b1f61-fdc3-44eb-bfdc-1f1aad683eeb admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:07.603877 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e270d6e-cb1c-4f24-b476-9eff1c92f429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:07.604672 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e270d6e-cb1c-4f24-b476-9eff1c92f429 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:07.604989 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e270d6e-cb1c-4f24-b476-9eff1c92f429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:07.605264 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e270d6e-cb1c-4f24-b476-9eff1c92f429 admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:07.606456 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e270d6e-cb1c-4f24-b476-9eff1c92f429 admin admin] RBAC: Authorizing `identity:get_project(project_id=65c96e1c663a4b7db4930772be89df09)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:07.608512 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e270d6e-cb1c-4f24-b476-9eff1c92f429 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:07.610237 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 87/167] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:07 2022] GET /identity/v3/projects/65c96e1c663a4b7db4930772be89df09 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:07.616718 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8a16b-e040-46a2-9a22-4e8e5b299028 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:07.626468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8a16b-e040-46a2-9a22-4e8e5b299028 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:07.631000 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542611da-aef9-4ce8-b925-3d79ec122adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:07.631644 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542611da-aef9-4ce8-b925-3d79ec122adb admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:07.631928 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542611da-aef9-4ce8-b925-3d79ec122adb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:07.632204 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542611da-aef9-4ce8-b925-3d79ec122adb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:07.633053 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542611da-aef9-4ce8-b925-3d79ec122adb admin admin] RBAC: Adding query filter params (role.id=0a6e12c9b8034527a8aa1988febe09ac, scope.project.id=65c96e1c663a4b7db4930772be89df09, user.id=a76edb4be4ed4cb1ace2740887f5f01d) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:07.633915 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542611da-aef9-4ce8-b925-3d79ec122adb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:07.635982 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542611da-aef9-4ce8-b925-3d79ec122adb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:07.641719 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 81/168] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:07 2022] GET /identity/v3/role_assignments?user.id=a76edb4be4ed4cb1ace2740887f5f01d&scope.project.id=65c96e1c663a4b7db4930772be89df09&role.id=0a6e12c9b8034527a8aa1988febe09ac => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:07.856586 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535af964-9ceb-489e-8288-2b91470a6d2c None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:07.856954 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535af964-9ceb-489e-8288-2b91470a6d2c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:07.857131 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535af964-9ceb-489e-8288-2b91470a6d2c None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:07.858962 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 88/169] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:07.866939 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639d4cf-14c9-4882-ade3-851e6d790115 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:07.867224 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639d4cf-14c9-4882-ade3-851e6d790115 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:07.867486 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639d4cf-14c9-4882-ade3-851e6d790115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:07.887832 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-d639d4cf-14c9-4882-ade3-851e6d790115 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:07.889061 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-d639d4cf-14c9-4882-ade3-851e6d790115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:07.896999 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 82/170] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:07 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:07.922594 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535af964-9ceb-489e-8288-2b91470a6d2c None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:07.939156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535af964-9ceb-489e-8288-2b91470a6d2c None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:07.944057 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67787a5-73e6-4bf8-8b26-8fa037c5cb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:07.945310 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67787a5-73e6-4bf8-8b26-8fa037c5cb49 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:07.946390 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67787a5-73e6-4bf8-8b26-8fa037c5cb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:07.946873 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67787a5-73e6-4bf8-8b26-8fa037c5cb49 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:07.958109 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67787a5-73e6-4bf8-8b26-8fa037c5cb49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:07.966287 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-f67787a5-73e6-4bf8-8b26-8fa037c5cb49 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:44:07.967739 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 89/171] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:07.974124 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639d4cf-14c9-4882-ade3-851e6d790115 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:07.983304 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639d4cf-14c9-4882-ade3-851e6d790115 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:07.987791 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df08e9-168f-483b-a5fd-f8814b59e0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:07.988447 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df08e9-168f-483b-a5fd-f8814b59e0ec admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:07.988745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df08e9-168f-483b-a5fd-f8814b59e0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:07.989022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df08e9-168f-483b-a5fd-f8814b59e0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:07.989758 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df08e9-168f-483b-a5fd-f8814b59e0ec admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:07.990056 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df08e9-168f-483b-a5fd-f8814b59e0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:07.991633 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df08e9-168f-483b-a5fd-f8814b59e0ec admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:08.000427 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 83/172] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:08.006474 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67787a5-73e6-4bf8-8b26-8fa037c5cb49 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:08.017434 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67787a5-73e6-4bf8-8b26-8fa037c5cb49 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:08.021972 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea4427-6752-4928-9c90-2d4e83382d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:08.022989 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea4427-6752-4928-9c90-2d4e83382d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:08.023268 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea4427-6752-4928-9c90-2d4e83382d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:08.023534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea4427-6752-4928-9c90-2d4e83382d97 admin admin] PATH_INFO: `/v3/users/4d8d6d5762e340d2aeb3219a15d43128` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:08.025349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea4427-6752-4928-9c90-2d4e83382d97 admin admin] RBAC: Authorizing `identity:get_user(user_id=4d8d6d5762e340d2aeb3219a15d43128)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:08.027404 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea4427-6752-4928-9c90-2d4e83382d97 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:08.029274 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 90/173] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:44:08 2022] GET /identity/v3/users/4d8d6d5762e340d2aeb3219a15d43128 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:08.035104 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df08e9-168f-483b-a5fd-f8814b59e0ec admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:08.044919 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df08e9-168f-483b-a5fd-f8814b59e0ec admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:08.049330 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fca42-b838-4bf2-a974-4020c9a6fc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:08.049964 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fca42-b838-4bf2-a974-4020c9a6fc92 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:08.050241 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fca42-b838-4bf2-a974-4020c9a6fc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:08.050509 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fca42-b838-4bf2-a974-4020c9a6fc92 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:08.058985 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fca42-b838-4bf2-a974-4020c9a6fc92 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:08.060739 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fca42-b838-4bf2-a974-4020c9a6fc92 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:08.069903 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 84/174] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:08 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:08.076531 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea4427-6752-4928-9c90-2d4e83382d97 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:08.086254 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea4427-6752-4928-9c90-2d4e83382d97 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:08.091255 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae505e2-c8a0-44a6-a86d-1b3bbb6913cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:08.092103 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae505e2-c8a0-44a6-a86d-1b3bbb6913cc admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:08.092379 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae505e2-c8a0-44a6-a86d-1b3bbb6913cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:08.092651 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae505e2-c8a0-44a6-a86d-1b3bbb6913cc admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:08.093871 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae505e2-c8a0-44a6-a86d-1b3bbb6913cc admin admin] RBAC: Authorizing `identity:get_project(project_id=65c96e1c663a4b7db4930772be89df09)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:08.095942 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae505e2-c8a0-44a6-a86d-1b3bbb6913cc admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:08.097769 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 91/175] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:08 2022] GET /identity/v3/projects/65c96e1c663a4b7db4930772be89df09 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:08.104444 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fca42-b838-4bf2-a974-4020c9a6fc92 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:08.114031 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fca42-b838-4bf2-a974-4020c9a6fc92 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:08.118706 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a2b36-bc84-40ab-bfbb-96ee5ca13f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:08.119330 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a2b36-bc84-40ab-bfbb-96ee5ca13f44 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:08.119612 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a2b36-bc84-40ab-bfbb-96ee5ca13f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:08.119880 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a2b36-bc84-40ab-bfbb-96ee5ca13f44 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:08.120750 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a2b36-bc84-40ab-bfbb-96ee5ca13f44 admin admin] RBAC: Adding query filter params (role.id=253c0a1dc8d6421298a7987caaa55676, scope.project.id=65c96e1c663a4b7db4930772be89df09, user.id=4d8d6d5762e340d2aeb3219a15d43128) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:08.121093 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a2b36-bc84-40ab-bfbb-96ee5ca13f44 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:08.123076 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a2b36-bc84-40ab-bfbb-96ee5ca13f44 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:08.129648 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 85/176] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:08 2022] GET /identity/v3/role_assignments?user.id=4d8d6d5762e340d2aeb3219a15d43128&scope.project.id=65c96e1c663a4b7db4930772be89df09&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:08.205684 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631d223-968d-484d-8c01-033915c11560 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:08.206039 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631d223-968d-484d-8c01-033915c11560 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:08.206233 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631d223-968d-484d-8c01-033915c11560 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:08.208275 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 92/177] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:08.216779 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636555cf-bdfb-47b0-8326-ed1e68afc9dc None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:08.217092 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636555cf-bdfb-47b0-8326-ed1e68afc9dc None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:08.217355 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636555cf-bdfb-47b0-8326-ed1e68afc9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:08.236030 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-636555cf-bdfb-47b0-8326-ed1e68afc9dc None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:08.237311 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-636555cf-bdfb-47b0-8326-ed1e68afc9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:08.247159 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 86/178] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:08 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:08.274514 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631d223-968d-484d-8c01-033915c11560 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:08.287899 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631d223-968d-484d-8c01-033915c11560 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:08.294772 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199cced-9b13-42f5-b277-be4424ecf29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:08.295493 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199cced-9b13-42f5-b277-be4424ecf29b admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:08.295773 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199cced-9b13-42f5-b277-be4424ecf29b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:08.296075 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199cced-9b13-42f5-b277-be4424ecf29b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:08.297363 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199cced-9b13-42f5-b277-be4424ecf29b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:08.299225 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199cced-9b13-42f5-b277-be4424ecf29b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:08.301076 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 93/179] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:08.307956 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636555cf-bdfb-47b0-8326-ed1e68afc9dc None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:08.317185 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636555cf-bdfb-47b0-8326-ed1e68afc9dc None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:08.322295 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb907b-ddd5-4123-887a-c0f0a08e8a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:08.323000 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb907b-ddd5-4123-887a-c0f0a08e8a84 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:08.323277 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb907b-ddd5-4123-887a-c0f0a08e8a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:08.323546 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb907b-ddd5-4123-887a-c0f0a08e8a84 admin admin] PATH_INFO: `/v3/groups` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:08.324288 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb907b-ddd5-4123-887a-c0f0a08e8a84 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:08.325382 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING py.warnings [None req-46fb907b-ddd5-4123-887a-c0f0a08e8a84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:08.325382 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: warnings.warn(msg) Jan 28 01:44:08.325382 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: Jan 28 01:44:08.326616 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb907b-ddd5-4123-887a-c0f0a08e8a84 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:08.343409 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 87/180] 10.222.0.96 () {60 vars in 1155 bytes} [Fri Jan 28 01:44:08 2022] POST /identity/v3/groups => generated 229 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:44:08.345971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b2c8a-3aa5-4ad6-aab4-b2a8f94430c3 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:08.346256 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b2c8a-3aa5-4ad6-aab4-b2a8f94430c3 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:08.346531 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b2c8a-3aa5-4ad6-aab4-b2a8f94430c3 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:08.348711 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 94/181] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:08.357701 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac07a07-cad4-4d07-8960-f61f1644673f None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:08.358029 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac07a07-cad4-4d07-8960-f61f1644673f None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:08.358316 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac07a07-cad4-4d07-8960-f61f1644673f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:08.378642 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-dac07a07-cad4-4d07-8960-f61f1644673f None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:08.379789 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-dac07a07-cad4-4d07-8960-f61f1644673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:08.389049 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 88/182] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:08 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:08.415349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b2c8a-3aa5-4ad6-aab4-b2a8f94430c3 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:08.429233 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b2c8a-3aa5-4ad6-aab4-b2a8f94430c3 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:08.434743 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d202d-7255-409f-8868-be0d7aa32766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:08.435579 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d202d-7255-409f-8868-be0d7aa32766 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:08.435952 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d202d-7255-409f-8868-be0d7aa32766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:08.436282 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d202d-7255-409f-8868-be0d7aa32766 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:08.450687 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d202d-7255-409f-8868-be0d7aa32766 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:08.458157 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-6e7d202d-7255-409f-8868-be0d7aa32766 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:44:08.459625 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 95/183] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:44:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:08.466272 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac07a07-cad4-4d07-8960-f61f1644673f None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:08.475682 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac07a07-cad4-4d07-8960-f61f1644673f None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:08.480595 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5b6da-e4cf-42c3-95c5-a7ef1bb6faac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:08.481493 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5b6da-e4cf-42c3-95c5-a7ef1bb6faac admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:08.481790 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5b6da-e4cf-42c3-95c5-a7ef1bb6faac admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:08.482052 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5b6da-e4cf-42c3-95c5-a7ef1bb6faac admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:08.482838 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5b6da-e4cf-42c3-95c5-a7ef1bb6faac admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:08.483145 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5b6da-e4cf-42c3-95c5-a7ef1bb6faac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:08.484860 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5b6da-e4cf-42c3-95c5-a7ef1bb6faac admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:08.494673 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 89/184] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:08.500915 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d202d-7255-409f-8868-be0d7aa32766 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:08.513129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d202d-7255-409f-8868-be0d7aa32766 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:08.518678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267506d-74b8-4698-9f16-abe10148f048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:08.519661 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267506d-74b8-4698-9f16-abe10148f048 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:08.519937 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267506d-74b8-4698-9f16-abe10148f048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:08.520254 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267506d-74b8-4698-9f16-abe10148f048 admin admin] PATH_INFO: `/v3/users/a76edb4be4ed4cb1ace2740887f5f01d` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:08.521553 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267506d-74b8-4698-9f16-abe10148f048 admin admin] RBAC: Authorizing `identity:get_user(user_id=a76edb4be4ed4cb1ace2740887f5f01d)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:08.523899 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267506d-74b8-4698-9f16-abe10148f048 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:08.525716 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 96/185] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:44:08 2022] GET /identity/v3/users/a76edb4be4ed4cb1ace2740887f5f01d => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:08.532316 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5b6da-e4cf-42c3-95c5-a7ef1bb6faac admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:08.543936 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5b6da-e4cf-42c3-95c5-a7ef1bb6faac admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:08.551546 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0881ceb-2ef0-4ee2-9db3-fac000883d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:08.552205 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0881ceb-2ef0-4ee2-9db3-fac000883d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:08.552485 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0881ceb-2ef0-4ee2-9db3-fac000883d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:08.552755 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0881ceb-2ef0-4ee2-9db3-fac000883d77 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:08.564855 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0881ceb-2ef0-4ee2-9db3-fac000883d77 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:08.564855 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0881ceb-2ef0-4ee2-9db3-fac000883d77 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:08.574460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 90/186] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:08 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:08.581017 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267506d-74b8-4698-9f16-abe10148f048 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:08.591383 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267506d-74b8-4698-9f16-abe10148f048 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:08.595840 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260951e-1761-4452-8f5b-c295836b3af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:08.596688 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260951e-1761-4452-8f5b-c295836b3af6 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:08.597000 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260951e-1761-4452-8f5b-c295836b3af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:08.597275 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260951e-1761-4452-8f5b-c295836b3af6 admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:08.598472 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260951e-1761-4452-8f5b-c295836b3af6 admin admin] RBAC: Authorizing `identity:get_project(project_id=65c96e1c663a4b7db4930772be89df09)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:08.600512 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260951e-1761-4452-8f5b-c295836b3af6 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:08.603126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 97/187] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:08 2022] GET /identity/v3/projects/65c96e1c663a4b7db4930772be89df09 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:08.609356 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0881ceb-2ef0-4ee2-9db3-fac000883d77 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:08.619083 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0881ceb-2ef0-4ee2-9db3-fac000883d77 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:08.624282 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42d9b4-c495-442d-ade2-439ee12d6483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:08.625213 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42d9b4-c495-442d-ade2-439ee12d6483 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:08.625498 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42d9b4-c495-442d-ade2-439ee12d6483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:08.625772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42d9b4-c495-442d-ade2-439ee12d6483 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:08.626600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42d9b4-c495-442d-ade2-439ee12d6483 admin admin] RBAC: Adding query filter params (role.id=fb4c25e67ee749378e33ec4843ae1dbf, scope.project.id=65c96e1c663a4b7db4930772be89df09, user.id=a76edb4be4ed4cb1ace2740887f5f01d) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:08.626910 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42d9b4-c495-442d-ade2-439ee12d6483 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:08.628787 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42d9b4-c495-442d-ade2-439ee12d6483 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:08.634615 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 91/188] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:08 2022] GET /identity/v3/role_assignments?user.id=a76edb4be4ed4cb1ace2740887f5f01d&scope.project.id=65c96e1c663a4b7db4930772be89df09&role.id=fb4c25e67ee749378e33ec4843ae1dbf => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:09.926030 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee39f2-d125-4f81-a5be-ee7bedabca1f None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:09.926767 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee39f2-d125-4f81-a5be-ee7bedabca1f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:09.926767 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee39f2-d125-4f81-a5be-ee7bedabca1f None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:09.928237 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 98/189] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:09.936089 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4863300-3be7-4f31-a87d-3c34b3497bef None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:09.936690 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4863300-3be7-4f31-a87d-3c34b3497bef None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:09.936690 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4863300-3be7-4f31-a87d-3c34b3497bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:09.954639 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-c4863300-3be7-4f31-a87d-3c34b3497bef None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:09.955827 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c4863300-3be7-4f31-a87d-3c34b3497bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:09.964175 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 92/190] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:09 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:09.991961 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee39f2-d125-4f81-a5be-ee7bedabca1f None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:10.004329 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee39f2-d125-4f81-a5be-ee7bedabca1f None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:10.008682 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57763c39-b2a7-4938-9741-d99b25a41e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:10.009495 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57763c39-b2a7-4938-9741-d99b25a41e69 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:10.009773 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57763c39-b2a7-4938-9741-d99b25a41e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:10.010044 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57763c39-b2a7-4938-9741-d99b25a41e69 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:10.020709 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57763c39-b2a7-4938-9741-d99b25a41e69 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:10.028732 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-57763c39-b2a7-4938-9741-d99b25a41e69 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:44:10.029979 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 99/191] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:10.036250 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4863300-3be7-4f31-a87d-3c34b3497bef None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:10.046190 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4863300-3be7-4f31-a87d-3c34b3497bef None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:10.050687 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf22df-0ece-4f9d-8616-44f1ba2bb889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:10.051347 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf22df-0ece-4f9d-8616-44f1ba2bb889 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:10.051626 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf22df-0ece-4f9d-8616-44f1ba2bb889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:10.051898 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf22df-0ece-4f9d-8616-44f1ba2bb889 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:10.052645 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf22df-0ece-4f9d-8616-44f1ba2bb889 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:10.052983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf22df-0ece-4f9d-8616-44f1ba2bb889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:10.054587 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf22df-0ece-4f9d-8616-44f1ba2bb889 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:10.063641 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 93/192] 10.222.0.96 () {56 vars in 1122 bytes} [Fri Jan 28 01:44:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:10.069760 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57763c39-b2a7-4938-9741-d99b25a41e69 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:10.079737 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57763c39-b2a7-4938-9741-d99b25a41e69 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:10.084219 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c42628-2c9b-4bff-b7cc-40f6724db386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:10.085112 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c42628-2c9b-4bff-b7cc-40f6724db386 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:10.085393 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c42628-2c9b-4bff-b7cc-40f6724db386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:10.085664 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c42628-2c9b-4bff-b7cc-40f6724db386 admin admin] PATH_INFO: `/v3/users/a76edb4be4ed4cb1ace2740887f5f01d` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:10.087465 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c42628-2c9b-4bff-b7cc-40f6724db386 admin admin] RBAC: Authorizing `identity:get_user(user_id=a76edb4be4ed4cb1ace2740887f5f01d)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:10.089630 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c42628-2c9b-4bff-b7cc-40f6724db386 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:10.091257 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 100/193] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:44:10 2022] GET /identity/v3/users/a76edb4be4ed4cb1ace2740887f5f01d => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:10.097386 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf22df-0ece-4f9d-8616-44f1ba2bb889 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:10.107902 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf22df-0ece-4f9d-8616-44f1ba2bb889 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:10.112366 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759b3f7-febd-4c73-826b-730d251241e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:10.113260 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759b3f7-febd-4c73-826b-730d251241e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:10.113538 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759b3f7-febd-4c73-826b-730d251241e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:10.113812 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759b3f7-febd-4c73-826b-730d251241e5 admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:10.115001 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759b3f7-febd-4c73-826b-730d251241e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=65c96e1c663a4b7db4930772be89df09)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:10.117075 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759b3f7-febd-4c73-826b-730d251241e5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:10.118998 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 94/194] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:10 2022] GET /identity/v3/projects/65c96e1c663a4b7db4930772be89df09 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:10.125362 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c42628-2c9b-4bff-b7cc-40f6724db386 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:10.136213 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c42628-2c9b-4bff-b7cc-40f6724db386 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:10.140676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362b956-9df9-4ce2-8070-fd800d00d677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:10.141580 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362b956-9df9-4ce2-8070-fd800d00d677 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:10.141852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362b956-9df9-4ce2-8070-fd800d00d677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:10.142119 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362b956-9df9-4ce2-8070-fd800d00d677 admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09/users/a76edb4be4ed4cb1ace2740887f5f01d/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:10.144066 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362b956-9df9-4ce2-8070-fd800d00d677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c96e1c663a4b7db4930772be89df09, user_id=a76edb4be4ed4cb1ace2740887f5f01d, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:10.146688 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362b956-9df9-4ce2-8070-fd800d00d677 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:10.164192 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 101/195] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:44:10 2022] PUT /identity/v3/projects/65c96e1c663a4b7db4930772be89df09/users/a76edb4be4ed4cb1ace2740887f5f01d/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:44:10.356845 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc499a-4266-4938-9ae4-36d13d2c21dc None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:10.357252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc499a-4266-4938-9ae4-36d13d2c21dc None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:10.357423 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc499a-4266-4938-9ae4-36d13d2c21dc None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:10.359173 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 95/196] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:10.366835 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe74e05-c189-4de3-a979-bb0de4a56303 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:10.367139 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe74e05-c189-4de3-a979-bb0de4a56303 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:10.367394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe74e05-c189-4de3-a979-bb0de4a56303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:10.388153 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-1fe74e05-c189-4de3-a979-bb0de4a56303 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:10.389410 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-1fe74e05-c189-4de3-a979-bb0de4a56303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:10.449162 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 102/197] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:10 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:10.474566 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc499a-4266-4938-9ae4-36d13d2c21dc None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:10.488056 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc499a-4266-4938-9ae4-36d13d2c21dc None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:10.493553 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69188064-bd28-46de-a13d-fdba8d2c58c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:10.494625 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69188064-bd28-46de-a13d-fdba8d2c58c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:10.495094 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69188064-bd28-46de-a13d-fdba8d2c58c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:10.495574 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69188064-bd28-46de-a13d-fdba8d2c58c5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:10.506279 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69188064-bd28-46de-a13d-fdba8d2c58c5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:10.514022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-69188064-bd28-46de-a13d-fdba8d2c58c5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:44:10.515476 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 96/198] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:10.521921 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe74e05-c189-4de3-a979-bb0de4a56303 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:10.533908 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe74e05-c189-4de3-a979-bb0de4a56303 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:10.538806 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ce18a-6e82-433d-84b2-57f78169034d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:10.539827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ce18a-6e82-433d-84b2-57f78169034d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:10.540300 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ce18a-6e82-433d-84b2-57f78169034d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:10.540776 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ce18a-6e82-433d-84b2-57f78169034d admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:10.541768 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ce18a-6e82-433d-84b2-57f78169034d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:10.542260 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ce18a-6e82-433d-84b2-57f78169034d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:10.544050 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ce18a-6e82-433d-84b2-57f78169034d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:10.553431 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 103/199] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:10.560433 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69188064-bd28-46de-a13d-fdba8d2c58c5 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:10.571503 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69188064-bd28-46de-a13d-fdba8d2c58c5 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:10.576377 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b554224-862e-4220-bcec-b916bdc77fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:10.577371 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554224-862e-4220-bcec-b916bdc77fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:10.577649 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554224-862e-4220-bcec-b916bdc77fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:10.577919 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554224-862e-4220-bcec-b916bdc77fe1 admin admin] PATH_INFO: `/v3/users/4d8d6d5762e340d2aeb3219a15d43128` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:10.579189 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b554224-862e-4220-bcec-b916bdc77fe1 admin admin] RBAC: Authorizing `identity:get_user(user_id=4d8d6d5762e340d2aeb3219a15d43128)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:10.581078 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b554224-862e-4220-bcec-b916bdc77fe1 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:10.582926 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 97/200] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:44:10 2022] GET /identity/v3/users/4d8d6d5762e340d2aeb3219a15d43128 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:10.589096 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ce18a-6e82-433d-84b2-57f78169034d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:10.599478 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ce18a-6e82-433d-84b2-57f78169034d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:10.604341 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0f468-7f03-4e75-b0da-2b11a1daa26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:10.605230 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0f468-7f03-4e75-b0da-2b11a1daa26a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:10.605549 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0f468-7f03-4e75-b0da-2b11a1daa26a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:10.605819 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0f468-7f03-4e75-b0da-2b11a1daa26a admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:10.607106 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0f468-7f03-4e75-b0da-2b11a1daa26a admin admin] RBAC: Authorizing `identity:get_project(project_id=65c96e1c663a4b7db4930772be89df09)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:10.609266 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0f468-7f03-4e75-b0da-2b11a1daa26a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:10.611404 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 104/201] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:10 2022] GET /identity/v3/projects/65c96e1c663a4b7db4930772be89df09 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:10.618223 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b554224-862e-4220-bcec-b916bdc77fe1 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:10.629509 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b554224-862e-4220-bcec-b916bdc77fe1 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:10.637443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab5972-efa3-41a4-8848-ae680c85c39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:10.639286 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab5972-efa3-41a4-8848-ae680c85c39e admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:10.639752 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab5972-efa3-41a4-8848-ae680c85c39e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:10.640311 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab5972-efa3-41a4-8848-ae680c85c39e admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09/users/4d8d6d5762e340d2aeb3219a15d43128/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:10.644580 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab5972-efa3-41a4-8848-ae680c85c39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c96e1c663a4b7db4930772be89df09, user_id=4d8d6d5762e340d2aeb3219a15d43128, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:10.648542 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab5972-efa3-41a4-8848-ae680c85c39e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:10.665469 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 98/202] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:44:10 2022] PUT /identity/v3/projects/65c96e1c663a4b7db4930772be89df09/users/4d8d6d5762e340d2aeb3219a15d43128/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:44:10.736417 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ea7b1-817b-42cb-a72a-65362839524e None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:10.736723 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ea7b1-817b-42cb-a72a-65362839524e None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:10.736981 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ea7b1-817b-42cb-a72a-65362839524e None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:10.739101 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 105/203] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:10.747872 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219e0d0-3d47-4736-bed3-21da05507b2e None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:10.748296 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219e0d0-3d47-4736-bed3-21da05507b2e None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:10.748669 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219e0d0-3d47-4736-bed3-21da05507b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:10.770373 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-f219e0d0-3d47-4736-bed3-21da05507b2e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:10.771795 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-f219e0d0-3d47-4736-bed3-21da05507b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:10.839673 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 99/204] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:10 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:10.864718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ea7b1-817b-42cb-a72a-65362839524e None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:10.868078 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511888f5-2b85-4ed4-9b6b-39cc2a61cf0e None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:10.868691 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511888f5-2b85-4ed4-9b6b-39cc2a61cf0e None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:10.869197 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511888f5-2b85-4ed4-9b6b-39cc2a61cf0e None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:10.871730 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 100/205] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:10.881129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ea7b1-817b-42cb-a72a-65362839524e None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:10.882218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdf50d-67a7-41c8-bb4e-b208f886522d None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:10.882718 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdf50d-67a7-41c8-bb4e-b208f886522d None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:10.883880 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdf50d-67a7-41c8-bb4e-b208f886522d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:10.887616 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b23bb-8a29-4045-b775-7e9d5011aa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:10.888410 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b23bb-8a29-4045-b775-7e9d5011aa1f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:10.888755 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b23bb-8a29-4045-b775-7e9d5011aa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:10.889014 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b23bb-8a29-4045-b775-7e9d5011aa1f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:10.890166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b23bb-8a29-4045-b775-7e9d5011aa1f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:10.891869 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b23bb-8a29-4045-b775-7e9d5011aa1f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:10.894071 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 106/206] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:10.901108 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b23bb-8a29-4045-b775-7e9d5011aa1f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:10.908519 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-64fdf50d-67a7-41c8-bb4e-b208f886522d None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:10.910547 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-64fdf50d-67a7-41c8-bb4e-b208f886522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:10.912605 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b23bb-8a29-4045-b775-7e9d5011aa1f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:10.917924 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf21c3-c930-4048-93f2-4adcd2f61989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:10.918584 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf21c3-c930-4048-93f2-4adcd2f61989 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:10.918858 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf21c3-c930-4048-93f2-4adcd2f61989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:10.919125 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf21c3-c930-4048-93f2-4adcd2f61989 admin admin] PATH_INFO: `/v3/groups` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:10.919809 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf21c3-c930-4048-93f2-4adcd2f61989 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:10.920890 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-bfbf21c3-c930-4048-93f2-4adcd2f61989 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:10.920890 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:44:10.920890 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:44:10.922035 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf21c3-c930-4048-93f2-4adcd2f61989 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:10.929211 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 101/207] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:10 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:10.947973 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdf50d-67a7-41c8-bb4e-b208f886522d None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:10.952470 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 107/208] 10.222.0.96 () {60 vars in 1155 bytes} [Fri Jan 28 01:44:10 2022] POST /identity/v3/groups => generated 226 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:44:10.958349 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdf50d-67a7-41c8-bb4e-b208f886522d None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:10.962445 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e142f-7e42-4916-857e-096003d97538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:10.963270 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e142f-7e42-4916-857e-096003d97538 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:10.963544 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e142f-7e42-4916-857e-096003d97538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:10.963809 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e142f-7e42-4916-857e-096003d97538 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:10.976725 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e142f-7e42-4916-857e-096003d97538 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:10.985392 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-853e142f-7e42-4916-857e-096003d97538 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:44:10.986725 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 102/209] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:44:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:10.994077 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf21c3-c930-4048-93f2-4adcd2f61989 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:11.006925 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf21c3-c930-4048-93f2-4adcd2f61989 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:11.012017 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ffcdc-3003-4b06-bcc3-7822054722d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:11.013108 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ffcdc-3003-4b06-bcc3-7822054722d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:11.013563 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ffcdc-3003-4b06-bcc3-7822054722d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:11.014006 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ffcdc-3003-4b06-bcc3-7822054722d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:11.014951 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ffcdc-3003-4b06-bcc3-7822054722d1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:11.015437 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ffcdc-3003-4b06-bcc3-7822054722d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:11.017313 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ffcdc-3003-4b06-bcc3-7822054722d1 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:11.029262 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 108/210] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:11.036767 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e142f-7e42-4916-857e-096003d97538 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:11.049368 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e142f-7e42-4916-857e-096003d97538 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:11.054500 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a577e7f-ad8a-4780-9ae3-22859625cd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:11.056426 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a577e7f-ad8a-4780-9ae3-22859625cd05 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:11.057083 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a577e7f-ad8a-4780-9ae3-22859625cd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:11.057566 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a577e7f-ad8a-4780-9ae3-22859625cd05 admin admin] PATH_INFO: `/v3/users/a76edb4be4ed4cb1ace2740887f5f01d` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:11.059273 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a577e7f-ad8a-4780-9ae3-22859625cd05 admin admin] RBAC: Authorizing `identity:get_user(user_id=a76edb4be4ed4cb1ace2740887f5f01d)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:11.062396 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a577e7f-ad8a-4780-9ae3-22859625cd05 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:11.064580 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 103/211] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:44:11 2022] GET /identity/v3/users/a76edb4be4ed4cb1ace2740887f5f01d => generated 283 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:11.071934 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ffcdc-3003-4b06-bcc3-7822054722d1 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:11.082875 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ffcdc-3003-4b06-bcc3-7822054722d1 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:11.087595 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252dd73-3967-4952-ac7c-9fbe1c04f88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:11.088563 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252dd73-3967-4952-ac7c-9fbe1c04f88f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:11.088971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252dd73-3967-4952-ac7c-9fbe1c04f88f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:11.089508 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252dd73-3967-4952-ac7c-9fbe1c04f88f admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:11.091665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252dd73-3967-4952-ac7c-9fbe1c04f88f admin admin] RBAC: Authorizing `identity:get_project(project_id=65c96e1c663a4b7db4930772be89df09)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:11.093978 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252dd73-3967-4952-ac7c-9fbe1c04f88f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:11.096078 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 109/212] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:11 2022] GET /identity/v3/projects/65c96e1c663a4b7db4930772be89df09 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:11.104315 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a577e7f-ad8a-4780-9ae3-22859625cd05 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:11.118403 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a577e7f-ad8a-4780-9ae3-22859625cd05 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:11.123720 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a5ef6-f425-4422-a64d-37c082508240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:11.124822 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a5ef6-f425-4422-a64d-37c082508240 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:11.125117 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a5ef6-f425-4422-a64d-37c082508240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:11.125384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a5ef6-f425-4422-a64d-37c082508240 admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09/users/a76edb4be4ed4cb1ace2740887f5f01d/roles/fb4c25e67ee749378e33ec4843ae1dbf` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:11.127708 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a5ef6-f425-4422-a64d-37c082508240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c96e1c663a4b7db4930772be89df09, user_id=a76edb4be4ed4cb1ace2740887f5f01d, role_id=fb4c25e67ee749378e33ec4843ae1dbf)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:11.130456 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a5ef6-f425-4422-a64d-37c082508240 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:11.147662 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 104/213] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:44:11 2022] PUT /identity/v3/projects/65c96e1c663a4b7db4930772be89df09/users/a76edb4be4ed4cb1ace2740887f5f01d/roles/fb4c25e67ee749378e33ec4843ae1dbf => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:44:12.598729 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a433af-1dea-43c9-b193-8f1dfc9b8a7c None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:12.599365 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a433af-1dea-43c9-b193-8f1dfc9b8a7c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:12.599624 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a433af-1dea-43c9-b193-8f1dfc9b8a7c None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:12.603597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 110/214] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:12.612609 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08031dc-6402-489b-a46c-e8ac201b92de None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:12.613580 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08031dc-6402-489b-a46c-e8ac201b92de None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:12.614055 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08031dc-6402-489b-a46c-e8ac201b92de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:12.638681 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-a08031dc-6402-489b-a46c-e8ac201b92de None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:12.640218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-a08031dc-6402-489b-a46c-e8ac201b92de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:12.725295 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 105/215] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:12 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jan 28 01:44:12.765383 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a433af-1dea-43c9-b193-8f1dfc9b8a7c None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:12.796369 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a433af-1dea-43c9-b193-8f1dfc9b8a7c None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:12.807574 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cebf9e-794c-4623-8242-26529796d3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:12.808738 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cebf9e-794c-4623-8242-26529796d3ad admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:12.809213 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cebf9e-794c-4623-8242-26529796d3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:12.809655 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cebf9e-794c-4623-8242-26529796d3ad admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:12.834722 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cebf9e-794c-4623-8242-26529796d3ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:12.847424 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-f9cebf9e-794c-4623-8242-26529796d3ad admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:44:12.849527 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 111/216] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:12.856742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08031dc-6402-489b-a46c-e8ac201b92de None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:12.875440 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08031dc-6402-489b-a46c-e8ac201b92de None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:12.890617 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a590f8-a23f-4d04-87aa-2236fd210d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:12.891648 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a590f8-a23f-4d04-87aa-2236fd210d09 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:12.892128 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a590f8-a23f-4d04-87aa-2236fd210d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:12.892617 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a590f8-a23f-4d04-87aa-2236fd210d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:12.893610 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a590f8-a23f-4d04-87aa-2236fd210d09 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:12.894128 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a590f8-a23f-4d04-87aa-2236fd210d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:12.895947 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a590f8-a23f-4d04-87aa-2236fd210d09 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:12.909524 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 106/217] 10.222.0.96 () {56 vars in 1122 bytes} [Fri Jan 28 01:44:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:12.917530 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cebf9e-794c-4623-8242-26529796d3ad admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:12.939094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cebf9e-794c-4623-8242-26529796d3ad admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:12.953117 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142359c-495c-44a6-b32c-b8928fadf692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:12.954666 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142359c-495c-44a6-b32c-b8928fadf692 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:12.955156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142359c-495c-44a6-b32c-b8928fadf692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:12.955630 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142359c-495c-44a6-b32c-b8928fadf692 admin admin] PATH_INFO: `/v3/users/a76edb4be4ed4cb1ace2740887f5f01d` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:12.957979 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142359c-495c-44a6-b32c-b8928fadf692 admin admin] RBAC: Authorizing `identity:get_user(user_id=a76edb4be4ed4cb1ace2740887f5f01d)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:12.962938 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142359c-495c-44a6-b32c-b8928fadf692 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:12.969354 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 112/218] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:44:12 2022] GET /identity/v3/users/a76edb4be4ed4cb1ace2740887f5f01d => generated 283 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:12.975746 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a590f8-a23f-4d04-87aa-2236fd210d09 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:12.995247 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a590f8-a23f-4d04-87aa-2236fd210d09 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:13.005128 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a67ef5-5c64-4d57-a213-6bd4142e2fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:13.006132 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a67ef5-5c64-4d57-a213-6bd4142e2fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:13.006638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a67ef5-5c64-4d57-a213-6bd4142e2fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:13.007108 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a67ef5-5c64-4d57-a213-6bd4142e2fd8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:13.025426 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a67ef5-5c64-4d57-a213-6bd4142e2fd8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:13.027801 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a67ef5-5c64-4d57-a213-6bd4142e2fd8 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:13.043500 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 107/219] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:12 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:13.050689 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142359c-495c-44a6-b32c-b8928fadf692 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:13.074834 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142359c-495c-44a6-b32c-b8928fadf692 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:13.088462 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f375c6-6898-467b-acd5-9e2fcef33044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:13.089885 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f375c6-6898-467b-acd5-9e2fcef33044 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:13.090390 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f375c6-6898-467b-acd5-9e2fcef33044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:13.090834 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f375c6-6898-467b-acd5-9e2fcef33044 admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:13.092958 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f375c6-6898-467b-acd5-9e2fcef33044 admin admin] RBAC: Authorizing `identity:get_project(project_id=65c96e1c663a4b7db4930772be89df09)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:13.096778 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f375c6-6898-467b-acd5-9e2fcef33044 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:13.099988 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 113/220] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:13 2022] GET /identity/v3/projects/65c96e1c663a4b7db4930772be89df09 => generated 302 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:13.107679 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a67ef5-5c64-4d57-a213-6bd4142e2fd8 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:13.121333 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a67ef5-5c64-4d57-a213-6bd4142e2fd8 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:13.129094 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1260d9d-86ba-49cd-8930-dcc46399b4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:13.130101 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1260d9d-86ba-49cd-8930-dcc46399b4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:13.130579 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1260d9d-86ba-49cd-8930-dcc46399b4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:13.131057 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1260d9d-86ba-49cd-8930-dcc46399b4a5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:13.132091 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1260d9d-86ba-49cd-8930-dcc46399b4a5 admin admin] RBAC: Adding query filter params (role.id=0a6e12c9b8034527a8aa1988febe09ac, scope.project.id=65c96e1c663a4b7db4930772be89df09, user.id=a76edb4be4ed4cb1ace2740887f5f01d) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:13.132639 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1260d9d-86ba-49cd-8930-dcc46399b4a5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:13.134775 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1260d9d-86ba-49cd-8930-dcc46399b4a5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:13.145924 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 108/221] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:13 2022] GET /identity/v3/role_assignments?user.id=a76edb4be4ed4cb1ace2740887f5f01d&scope.project.id=65c96e1c663a4b7db4930772be89df09&role.id=0a6e12c9b8034527a8aa1988febe09ac => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:14.653906 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a6bc0-3d6f-4d04-a466-8dfd494e49fd None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:14.654448 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a6bc0-3d6f-4d04-a466-8dfd494e49fd None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:14.654854 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a6bc0-3d6f-4d04-a466-8dfd494e49fd None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:14.658408 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 114/222] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:14.670525 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8576e-1ebe-4e0c-97f8-1c9b67ef9eab None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:14.671013 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8576e-1ebe-4e0c-97f8-1c9b67ef9eab None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:14.671536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8576e-1ebe-4e0c-97f8-1c9b67ef9eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:14.709893 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-c0e8576e-1ebe-4e0c-97f8-1c9b67ef9eab None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:14.712474 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c0e8576e-1ebe-4e0c-97f8-1c9b67ef9eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:14.730284 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 109/223] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:14 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:14.809914 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a6bc0-3d6f-4d04-a466-8dfd494e49fd None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:14.835450 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a6bc0-3d6f-4d04-a466-8dfd494e49fd None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:14.848697 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829ca4e-b4b0-4627-9374-5beb55157372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:14.850122 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829ca4e-b4b0-4627-9374-5beb55157372 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:14.850589 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829ca4e-b4b0-4627-9374-5beb55157372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:14.851126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829ca4e-b4b0-4627-9374-5beb55157372 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:14.874790 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829ca4e-b4b0-4627-9374-5beb55157372 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:14.888325 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-3829ca4e-b4b0-4627-9374-5beb55157372 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:44:14.896944 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 115/224] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:14.901659 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8576e-1ebe-4e0c-97f8-1c9b67ef9eab None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:14.921973 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8576e-1ebe-4e0c-97f8-1c9b67ef9eab None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:14.935158 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb8b1f-d42f-4416-aff8-2a86edcb2120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:14.936320 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb8b1f-d42f-4416-aff8-2a86edcb2120 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:14.936825 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb8b1f-d42f-4416-aff8-2a86edcb2120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:14.937326 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb8b1f-d42f-4416-aff8-2a86edcb2120 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:14.938729 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb8b1f-d42f-4416-aff8-2a86edcb2120 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:14.939272 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb8b1f-d42f-4416-aff8-2a86edcb2120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:14.942406 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb8b1f-d42f-4416-aff8-2a86edcb2120 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:14.962740 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 110/225] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:14.972744 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829ca4e-b4b0-4627-9374-5beb55157372 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:14.990894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829ca4e-b4b0-4627-9374-5beb55157372 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:15.003112 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a0fa4-8ae5-45ff-9acd-8adeb0b2d593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:15.004731 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a0fa4-8ae5-45ff-9acd-8adeb0b2d593 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.005240 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a0fa4-8ae5-45ff-9acd-8adeb0b2d593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.005718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a0fa4-8ae5-45ff-9acd-8adeb0b2d593 admin admin] PATH_INFO: `/v3/users/4d8d6d5762e340d2aeb3219a15d43128` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.009005 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a0fa4-8ae5-45ff-9acd-8adeb0b2d593 admin admin] RBAC: Authorizing `identity:get_user(user_id=4d8d6d5762e340d2aeb3219a15d43128)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:15.012581 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a0fa4-8ae5-45ff-9acd-8adeb0b2d593 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:15.018470 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 116/226] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:44:14 2022] GET /identity/v3/users/4d8d6d5762e340d2aeb3219a15d43128 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:15.025693 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb8b1f-d42f-4416-aff8-2a86edcb2120 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:15.046396 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb8b1f-d42f-4416-aff8-2a86edcb2120 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:15.054151 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fe28f-ec4c-4b0b-a1ab-638ecd94f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:15.055716 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fe28f-ec4c-4b0b-a1ab-638ecd94f65f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.056369 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fe28f-ec4c-4b0b-a1ab-638ecd94f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.056778 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fe28f-ec4c-4b0b-a1ab-638ecd94f65f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.073004 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fe28f-ec4c-4b0b-a1ab-638ecd94f65f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:15.076319 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fe28f-ec4c-4b0b-a1ab-638ecd94f65f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:15.095170 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 111/227] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:15 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:15.101159 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc49e28-71d6-46cc-91c4-3b1027b7a435 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.101646 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc49e28-71d6-46cc-91c4-3b1027b7a435 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.102178 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc49e28-71d6-46cc-91c4-3b1027b7a435 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.107307 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fe28f-ec4c-4b0b-a1ab-638ecd94f65f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:15.109045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 117/228] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:15.117277 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f653bb-b6b5-45f0-af10-c34dd691c55c None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.118361 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f653bb-b6b5-45f0-af10-c34dd691c55c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.118807 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f653bb-b6b5-45f0-af10-c34dd691c55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.124202 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fe28f-ec4c-4b0b-a1ab-638ecd94f65f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:15.152161 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b42229-b424-41c8-b6f1-9565926b6b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:15.153574 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b42229-b424-41c8-b6f1-9565926b6b97 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.154045 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b42229-b424-41c8-b6f1-9565926b6b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.154486 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b42229-b424-41c8-b6f1-9565926b6b97 admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.160825 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-10f653bb-b6b5-45f0-af10-c34dd691c55c None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:15.162035 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b42229-b424-41c8-b6f1-9565926b6b97 admin admin] RBAC: Authorizing `identity:get_project(project_id=65c96e1c663a4b7db4930772be89df09)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:15.162710 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-10f653bb-b6b5-45f0-af10-c34dd691c55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:15.165812 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b42229-b424-41c8-b6f1-9565926b6b97 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:15.169281 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 112/229] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:15 2022] GET /identity/v3/projects/65c96e1c663a4b7db4930772be89df09 => generated 302 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:15.181396 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b42229-b424-41c8-b6f1-9565926b6b97 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:15.183140 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 118/230] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:15 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:15.209405 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b42229-b424-41c8-b6f1-9565926b6b97 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:15.218550 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f653bb-b6b5-45f0-af10-c34dd691c55c None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:15.221008 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76657ef8-96c5-4a9d-999a-d33187f55a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:15.222068 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76657ef8-96c5-4a9d-999a-d33187f55a64 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.222535 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76657ef8-96c5-4a9d-999a-d33187f55a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.222990 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76657ef8-96c5-4a9d-999a-d33187f55a64 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.224415 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76657ef8-96c5-4a9d-999a-d33187f55a64 admin admin] RBAC: Adding query filter params (role.id=253c0a1dc8d6421298a7987caaa55676, scope.project.id=65c96e1c663a4b7db4930772be89df09, user.id=4d8d6d5762e340d2aeb3219a15d43128) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:15.224947 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76657ef8-96c5-4a9d-999a-d33187f55a64 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:15.228819 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76657ef8-96c5-4a9d-999a-d33187f55a64 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:15.244535 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 113/231] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:15 2022] GET /identity/v3/role_assignments?user.id=4d8d6d5762e340d2aeb3219a15d43128&scope.project.id=65c96e1c663a4b7db4930772be89df09&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 608 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:15.245368 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f653bb-b6b5-45f0-af10-c34dd691c55c None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:15.258152 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a9acb-9484-42ba-967e-38612567c15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:15.260207 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9acb-9484-42ba-967e-38612567c15b admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.260630 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9acb-9484-42ba-967e-38612567c15b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.261136 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9acb-9484-42ba-967e-38612567c15b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.292727 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a9acb-9484-42ba-967e-38612567c15b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:15.308599 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-852a9acb-9484-42ba-967e-38612567c15b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:44:15.311041 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 119/232] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:15.318726 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76657ef8-96c5-4a9d-999a-d33187f55a64 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:15.346215 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76657ef8-96c5-4a9d-999a-d33187f55a64 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:15.361500 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa07c0-f0cc-4c46-9341-d9750526d043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:15.362560 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa07c0-f0cc-4c46-9341-d9750526d043 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.363004 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa07c0-f0cc-4c46-9341-d9750526d043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.363465 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa07c0-f0cc-4c46-9341-d9750526d043 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.364857 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa07c0-f0cc-4c46-9341-d9750526d043 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:15.365385 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa07c0-f0cc-4c46-9341-d9750526d043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:15.368499 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa07c0-f0cc-4c46-9341-d9750526d043 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:15.390250 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 114/233] 10.222.0.96 () {56 vars in 1122 bytes} [Fri Jan 28 01:44:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:15.397261 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a9acb-9484-42ba-967e-38612567c15b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:15.421306 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a9acb-9484-42ba-967e-38612567c15b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:15.434544 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29051296-3a4c-4b44-93f0-3226ea255e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:15.435583 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29051296-3a4c-4b44-93f0-3226ea255e3c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.435995 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29051296-3a4c-4b44-93f0-3226ea255e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.436408 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29051296-3a4c-4b44-93f0-3226ea255e3c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.464378 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29051296-3a4c-4b44-93f0-3226ea255e3c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:15.467579 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29051296-3a4c-4b44-93f0-3226ea255e3c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:15.488873 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 120/234] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:15 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:44:15.497144 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa07c0-f0cc-4c46-9341-d9750526d043 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:15.516886 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17ff39-500b-454b-b423-bd5acc7ecd20 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.517485 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17ff39-500b-454b-b423-bd5acc7ecd20 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.517930 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17ff39-500b-454b-b423-bd5acc7ecd20 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.521197 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 121/235] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:44:15.537702 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381c681-01aa-4dc2-aad9-c5746881adc6 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.538148 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381c681-01aa-4dc2-aad9-c5746881adc6 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.538397 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa07c0-f0cc-4c46-9341-d9750526d043 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:15.538580 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381c681-01aa-4dc2-aad9-c5746881adc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.562528 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00552ca2-aff1-4e8e-9bc7-ded3459cf055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:15.563968 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00552ca2-aff1-4e8e-9bc7-ded3459cf055 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.564442 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00552ca2-aff1-4e8e-9bc7-ded3459cf055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.564938 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00552ca2-aff1-4e8e-9bc7-ded3459cf055 admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.570037 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00552ca2-aff1-4e8e-9bc7-ded3459cf055 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:15.574197 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00552ca2-aff1-4e8e-9bc7-ded3459cf055 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:15.577425 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 115/236] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:15 2022] GET /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 298 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:15.582344 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-7381c681-01aa-4dc2-aad9-c5746881adc6 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:15.583776 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00552ca2-aff1-4e8e-9bc7-ded3459cf055 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:15.584136 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-7381c681-01aa-4dc2-aad9-c5746881adc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:15.604780 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 122/237] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:15 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:15.611272 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00552ca2-aff1-4e8e-9bc7-ded3459cf055 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:15.629926 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87d751-7987-4c6c-b87b-c7088c5e77b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:15.631456 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87d751-7987-4c6c-b87b-c7088c5e77b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.631877 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87d751-7987-4c6c-b87b-c7088c5e77b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.632293 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87d751-7987-4c6c-b87b-c7088c5e77b4 admin admin] PATH_INFO: `/v3/groups/9ca862b44c3c402ba6d399f549aee851` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.647341 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381c681-01aa-4dc2-aad9-c5746881adc6 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:15.662964 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87d751-7987-4c6c-b87b-c7088c5e77b4 admin admin] RBAC: Authorizing `identity:get_group(group_id=9ca862b44c3c402ba6d399f549aee851)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:15.668908 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING py.warnings [None req-ba87d751-7987-4c6c-b87b-c7088c5e77b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:15.668908 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: warnings.warn(msg) Jan 28 01:44:15.668908 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: Jan 28 01:44:15.671268 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87d751-7987-4c6c-b87b-c7088c5e77b4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:15.673173 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381c681-01aa-4dc2-aad9-c5746881adc6 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:15.677605 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 116/238] 10.222.0.96 () {56 vars in 1201 bytes} [Fri Jan 28 01:44:15 2022] GET /identity/v3/groups/9ca862b44c3c402ba6d399f549aee851 => generated 226 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:15.686960 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87d751-7987-4c6c-b87b-c7088c5e77b4 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:15.689139 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201f10c-73b3-41c3-8be2-a6e288f761ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:15.691970 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201f10c-73b3-41c3-8be2-a6e288f761ea admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.692452 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201f10c-73b3-41c3-8be2-a6e288f761ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.694789 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201f10c-73b3-41c3-8be2-a6e288f761ea admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.730553 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87d751-7987-4c6c-b87b-c7088c5e77b4 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:15.746428 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473895f1-a6c6-4630-9eb7-7c7089cb6197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:15.747081 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201f10c-73b3-41c3-8be2-a6e288f761ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:15.749621 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473895f1-a6c6-4630-9eb7-7c7089cb6197 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.752120 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473895f1-a6c6-4630-9eb7-7c7089cb6197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.752672 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473895f1-a6c6-4630-9eb7-7c7089cb6197 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.756629 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473895f1-a6c6-4630-9eb7-7c7089cb6197 admin admin] RBAC: Adding query filter params (group.id=9ca862b44c3c402ba6d399f549aee851, role.id=0a6e12c9b8034527a8aa1988febe09ac, scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:15.757179 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473895f1-a6c6-4630-9eb7-7c7089cb6197 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:15.761319 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473895f1-a6c6-4630-9eb7-7c7089cb6197 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:15.774639 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-7201f10c-73b3-41c3-8be2-a6e288f761ea admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:44:15.776967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 123/239] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:44:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:15.783971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201f10c-73b3-41c3-8be2-a6e288f761ea admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:15.787679 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 117/240] 10.222.0.96 () {56 vars in 1397 bytes} [Fri Jan 28 01:44:15 2022] GET /identity/v3/role_assignments?group.id=9ca862b44c3c402ba6d399f549aee851&scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3&role.id=0a6e12c9b8034527a8aa1988febe09ac => generated 260 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:15.809655 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201f10c-73b3-41c3-8be2-a6e288f761ea admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:15.817512 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57371b-3539-46d7-b5f7-2d96db05a8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:15.818734 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57371b-3539-46d7-b5f7-2d96db05a8ac admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.819316 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57371b-3539-46d7-b5f7-2d96db05a8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.819757 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57371b-3539-46d7-b5f7-2d96db05a8ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.822057 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57371b-3539-46d7-b5f7-2d96db05a8ac admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:15.822662 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57371b-3539-46d7-b5f7-2d96db05a8ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:15.825855 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57371b-3539-46d7-b5f7-2d96db05a8ac admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:15.843677 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 124/241] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:15.850579 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473895f1-a6c6-4630-9eb7-7c7089cb6197 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:15.877461 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe8953-f959-44a6-a022-298d784356b1 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.877749 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473895f1-a6c6-4630-9eb7-7c7089cb6197 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:15.877909 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe8953-f959-44a6-a022-298d784356b1 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.877909 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe8953-f959-44a6-a022-298d784356b1 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.879829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 125/242] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:44:15.887351 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af7033-eb42-4716-a8da-2ea3abd545e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:15.888353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af7033-eb42-4716-a8da-2ea3abd545e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.888528 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968df2f-f1c6-49ce-a1f1-308ab15e5b28 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.888701 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968df2f-f1c6-49ce-a1f1-308ab15e5b28 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.888888 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af7033-eb42-4716-a8da-2ea3abd545e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.889035 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968df2f-f1c6-49ce-a1f1-308ab15e5b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.889252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af7033-eb42-4716-a8da-2ea3abd545e3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.909737 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af7033-eb42-4716-a8da-2ea3abd545e3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:15.914118 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af7033-eb42-4716-a8da-2ea3abd545e3 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:15.925496 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-3968df2f-f1c6-49ce-a1f1-308ab15e5b28 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:15.926702 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-3968df2f-f1c6-49ce-a1f1-308ab15e5b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:15.943981 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 118/243] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:15 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:15.952269 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af7033-eb42-4716-a8da-2ea3abd545e3 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:15.954338 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 126/244] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:15 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:15.971310 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af7033-eb42-4716-a8da-2ea3abd545e3 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:15.983558 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165fb0a-4b24-4240-a8a7-9ce5886fefb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:15.985233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165fb0a-4b24-4240-a8a7-9ce5886fefb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:15.985723 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165fb0a-4b24-4240-a8a7-9ce5886fefb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:15.986203 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165fb0a-4b24-4240-a8a7-9ce5886fefb1 admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:15.989419 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165fb0a-4b24-4240-a8a7-9ce5886fefb1 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:15.994956 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165fb0a-4b24-4240-a8a7-9ce5886fefb1 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:15.998497 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 119/245] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:15 2022] GET /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:16.004084 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968df2f-f1c6-49ce-a1f1-308ab15e5b28 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:16.023533 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968df2f-f1c6-49ce-a1f1-308ab15e5b28 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:16.030060 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165fb0a-4b24-4240-a8a7-9ce5886fefb1 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:16.048649 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71150393-498e-4d9e-a46e-31f4de512f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:16.052458 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71150393-498e-4d9e-a46e-31f4de512f9b admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:16.053130 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71150393-498e-4d9e-a46e-31f4de512f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:16.053757 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71150393-498e-4d9e-a46e-31f4de512f9b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:16.057980 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165fb0a-4b24-4240-a8a7-9ce5886fefb1 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:16.077282 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a418111-13bb-41ab-9b28-006bfef14848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:16.082314 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a418111-13bb-41ab-9b28-006bfef14848 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:16.083167 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a418111-13bb-41ab-9b28-006bfef14848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:16.083851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a418111-13bb-41ab-9b28-006bfef14848 admin admin] PATH_INFO: `/v3/groups/9ca862b44c3c402ba6d399f549aee851` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:16.088972 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a418111-13bb-41ab-9b28-006bfef14848 admin admin] RBAC: Authorizing `identity:get_group(group_id=9ca862b44c3c402ba6d399f549aee851)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:16.098310 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71150393-498e-4d9e-a46e-31f4de512f9b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:16.098588 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a418111-13bb-41ab-9b28-006bfef14848 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:16.105612 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 120/246] 10.222.0.96 () {56 vars in 1201 bytes} [Fri Jan 28 01:44:16 2022] GET /identity/v3/groups/9ca862b44c3c402ba6d399f549aee851 => generated 226 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:16.112895 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a418111-13bb-41ab-9b28-006bfef14848 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:16.126321 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-71150393-498e-4d9e-a46e-31f4de512f9b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:44:16.128844 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 127/247] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:44:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 126 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:16.130554 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a418111-13bb-41ab-9b28-006bfef14848 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:16.136341 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71150393-498e-4d9e-a46e-31f4de512f9b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:16.138413 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5502d-6bef-44c4-b1ec-35be72a3f7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:16.139196 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5502d-6bef-44c4-b1ec-35be72a3f7ed admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:16.139578 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5502d-6bef-44c4-b1ec-35be72a3f7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:16.139973 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5502d-6bef-44c4-b1ec-35be72a3f7ed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:16.140950 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5502d-6bef-44c4-b1ec-35be72a3f7ed admin admin] RBAC: Adding query filter params (group.id=9ca862b44c3c402ba6d399f549aee851, role.id=fb4c25e67ee749378e33ec4843ae1dbf, scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:16.141430 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5502d-6bef-44c4-b1ec-35be72a3f7ed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:16.143370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5502d-6bef-44c4-b1ec-35be72a3f7ed admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:16.159796 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 121/248] 10.222.0.96 () {56 vars in 1397 bytes} [Fri Jan 28 01:44:16 2022] GET /identity/v3/role_assignments?group.id=9ca862b44c3c402ba6d399f549aee851&scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3&role.id=fb4c25e67ee749378e33ec4843ae1dbf => generated 260 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:16.161012 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71150393-498e-4d9e-a46e-31f4de512f9b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:16.172034 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ea2ee-1039-4586-adb1-3834c1b32d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:16.173599 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ea2ee-1039-4586-adb1-3834c1b32d47 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:16.174404 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ea2ee-1039-4586-adb1-3834c1b32d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:16.175068 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ea2ee-1039-4586-adb1-3834c1b32d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:16.176569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ea2ee-1039-4586-adb1-3834c1b32d47 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:16.177408 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ea2ee-1039-4586-adb1-3834c1b32d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:16.181560 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ea2ee-1039-4586-adb1-3834c1b32d47 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:16.202828 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 128/249] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:16.209155 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5502d-6bef-44c4-b1ec-35be72a3f7ed admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:16.226595 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5502d-6bef-44c4-b1ec-35be72a3f7ed admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:16.239112 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958ae61-a6bc-4873-a281-2c1ff2d27295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:16.240015 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958ae61-a6bc-4873-a281-2c1ff2d27295 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:16.240295 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958ae61-a6bc-4873-a281-2c1ff2d27295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:16.240563 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958ae61-a6bc-4873-a281-2c1ff2d27295 admin admin] PATH_INFO: `/v3/users/a76edb4be4ed4cb1ace2740887f5f01d` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:16.241830 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958ae61-a6bc-4873-a281-2c1ff2d27295 admin admin] RBAC: Authorizing `identity:get_user(user_id=a76edb4be4ed4cb1ace2740887f5f01d)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:16.245156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958ae61-a6bc-4873-a281-2c1ff2d27295 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:16.246909 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 122/250] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:44:16 2022] GET /identity/v3/users/a76edb4be4ed4cb1ace2740887f5f01d => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:16.254002 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ea2ee-1039-4586-adb1-3834c1b32d47 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:16.280339 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ea2ee-1039-4586-adb1-3834c1b32d47 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:16.288261 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6f05d-1c71-4fad-87a5-17235d048a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:16.290590 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6f05d-1c71-4fad-87a5-17235d048a8d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:16.291783 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6f05d-1c71-4fad-87a5-17235d048a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:16.292544 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6f05d-1c71-4fad-87a5-17235d048a8d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:16.312141 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6f05d-1c71-4fad-87a5-17235d048a8d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:16.318075 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6f05d-1c71-4fad-87a5-17235d048a8d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:16.339996 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 129/251] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:16 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:16.346448 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958ae61-a6bc-4873-a281-2c1ff2d27295 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:16.365735 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958ae61-a6bc-4873-a281-2c1ff2d27295 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:16.378447 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c2afa-4d1f-4cd6-aba0-1abe4d01b6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:16.379419 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c2afa-4d1f-4cd6-aba0-1abe4d01b6be admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:16.379659 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c2afa-4d1f-4cd6-aba0-1abe4d01b6be admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:16.379913 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c2afa-4d1f-4cd6-aba0-1abe4d01b6be admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:16.381336 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c2afa-4d1f-4cd6-aba0-1abe4d01b6be admin admin] RBAC: Authorizing `identity:get_project(project_id=65c96e1c663a4b7db4930772be89df09)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:16.384107 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c2afa-4d1f-4cd6-aba0-1abe4d01b6be admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:16.390878 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 123/252] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:16 2022] GET /identity/v3/projects/65c96e1c663a4b7db4930772be89df09 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:16.397843 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6f05d-1c71-4fad-87a5-17235d048a8d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:16.419238 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6f05d-1c71-4fad-87a5-17235d048a8d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:16.428168 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b1068-66c3-4ccc-9bca-486e88295f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:16.429700 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b1068-66c3-4ccc-9bca-486e88295f76 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:16.430988 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b1068-66c3-4ccc-9bca-486e88295f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:16.431803 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b1068-66c3-4ccc-9bca-486e88295f76 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:16.433593 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b1068-66c3-4ccc-9bca-486e88295f76 admin admin] RBAC: Adding query filter params (role.id=fb4c25e67ee749378e33ec4843ae1dbf, scope.project.id=65c96e1c663a4b7db4930772be89df09, user.id=a76edb4be4ed4cb1ace2740887f5f01d) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:16.434452 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b1068-66c3-4ccc-9bca-486e88295f76 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:16.438170 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b1068-66c3-4ccc-9bca-486e88295f76 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:16.454295 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 130/253] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:16 2022] GET /identity/v3/role_assignments?user.id=a76edb4be4ed4cb1ace2740887f5f01d&scope.project.id=65c96e1c663a4b7db4930772be89df09&role.id=fb4c25e67ee749378e33ec4843ae1dbf => generated 608 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:16.601291 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338a852-3b65-49be-b2ae-fde210115d0e None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:16.601690 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338a852-3b65-49be-b2ae-fde210115d0e None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:16.601983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338a852-3b65-49be-b2ae-fde210115d0e None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:16.605496 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 124/254] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:16.615387 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e9fec-9c16-4488-97a5-571399bbea14 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:16.616198 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e9fec-9c16-4488-97a5-571399bbea14 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:16.616901 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e9fec-9c16-4488-97a5-571399bbea14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:16.666913 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-117e9fec-9c16-4488-97a5-571399bbea14 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:16.669330 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-117e9fec-9c16-4488-97a5-571399bbea14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:16.685556 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 131/255] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:16 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:16.714469 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338a852-3b65-49be-b2ae-fde210115d0e None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:16.738612 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338a852-3b65-49be-b2ae-fde210115d0e None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:16.746510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ba556-258f-4d1d-a613-bb3db16be118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:16.747329 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ba556-258f-4d1d-a613-bb3db16be118 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:16.747598 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ba556-258f-4d1d-a613-bb3db16be118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:16.747871 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ba556-258f-4d1d-a613-bb3db16be118 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:16.769961 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ba556-258f-4d1d-a613-bb3db16be118 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:16.778281 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-e33ba556-258f-4d1d-a613-bb3db16be118 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:44:16.779852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 125/256] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:16.787174 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e9fec-9c16-4488-97a5-571399bbea14 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:16.808971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e9fec-9c16-4488-97a5-571399bbea14 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:16.824601 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fd271-ffad-4419-a068-390c23e9abff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:16.826235 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fd271-ffad-4419-a068-390c23e9abff admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:16.827027 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fd271-ffad-4419-a068-390c23e9abff admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:16.827791 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fd271-ffad-4419-a068-390c23e9abff admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:16.829461 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fd271-ffad-4419-a068-390c23e9abff admin admin] RBAC: Adding query filter params (name=member) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:16.830288 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fd271-ffad-4419-a068-390c23e9abff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:16.833729 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fd271-ffad-4419-a068-390c23e9abff admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:16.858897 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 132/257] 10.222.0.96 () {56 vars in 1122 bytes} [Fri Jan 28 01:44:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:16.865296 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ba556-258f-4d1d-a613-bb3db16be118 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:16.885585 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ba556-258f-4d1d-a613-bb3db16be118 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:16.894157 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9bd2b-eb12-4e55-b8ec-51076e32a822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:16.894825 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9bd2b-eb12-4e55-b8ec-51076e32a822 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:16.895102 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9bd2b-eb12-4e55-b8ec-51076e32a822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:16.895405 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9bd2b-eb12-4e55-b8ec-51076e32a822 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:16.909477 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9bd2b-eb12-4e55-b8ec-51076e32a822 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:16.911239 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9bd2b-eb12-4e55-b8ec-51076e32a822 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:16.927185 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 126/258] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:16 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:16.934963 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fd271-ffad-4419-a068-390c23e9abff admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:16.958317 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fd271-ffad-4419-a068-390c23e9abff admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:16.971149 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81134ccd-827e-4261-900a-25e5a0336187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:16.973095 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81134ccd-827e-4261-900a-25e5a0336187 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:16.973830 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81134ccd-827e-4261-900a-25e5a0336187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:16.974541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81134ccd-827e-4261-900a-25e5a0336187 admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:16.980223 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81134ccd-827e-4261-900a-25e5a0336187 admin admin] RBAC: Authorizing `identity:get_project(project_id=65c96e1c663a4b7db4930772be89df09)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:16.984590 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81134ccd-827e-4261-900a-25e5a0336187 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:16.988053 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 133/259] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:16 2022] GET /identity/v3/projects/65c96e1c663a4b7db4930772be89df09 => generated 302 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:16.994956 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9bd2b-eb12-4e55-b8ec-51076e32a822 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:17.006967 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9bd2b-eb12-4e55-b8ec-51076e32a822 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:17.022540 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dea6dc-9ba0-4255-b06d-33b81a6aa544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:17.023524 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dea6dc-9ba0-4255-b06d-33b81a6aa544 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:17.024887 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dea6dc-9ba0-4255-b06d-33b81a6aa544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:17.025190 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dea6dc-9ba0-4255-b06d-33b81a6aa544 admin admin] PATH_INFO: `/v3/groups/9ca862b44c3c402ba6d399f549aee851` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:17.026834 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dea6dc-9ba0-4255-b06d-33b81a6aa544 admin admin] RBAC: Authorizing `identity:get_group(group_id=9ca862b44c3c402ba6d399f549aee851)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:17.028722 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dea6dc-9ba0-4255-b06d-33b81a6aa544 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:17.030417 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 127/260] 10.222.0.96 () {56 vars in 1201 bytes} [Fri Jan 28 01:44:16 2022] GET /identity/v3/groups/9ca862b44c3c402ba6d399f549aee851 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:17.037911 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81134ccd-827e-4261-900a-25e5a0336187 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:17.061542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81134ccd-827e-4261-900a-25e5a0336187 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:17.069490 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28b16d-40c0-4069-a464-250602b2f813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:17.072132 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28b16d-40c0-4069-a464-250602b2f813 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:17.072868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28b16d-40c0-4069-a464-250602b2f813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:17.073620 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28b16d-40c0-4069-a464-250602b2f813 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:17.075453 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28b16d-40c0-4069-a464-250602b2f813 admin admin] RBAC: Adding query filter params (group.id=9ca862b44c3c402ba6d399f549aee851, role.id=0a6e12c9b8034527a8aa1988febe09ac, scope.project.id=65c96e1c663a4b7db4930772be89df09) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:17.076306 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28b16d-40c0-4069-a464-250602b2f813 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:17.080079 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28b16d-40c0-4069-a464-250602b2f813 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:17.094834 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 134/261] 10.222.0.96 () {56 vars in 1397 bytes} [Fri Jan 28 01:44:17 2022] GET /identity/v3/role_assignments?group.id=9ca862b44c3c402ba6d399f549aee851&scope.project.id=65c96e1c663a4b7db4930772be89df09&role.id=0a6e12c9b8034527a8aa1988febe09ac => generated 260 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:17.842558 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746af91e-8635-4e06-aed7-179ceef92182 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:17.843294 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746af91e-8635-4e06-aed7-179ceef92182 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:17.843294 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746af91e-8635-4e06-aed7-179ceef92182 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:17.845108 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 128/262] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:17.863637 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd00323-c4f9-48f6-91fd-9573a5de5eae None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:17.864354 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd00323-c4f9-48f6-91fd-9573a5de5eae None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:17.864354 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd00323-c4f9-48f6-91fd-9573a5de5eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:17.897323 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-bfd00323-c4f9-48f6-91fd-9573a5de5eae None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:17.898591 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-bfd00323-c4f9-48f6-91fd-9573a5de5eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:17.912719 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 135/263] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:17 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:17.979786 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746af91e-8635-4e06-aed7-179ceef92182 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:17.998164 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746af91e-8635-4e06-aed7-179ceef92182 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:18.003027 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9f26c-03e9-4c13-a900-19566b300d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:18.003845 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9f26c-03e9-4c13-a900-19566b300d2d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:18.004155 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9f26c-03e9-4c13-a900-19566b300d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:18.004427 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9f26c-03e9-4c13-a900-19566b300d2d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:18.015968 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665a582-3850-4b50-953f-c7369e2f0983 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:18.016354 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665a582-3850-4b50-953f-c7369e2f0983 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:18.016596 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665a582-3850-4b50-953f-c7369e2f0983 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:18.017447 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9f26c-03e9-4c13-a900-19566b300d2d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:18.018724 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 136/264] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:18.027834 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636e7be-cb58-4ed0-9f21-3cbabc0ffc1e None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:18.028201 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-86d9f26c-03e9-4c13-a900-19566b300d2d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:44:18.028459 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636e7be-cb58-4ed0-9f21-3cbabc0ffc1e None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:18.028459 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636e7be-cb58-4ed0-9f21-3cbabc0ffc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:18.029196 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 129/265] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:18.040025 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9f26c-03e9-4c13-a900-19566b300d2d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:18.058253 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9f26c-03e9-4c13-a900-19566b300d2d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:18.066241 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05dde4-c9de-4ad7-8814-c381564b1848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:18.067435 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05dde4-c9de-4ad7-8814-c381564b1848 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:18.067925 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05dde4-c9de-4ad7-8814-c381564b1848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:18.068466 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05dde4-c9de-4ad7-8814-c381564b1848 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:18.069971 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05dde4-c9de-4ad7-8814-c381564b1848 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:18.071561 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05dde4-c9de-4ad7-8814-c381564b1848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:18.074345 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05dde4-c9de-4ad7-8814-c381564b1848 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:18.097333 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 130/266] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:18.103511 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05dde4-c9de-4ad7-8814-c381564b1848 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:18.124035 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05dde4-c9de-4ad7-8814-c381564b1848 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:18.132193 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b102cb-67a6-4d76-b0cc-e20cd459b0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:18.133973 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b102cb-67a6-4d76-b0cc-e20cd459b0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:18.134542 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b102cb-67a6-4d76-b0cc-e20cd459b0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:18.135001 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b102cb-67a6-4d76-b0cc-e20cd459b0f3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:18.151879 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b102cb-67a6-4d76-b0cc-e20cd459b0f3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:18.154984 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b102cb-67a6-4d76-b0cc-e20cd459b0f3 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:18.176305 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 131/267] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:18 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:18.182280 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-c636e7be-cb58-4ed0-9f21-3cbabc0ffc1e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:18.183514 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c636e7be-cb58-4ed0-9f21-3cbabc0ffc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:18.184019 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b102cb-67a6-4d76-b0cc-e20cd459b0f3 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:18.202924 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b102cb-67a6-4d76-b0cc-e20cd459b0f3 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:18.203438 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 137/268] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:18 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:18.210842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbc277-837b-4f1a-b81a-d13b98c7bdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:18.212556 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbc277-837b-4f1a-b81a-d13b98c7bdaf admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:18.213163 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbc277-837b-4f1a-b81a-d13b98c7bdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:18.213672 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbc277-837b-4f1a-b81a-d13b98c7bdaf admin admin] PATH_INFO: `/v3/projects/7ed2a96df227403c8d2cdfcff229008d` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:18.215836 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbc277-837b-4f1a-b81a-d13b98c7bdaf admin admin] RBAC: Authorizing `identity:get_project(project_id=7ed2a96df227403c8d2cdfcff229008d)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:18.219482 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbc277-837b-4f1a-b81a-d13b98c7bdaf admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:18.222783 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 132/269] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:18 2022] GET /identity/v3/projects/7ed2a96df227403c8d2cdfcff229008d => generated 344 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:18.233627 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636e7be-cb58-4ed0-9f21-3cbabc0ffc1e None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:18.245460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbc277-837b-4f1a-b81a-d13b98c7bdaf admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:18.270528 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbc277-837b-4f1a-b81a-d13b98c7bdaf admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:18.271832 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636e7be-cb58-4ed0-9f21-3cbabc0ffc1e None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:18.286066 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27812890-8004-40fa-8758-fd7185080dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:18.288014 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f417a75-6e43-49e7-82e6-018d577bd244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:18.289181 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27812890-8004-40fa-8758-fd7185080dcb admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:18.290406 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27812890-8004-40fa-8758-fd7185080dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:18.290679 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f417a75-6e43-49e7-82e6-018d577bd244 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:18.290928 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27812890-8004-40fa-8758-fd7185080dcb admin admin] PATH_INFO: `/v3/groups/bcc02110ba6a405b829d9cf3e8f55b6d` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:18.291161 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f417a75-6e43-49e7-82e6-018d577bd244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:18.291161 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f417a75-6e43-49e7-82e6-018d577bd244 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:18.308619 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27812890-8004-40fa-8758-fd7185080dcb admin admin] RBAC: Authorizing `identity:get_group(group_id=bcc02110ba6a405b829d9cf3e8f55b6d)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:18.309687 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-27812890-8004-40fa-8758-fd7185080dcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:18.309687 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:44:18.309687 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:44:18.310866 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27812890-8004-40fa-8758-fd7185080dcb admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:18.312593 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 138/270] 10.222.0.96 () {56 vars in 1201 bytes} [Fri Jan 28 01:44:18 2022] GET /identity/v3/groups/bcc02110ba6a405b829d9cf3e8f55b6d => generated 229 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:18.322447 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f417a75-6e43-49e7-82e6-018d577bd244 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:18.341739 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-5f417a75-6e43-49e7-82e6-018d577bd244 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:44:18.343976 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 133/271] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:44:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:18.349637 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27812890-8004-40fa-8758-fd7185080dcb admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:18.350935 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f417a75-6e43-49e7-82e6-018d577bd244 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:18.371369 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27812890-8004-40fa-8758-fd7185080dcb admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:18.372223 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f417a75-6e43-49e7-82e6-018d577bd244 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:18.380073 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89091101-fb59-47fb-ab6f-2c190ff93d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:18.381270 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89091101-fb59-47fb-ab6f-2c190ff93d18 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:18.381843 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89091101-fb59-47fb-ab6f-2c190ff93d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:18.382471 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89091101-fb59-47fb-ab6f-2c190ff93d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:18.384490 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89091101-fb59-47fb-ab6f-2c190ff93d18 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:18.385045 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89091101-fb59-47fb-ab6f-2c190ff93d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:18.388273 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89091101-fb59-47fb-ab6f-2c190ff93d18 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:18.390090 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd185ada-1476-43d3-95fe-a45feaed7684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:18.390766 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd185ada-1476-43d3-95fe-a45feaed7684 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:18.391043 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd185ada-1476-43d3-95fe-a45feaed7684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:18.391314 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd185ada-1476-43d3-95fe-a45feaed7684 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:18.392146 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd185ada-1476-43d3-95fe-a45feaed7684 admin admin] RBAC: Adding query filter params (group.id=bcc02110ba6a405b829d9cf3e8f55b6d, role.id=253c0a1dc8d6421298a7987caaa55676, scope.project.id=7ed2a96df227403c8d2cdfcff229008d) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:18.392454 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd185ada-1476-43d3-95fe-a45feaed7684 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:18.394342 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd185ada-1476-43d3-95fe-a45feaed7684 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:18.405893 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 134/272] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:18.409060 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 139/273] 10.222.0.96 () {56 vars in 1397 bytes} [Fri Jan 28 01:44:18 2022] GET /identity/v3/role_assignments?group.id=bcc02110ba6a405b829d9cf3e8f55b6d&scope.project.id=7ed2a96df227403c8d2cdfcff229008d&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 260 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:18.414107 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89091101-fb59-47fb-ab6f-2c190ff93d18 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:18.425558 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89091101-fb59-47fb-ab6f-2c190ff93d18 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:18.436324 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537d9fe-d16c-43e3-844e-1ab83232da53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:18.437015 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537d9fe-d16c-43e3-844e-1ab83232da53 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:18.437343 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537d9fe-d16c-43e3-844e-1ab83232da53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:18.437619 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537d9fe-d16c-43e3-844e-1ab83232da53 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:18.446951 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537d9fe-d16c-43e3-844e-1ab83232da53 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:18.448782 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537d9fe-d16c-43e3-844e-1ab83232da53 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:18.463600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 135/274] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:18 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:18.470866 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd185ada-1476-43d3-95fe-a45feaed7684 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:18.487986 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd185ada-1476-43d3-95fe-a45feaed7684 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:18.500507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30e560-8f0b-47fa-8b4d-5afff4d65b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:18.501809 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30e560-8f0b-47fa-8b4d-5afff4d65b6f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:18.502304 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30e560-8f0b-47fa-8b4d-5afff4d65b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:18.502780 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30e560-8f0b-47fa-8b4d-5afff4d65b6f admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:18.509851 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30e560-8f0b-47fa-8b4d-5afff4d65b6f admin admin] RBAC: Authorizing `identity:get_project(project_id=65c96e1c663a4b7db4930772be89df09)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:18.512437 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30e560-8f0b-47fa-8b4d-5afff4d65b6f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:18.515085 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 140/275] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:18 2022] GET /identity/v3/projects/65c96e1c663a4b7db4930772be89df09 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:18.521126 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537d9fe-d16c-43e3-844e-1ab83232da53 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:18.530926 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537d9fe-d16c-43e3-844e-1ab83232da53 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:18.543086 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3bd89-b14c-467b-bc34-45bd5e4fe174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:18.544009 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3bd89-b14c-467b-bc34-45bd5e4fe174 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:18.544294 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3bd89-b14c-467b-bc34-45bd5e4fe174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:18.544567 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3bd89-b14c-467b-bc34-45bd5e4fe174 admin admin] PATH_INFO: `/v3/groups/9ca862b44c3c402ba6d399f549aee851` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:18.547253 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3bd89-b14c-467b-bc34-45bd5e4fe174 admin admin] RBAC: Authorizing `identity:get_group(group_id=9ca862b44c3c402ba6d399f549aee851)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:18.549231 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3bd89-b14c-467b-bc34-45bd5e4fe174 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:18.551008 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 136/276] 10.222.0.96 () {56 vars in 1201 bytes} [Fri Jan 28 01:44:18 2022] GET /identity/v3/groups/9ca862b44c3c402ba6d399f549aee851 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:18.558885 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30e560-8f0b-47fa-8b4d-5afff4d65b6f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:18.575483 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30e560-8f0b-47fa-8b4d-5afff4d65b6f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:18.583257 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acee808-25db-4373-8098-214e59a13354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:18.584327 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acee808-25db-4373-8098-214e59a13354 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:18.584826 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acee808-25db-4373-8098-214e59a13354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:18.585293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acee808-25db-4373-8098-214e59a13354 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:18.587086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acee808-25db-4373-8098-214e59a13354 admin admin] RBAC: Adding query filter params (group.id=9ca862b44c3c402ba6d399f549aee851, role.id=fb4c25e67ee749378e33ec4843ae1dbf, scope.project.id=65c96e1c663a4b7db4930772be89df09) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:18.587655 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acee808-25db-4373-8098-214e59a13354 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:18.589825 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acee808-25db-4373-8098-214e59a13354 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:18.602792 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 141/277] 10.222.0.96 () {56 vars in 1397 bytes} [Fri Jan 28 01:44:18 2022] GET /identity/v3/role_assignments?group.id=9ca862b44c3c402ba6d399f549aee851&scope.project.id=65c96e1c663a4b7db4930772be89df09&role.id=fb4c25e67ee749378e33ec4843ae1dbf => generated 260 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:19.724224 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bda4e4-4078-45c7-a3df-be81ef1ffd85 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:19.724723 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bda4e4-4078-45c7-a3df-be81ef1ffd85 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:19.724845 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bda4e4-4078-45c7-a3df-be81ef1ffd85 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:19.726598 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 137/278] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:19.735480 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa315ad-5eeb-496c-831e-b5f6c63ad69a None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:19.735961 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa315ad-5eeb-496c-831e-b5f6c63ad69a None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:19.736032 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa315ad-5eeb-496c-831e-b5f6c63ad69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:19.767739 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-0fa315ad-5eeb-496c-831e-b5f6c63ad69a None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:19.769034 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-0fa315ad-5eeb-496c-831e-b5f6c63ad69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:19.782630 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 142/279] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:19 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:19.827013 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bda4e4-4078-45c7-a3df-be81ef1ffd85 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:19.845584 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bda4e4-4078-45c7-a3df-be81ef1ffd85 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:19.850422 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef21997-d1c1-4317-b6e7-149a7637402e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:19.851241 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef21997-d1c1-4317-b6e7-149a7637402e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:19.851518 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef21997-d1c1-4317-b6e7-149a7637402e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:19.851821 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef21997-d1c1-4317-b6e7-149a7637402e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:19.866288 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef21997-d1c1-4317-b6e7-149a7637402e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:19.873776 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-0ef21997-d1c1-4317-b6e7-149a7637402e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:44:19.875405 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 138/280] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:44:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:19.881959 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa315ad-5eeb-496c-831e-b5f6c63ad69a None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:19.891946 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa315ad-5eeb-496c-831e-b5f6c63ad69a None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:19.894132 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e98d3c-a2e2-44c9-b03c-bca49609574b None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:19.894414 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e98d3c-a2e2-44c9-b03c-bca49609574b None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:19.894692 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e98d3c-a2e2-44c9-b03c-bca49609574b None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:19.896487 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 139/281] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:19.901557 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aa4e3-d023-4384-84ca-7c7f7c6e93f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:19.902244 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aa4e3-d023-4384-84ca-7c7f7c6e93f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:19.902524 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aa4e3-d023-4384-84ca-7c7f7c6e93f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:19.902798 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aa4e3-d023-4384-84ca-7c7f7c6e93f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:19.903565 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862aa4e3-d023-4384-84ca-7c7f7c6e93f5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:19.903870 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862aa4e3-d023-4384-84ca-7c7f7c6e93f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:19.906455 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588f924-249c-4389-aec7-f81e72595d40 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:19.906739 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588f924-249c-4389-aec7-f81e72595d40 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:19.907009 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588f924-249c-4389-aec7-f81e72595d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:19.910077 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862aa4e3-d023-4384-84ca-7c7f7c6e93f5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:19.939240 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 143/282] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:19.946252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-3588f924-249c-4389-aec7-f81e72595d40 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:19.946664 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aa4e3-d023-4384-84ca-7c7f7c6e93f5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:19.948091 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-3588f924-249c-4389-aec7-f81e72595d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:19.958676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aa4e3-d023-4384-84ca-7c7f7c6e93f5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:19.961019 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 140/283] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:19 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:19.970842 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae88e74-a374-41fb-b930-92d5aa330364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:19.972067 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae88e74-a374-41fb-b930-92d5aa330364 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:19.972545 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae88e74-a374-41fb-b930-92d5aa330364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:19.973035 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae88e74-a374-41fb-b930-92d5aa330364 admin admin] PATH_INFO: `/v3/groups/9ca862b44c3c402ba6d399f549aee851` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:19.974561 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae88e74-a374-41fb-b930-92d5aa330364 admin admin] RBAC: Authorizing `identity:get_group(group_id=9ca862b44c3c402ba6d399f549aee851)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:19.976719 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae88e74-a374-41fb-b930-92d5aa330364 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:19.979543 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 144/284] 10.222.0.96 () {56 vars in 1201 bytes} [Fri Jan 28 01:44:19 2022] GET /identity/v3/groups/9ca862b44c3c402ba6d399f549aee851 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:19.986183 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588f924-249c-4389-aec7-f81e72595d40 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:19.996941 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588f924-249c-4389-aec7-f81e72595d40 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:20.007462 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507912be-af3e-4a8a-a14a-8877c4964d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:20.009625 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507912be-af3e-4a8a-a14a-8877c4964d4d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:20.010283 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507912be-af3e-4a8a-a14a-8877c4964d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:20.010753 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507912be-af3e-4a8a-a14a-8877c4964d4d admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:20.014844 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507912be-af3e-4a8a-a14a-8877c4964d4d admin admin] RBAC: Authorizing `identity:get_project(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:20.017246 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507912be-af3e-4a8a-a14a-8877c4964d4d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:20.019261 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 141/285] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:19 2022] GET /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:20.021013 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae88e74-a374-41fb-b930-92d5aa330364 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:20.028185 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507912be-af3e-4a8a-a14a-8877c4964d4d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:20.040127 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae88e74-a374-41fb-b930-92d5aa330364 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:20.049417 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507912be-af3e-4a8a-a14a-8877c4964d4d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:20.050889 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c137b-a60a-4c2e-8b27-d6747a8ee3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:20.051964 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c137b-a60a-4c2e-8b27-d6747a8ee3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:20.052446 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c137b-a60a-4c2e-8b27-d6747a8ee3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:20.052967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c137b-a60a-4c2e-8b27-d6747a8ee3a5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:20.064323 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457b9f2-8dd6-4cb4-a77a-d3dbc03e1ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:20.066843 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457b9f2-8dd6-4cb4-a77a-d3dbc03e1ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:20.067331 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457b9f2-8dd6-4cb4-a77a-d3dbc03e1ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:20.068546 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457b9f2-8dd6-4cb4-a77a-d3dbc03e1ae0 admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3/groups/9ca862b44c3c402ba6d399f549aee851/roles/fb4c25e67ee749378e33ec4843ae1dbf` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:20.074433 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457b9f2-8dd6-4cb4-a77a-d3dbc03e1ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3, group_id=9ca862b44c3c402ba6d399f549aee851, role_id=fb4c25e67ee749378e33ec4843ae1dbf)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:20.077466 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457b9f2-8dd6-4cb4-a77a-d3dbc03e1ae0 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:20.078288 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c137b-a60a-4c2e-8b27-d6747a8ee3a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:20.088569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-457c137b-a60a-4c2e-8b27-d6747a8ee3a5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:44:20.096641 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 145/286] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:20.099022 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c137b-a60a-4c2e-8b27-d6747a8ee3a5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:20.108458 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 142/287] 10.222.0.96 () {58 vars in 1463 bytes} [Fri Jan 28 01:44:20 2022] PUT /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3/groups/9ca862b44c3c402ba6d399f549aee851/roles/fb4c25e67ee749378e33ec4843ae1dbf => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:44:20.120736 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c137b-a60a-4c2e-8b27-d6747a8ee3a5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:20.202590 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e4e08-8e94-4a94-8749-07ff4f34c639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:20.203745 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e4e08-8e94-4a94-8749-07ff4f34c639 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:20.204277 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e4e08-8e94-4a94-8749-07ff4f34c639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:20.204746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e4e08-8e94-4a94-8749-07ff4f34c639 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:20.205818 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e4e08-8e94-4a94-8749-07ff4f34c639 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:20.206326 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e4e08-8e94-4a94-8749-07ff4f34c639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:20.208189 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e4e08-8e94-4a94-8749-07ff4f34c639 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:20.220925 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 146/288] 10.222.0.96 () {56 vars in 1122 bytes} [Fri Jan 28 01:44:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:20.227955 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457b9f2-8dd6-4cb4-a77a-d3dbc03e1ae0 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:20.240043 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457b9f2-8dd6-4cb4-a77a-d3dbc03e1ae0 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:20.247743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57613e3-bdf6-423e-9af3-525a70521dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:20.249117 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57613e3-bdf6-423e-9af3-525a70521dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:20.249600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57613e3-bdf6-423e-9af3-525a70521dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:20.250068 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57613e3-bdf6-423e-9af3-525a70521dc0 admin admin] PATH_INFO: `/v3/groups/9ca862b44c3c402ba6d399f549aee851` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:20.251835 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57613e3-bdf6-423e-9af3-525a70521dc0 admin admin] RBAC: Authorizing `identity:get_group(group_id=9ca862b44c3c402ba6d399f549aee851)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:20.254121 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57613e3-bdf6-423e-9af3-525a70521dc0 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:20.256154 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 143/289] 10.222.0.96 () {56 vars in 1201 bytes} [Fri Jan 28 01:44:20 2022] GET /identity/v3/groups/9ca862b44c3c402ba6d399f549aee851 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:20.264178 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e4e08-8e94-4a94-8749-07ff4f34c639 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:20.278347 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e4e08-8e94-4a94-8749-07ff4f34c639 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:20.284061 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae1371-5435-4e38-a5c7-af9f9e7b2d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:20.285399 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae1371-5435-4e38-a5c7-af9f9e7b2d74 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:20.285910 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae1371-5435-4e38-a5c7-af9f9e7b2d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:20.286382 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae1371-5435-4e38-a5c7-af9f9e7b2d74 admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:20.287913 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae1371-5435-4e38-a5c7-af9f9e7b2d74 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:20.291048 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae1371-5435-4e38-a5c7-af9f9e7b2d74 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:20.293240 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 147/290] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:20 2022] GET /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:20.300259 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57613e3-bdf6-423e-9af3-525a70521dc0 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:20.313231 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57613e3-bdf6-423e-9af3-525a70521dc0 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:20.318515 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdebd44-0680-4137-a704-0408ecd2dc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:20.319777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdebd44-0680-4137-a704-0408ecd2dc7e admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:20.320252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdebd44-0680-4137-a704-0408ecd2dc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:20.321339 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdebd44-0680-4137-a704-0408ecd2dc7e admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3/groups/9ca862b44c3c402ba6d399f549aee851/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:20.323982 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdebd44-0680-4137-a704-0408ecd2dc7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3, group_id=9ca862b44c3c402ba6d399f549aee851, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:20.327017 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdebd44-0680-4137-a704-0408ecd2dc7e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:20.355309 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 144/291] 10.222.0.96 () {58 vars in 1463 bytes} [Fri Jan 28 01:44:20 2022] PUT /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3/groups/9ca862b44c3c402ba6d399f549aee851/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:44:20.798180 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1f327-cec7-478d-9b87-b1573d6c098a None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:20.798699 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1f327-cec7-478d-9b87-b1573d6c098a None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:20.798699 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1f327-cec7-478d-9b87-b1573d6c098a None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:20.800885 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 148/292] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:20.811061 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02196c-05ef-436a-b733-12bda192eb88 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:20.811557 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02196c-05ef-436a-b733-12bda192eb88 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:20.811629 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02196c-05ef-436a-b733-12bda192eb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:20.835264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-ec02196c-05ef-436a-b733-12bda192eb88 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:20.837257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ec02196c-05ef-436a-b733-12bda192eb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:20.913171 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 145/293] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:20 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:20.949989 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1f327-cec7-478d-9b87-b1573d6c098a None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:20.966575 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1f327-cec7-478d-9b87-b1573d6c098a None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:20.971946 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161aa12-9320-4fa1-bdea-09f15d984780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:20.972775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161aa12-9320-4fa1-bdea-09f15d984780 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:20.973092 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161aa12-9320-4fa1-bdea-09f15d984780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:20.973364 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161aa12-9320-4fa1-bdea-09f15d984780 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:20.992270 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161aa12-9320-4fa1-bdea-09f15d984780 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:21.003901 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-5161aa12-9320-4fa1-bdea-09f15d984780 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:44:21.005179 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 149/294] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:21.012152 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02196c-05ef-436a-b733-12bda192eb88 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:21.026667 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02196c-05ef-436a-b733-12bda192eb88 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:21.036195 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dffb06-44a5-4b6e-b3bf-c68f83d2e5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:21.036914 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dffb06-44a5-4b6e-b3bf-c68f83d2e5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:21.037196 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dffb06-44a5-4b6e-b3bf-c68f83d2e5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:21.037470 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dffb06-44a5-4b6e-b3bf-c68f83d2e5b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:21.038233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dffb06-44a5-4b6e-b3bf-c68f83d2e5b8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:21.038536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dffb06-44a5-4b6e-b3bf-c68f83d2e5b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:21.040653 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dffb06-44a5-4b6e-b3bf-c68f83d2e5b8 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:21.055944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 146/295] 10.222.0.96 () {56 vars in 1122 bytes} [Fri Jan 28 01:44:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:21.061724 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161aa12-9320-4fa1-bdea-09f15d984780 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:21.073032 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161aa12-9320-4fa1-bdea-09f15d984780 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:21.085385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5585f0-897e-45e4-a876-70c8916b19dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:21.086907 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5585f0-897e-45e4-a876-70c8916b19dc admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:21.087188 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5585f0-897e-45e4-a876-70c8916b19dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:21.087458 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5585f0-897e-45e4-a876-70c8916b19dc admin admin] PATH_INFO: `/v3/groups/9ca862b44c3c402ba6d399f549aee851` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:21.093861 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5585f0-897e-45e4-a876-70c8916b19dc admin admin] RBAC: Authorizing `identity:get_group(group_id=9ca862b44c3c402ba6d399f549aee851)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:21.095870 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5585f0-897e-45e4-a876-70c8916b19dc admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:21.098011 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 150/296] 10.222.0.96 () {56 vars in 1201 bytes} [Fri Jan 28 01:44:21 2022] GET /identity/v3/groups/9ca862b44c3c402ba6d399f549aee851 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:21.105483 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dffb06-44a5-4b6e-b3bf-c68f83d2e5b8 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:21.118724 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dffb06-44a5-4b6e-b3bf-c68f83d2e5b8 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:21.129043 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d69de6-1ec2-49aa-bc36-025cce339618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:21.129925 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d69de6-1ec2-49aa-bc36-025cce339618 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:21.130205 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d69de6-1ec2-49aa-bc36-025cce339618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:21.130479 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d69de6-1ec2-49aa-bc36-025cce339618 admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:21.133475 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d69de6-1ec2-49aa-bc36-025cce339618 admin admin] RBAC: Authorizing `identity:get_project(project_id=65c96e1c663a4b7db4930772be89df09)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:21.135981 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d69de6-1ec2-49aa-bc36-025cce339618 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:21.138049 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 147/297] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:21 2022] GET /identity/v3/projects/65c96e1c663a4b7db4930772be89df09 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:21.144136 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5585f0-897e-45e4-a876-70c8916b19dc admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:21.158690 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5585f0-897e-45e4-a876-70c8916b19dc admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:21.169247 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d33c1-837a-4e73-a620-c00de7dc06d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:21.170144 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d33c1-837a-4e73-a620-c00de7dc06d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:21.170427 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d33c1-837a-4e73-a620-c00de7dc06d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:21.170699 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d33c1-837a-4e73-a620-c00de7dc06d1 admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09/groups/9ca862b44c3c402ba6d399f549aee851/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:21.178282 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d33c1-837a-4e73-a620-c00de7dc06d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c96e1c663a4b7db4930772be89df09, group_id=9ca862b44c3c402ba6d399f549aee851, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:21.181010 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d33c1-837a-4e73-a620-c00de7dc06d1 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:21.193758 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ed390-afb8-4de2-91da-ea969a9dd409 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:21.194068 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ed390-afb8-4de2-91da-ea969a9dd409 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:21.194297 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ed390-afb8-4de2-91da-ea969a9dd409 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:21.196463 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 148/298] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:21.203574 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 151/299] 10.222.0.96 () {58 vars in 1463 bytes} [Fri Jan 28 01:44:21 2022] PUT /identity/v3/projects/65c96e1c663a4b7db4930772be89df09/groups/9ca862b44c3c402ba6d399f549aee851/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:44:21.204779 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2022e7a-3a22-4a08-bee8-acf2a0e87fc6 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:21.205091 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2022e7a-3a22-4a08-bee8-acf2a0e87fc6 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:21.205362 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2022e7a-3a22-4a08-bee8-acf2a0e87fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:21.238734 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-b2022e7a-3a22-4a08-bee8-acf2a0e87fc6 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:21.239974 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b2022e7a-3a22-4a08-bee8-acf2a0e87fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:21.340604 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 149/300] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:21 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:21.385051 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d33c1-837a-4e73-a620-c00de7dc06d1 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:21.395499 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d33c1-837a-4e73-a620-c00de7dc06d1 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:21.405490 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6f774-259a-4a5f-82e4-e11baeb75840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:21.406287 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6f774-259a-4a5f-82e4-e11baeb75840 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:21.406567 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6f774-259a-4a5f-82e4-e11baeb75840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:21.406838 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6f774-259a-4a5f-82e4-e11baeb75840 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:21.425718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6f774-259a-4a5f-82e4-e11baeb75840 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:21.433550 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-00d6f774-259a-4a5f-82e4-e11baeb75840 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:44:21.435131 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 152/301] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:21.441498 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2022e7a-3a22-4a08-bee8-acf2a0e87fc6 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:21.454028 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2022e7a-3a22-4a08-bee8-acf2a0e87fc6 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:21.462915 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f0fdf-3585-4bf9-aa00-248d12253815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:21.463600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0fdf-3585-4bf9-aa00-248d12253815 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:21.463880 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0fdf-3585-4bf9-aa00-248d12253815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:21.464154 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0fdf-3585-4bf9-aa00-248d12253815 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:21.464941 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f0fdf-3585-4bf9-aa00-248d12253815 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:21.465247 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f0fdf-3585-4bf9-aa00-248d12253815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:21.466851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f0fdf-3585-4bf9-aa00-248d12253815 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:21.481923 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 150/302] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:21.488455 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6f774-259a-4a5f-82e4-e11baeb75840 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:21.499516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6f774-259a-4a5f-82e4-e11baeb75840 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:21.508818 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5155e2-a884-41a8-8846-6a497771dcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:21.509717 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5155e2-a884-41a8-8846-6a497771dcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:21.509997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5155e2-a884-41a8-8846-6a497771dcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:21.510269 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5155e2-a884-41a8-8846-6a497771dcd7 admin admin] PATH_INFO: `/v3/groups/bcc02110ba6a405b829d9cf3e8f55b6d` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:21.514173 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5155e2-a884-41a8-8846-6a497771dcd7 admin admin] RBAC: Authorizing `identity:get_group(group_id=bcc02110ba6a405b829d9cf3e8f55b6d)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:21.516158 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5155e2-a884-41a8-8846-6a497771dcd7 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:21.518216 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 153/303] 10.222.0.96 () {56 vars in 1201 bytes} [Fri Jan 28 01:44:21 2022] GET /identity/v3/groups/bcc02110ba6a405b829d9cf3e8f55b6d => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:21.524692 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f0fdf-3585-4bf9-aa00-248d12253815 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:21.543869 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f0fdf-3585-4bf9-aa00-248d12253815 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:21.558191 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0aded-c28e-4aa3-9a30-e64ce731b750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:21.559070 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0aded-c28e-4aa3-9a30-e64ce731b750 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:21.559348 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0aded-c28e-4aa3-9a30-e64ce731b750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:21.559619 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0aded-c28e-4aa3-9a30-e64ce731b750 admin admin] PATH_INFO: `/v3/projects/7ed2a96df227403c8d2cdfcff229008d` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:21.561808 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0aded-c28e-4aa3-9a30-e64ce731b750 admin admin] RBAC: Authorizing `identity:get_project(project_id=7ed2a96df227403c8d2cdfcff229008d)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:21.563601 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0aded-c28e-4aa3-9a30-e64ce731b750 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:21.565675 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 151/304] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:21 2022] GET /identity/v3/projects/7ed2a96df227403c8d2cdfcff229008d => generated 344 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:21.575001 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5155e2-a884-41a8-8846-6a497771dcd7 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:21.587559 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5155e2-a884-41a8-8846-6a497771dcd7 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:21.596790 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704260b-e16c-4cf7-a477-d04216d64c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:21.598107 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704260b-e16c-4cf7-a477-d04216d64c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:21.598587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704260b-e16c-4cf7-a477-d04216d64c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:21.599082 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704260b-e16c-4cf7-a477-d04216d64c9d admin admin] PATH_INFO: `/v3/projects/7ed2a96df227403c8d2cdfcff229008d/groups/bcc02110ba6a405b829d9cf3e8f55b6d/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:21.605683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704260b-e16c-4cf7-a477-d04216d64c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed2a96df227403c8d2cdfcff229008d, group_id=bcc02110ba6a405b829d9cf3e8f55b6d, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:21.608922 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704260b-e16c-4cf7-a477-d04216d64c9d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:21.629042 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 154/305] 10.222.0.96 () {58 vars in 1463 bytes} [Fri Jan 28 01:44:21 2022] PUT /identity/v3/projects/7ed2a96df227403c8d2cdfcff229008d/groups/bcc02110ba6a405b829d9cf3e8f55b6d/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:44:22.112299 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a223cda-740e-4fcd-9c9f-5bd2d9b0709b None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:22.113330 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a223cda-740e-4fcd-9c9f-5bd2d9b0709b None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:22.113842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a223cda-740e-4fcd-9c9f-5bd2d9b0709b None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:22.115906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 152/306] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:22.124353 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0ef56-0545-4a4f-bd07-71320799dd29 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:22.124872 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0ef56-0545-4a4f-bd07-71320799dd29 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:22.124949 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0ef56-0545-4a4f-bd07-71320799dd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:22.144210 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-55e0ef56-0545-4a4f-bd07-71320799dd29 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:22.150194 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-55e0ef56-0545-4a4f-bd07-71320799dd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:22.221909 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 155/307] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:22 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:22.254535 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a223cda-740e-4fcd-9c9f-5bd2d9b0709b None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:22.267686 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a223cda-740e-4fcd-9c9f-5bd2d9b0709b None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:22.272459 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bc3c3-6acc-4f6a-a5a9-deede73dbfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:22.273293 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bc3c3-6acc-4f6a-a5a9-deede73dbfcf admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:22.273580 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bc3c3-6acc-4f6a-a5a9-deede73dbfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:22.274032 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bc3c3-6acc-4f6a-a5a9-deede73dbfcf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:22.285498 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bc3c3-6acc-4f6a-a5a9-deede73dbfcf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:22.293412 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-458bc3c3-6acc-4f6a-a5a9-deede73dbfcf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:44:22.294976 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 153/308] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:44:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:22.301282 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0ef56-0545-4a4f-bd07-71320799dd29 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:22.311176 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0ef56-0545-4a4f-bd07-71320799dd29 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:22.321051 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee06a11-9c67-4cc9-9dcd-46dd0b41b72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:22.321830 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee06a11-9c67-4cc9-9dcd-46dd0b41b72d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:22.322109 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee06a11-9c67-4cc9-9dcd-46dd0b41b72d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:22.322376 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee06a11-9c67-4cc9-9dcd-46dd0b41b72d admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:22.323305 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee06a11-9c67-4cc9-9dcd-46dd0b41b72d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:22.323611 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee06a11-9c67-4cc9-9dcd-46dd0b41b72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:22.325267 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee06a11-9c67-4cc9-9dcd-46dd0b41b72d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:22.340451 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 156/309] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:22.346798 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bc3c3-6acc-4f6a-a5a9-deede73dbfcf admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:22.359396 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bc3c3-6acc-4f6a-a5a9-deede73dbfcf admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:22.373578 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c10630-426f-4611-8dde-1c42fb3d4214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:22.374779 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c10630-426f-4611-8dde-1c42fb3d4214 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:22.375260 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c10630-426f-4611-8dde-1c42fb3d4214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:22.375726 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c10630-426f-4611-8dde-1c42fb3d4214 admin admin] PATH_INFO: `/v3/groups/9ca862b44c3c402ba6d399f549aee851` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:22.377195 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c10630-426f-4611-8dde-1c42fb3d4214 admin admin] RBAC: Authorizing `identity:get_group(group_id=9ca862b44c3c402ba6d399f549aee851)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:22.379302 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c10630-426f-4611-8dde-1c42fb3d4214 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:22.381526 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 154/310] 10.222.0.96 () {56 vars in 1201 bytes} [Fri Jan 28 01:44:22 2022] GET /identity/v3/groups/9ca862b44c3c402ba6d399f549aee851 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:22.389701 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee06a11-9c67-4cc9-9dcd-46dd0b41b72d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:22.400583 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee06a11-9c67-4cc9-9dcd-46dd0b41b72d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:22.410273 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447a11a-9c6b-441f-8103-297ded56a35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:22.411236 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447a11a-9c6b-441f-8103-297ded56a35c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:22.411550 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447a11a-9c6b-441f-8103-297ded56a35c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:22.411820 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447a11a-9c6b-441f-8103-297ded56a35c admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:22.413129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447a11a-9c6b-441f-8103-297ded56a35c admin admin] RBAC: Authorizing `identity:get_project(project_id=65c96e1c663a4b7db4930772be89df09)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:22.415804 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447a11a-9c6b-441f-8103-297ded56a35c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:22.417689 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 157/311] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:22 2022] GET /identity/v3/projects/65c96e1c663a4b7db4930772be89df09 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:22.424094 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c10630-426f-4611-8dde-1c42fb3d4214 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:22.437984 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c10630-426f-4611-8dde-1c42fb3d4214 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:22.449536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759187f2-c6d3-4063-81d1-af3203f57153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:22.450740 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759187f2-c6d3-4063-81d1-af3203f57153 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:22.451226 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759187f2-c6d3-4063-81d1-af3203f57153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:22.451725 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759187f2-c6d3-4063-81d1-af3203f57153 admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09/groups/9ca862b44c3c402ba6d399f549aee851/roles/fb4c25e67ee749378e33ec4843ae1dbf` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:22.458682 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759187f2-c6d3-4063-81d1-af3203f57153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c96e1c663a4b7db4930772be89df09, group_id=9ca862b44c3c402ba6d399f549aee851, role_id=fb4c25e67ee749378e33ec4843ae1dbf)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:22.462380 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759187f2-c6d3-4063-81d1-af3203f57153 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:22.494849 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 155/312] 10.222.0.96 () {58 vars in 1463 bytes} [Fri Jan 28 01:44:22 2022] PUT /identity/v3/projects/65c96e1c663a4b7db4930772be89df09/groups/9ca862b44c3c402ba6d399f549aee851/roles/fb4c25e67ee749378e33ec4843ae1dbf => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:44:23.196694 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd55ae-b0ca-4645-923f-947722b9d912 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:23.197420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd55ae-b0ca-4645-923f-947722b9d912 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:23.197689 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd55ae-b0ca-4645-923f-947722b9d912 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:23.200162 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 158/313] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:23.208133 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d744e0-ad50-41b3-9698-afcc284b8d59 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:23.208652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d744e0-ad50-41b3-9698-afcc284b8d59 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:23.208727 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d744e0-ad50-41b3-9698-afcc284b8d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:23.237965 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-41d744e0-ad50-41b3-9698-afcc284b8d59 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:23.239185 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-41d744e0-ad50-41b3-9698-afcc284b8d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:23.256972 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709215d-d853-4347-8262-f0f1531d7eca None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:23.257301 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709215d-d853-4347-8262-f0f1531d7eca None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:23.257527 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709215d-d853-4347-8262-f0f1531d7eca None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:23.262187 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 159/314] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:23.268392 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dd749-8a30-4eac-873e-bf4f1ebfcb2d None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:23.268672 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dd749-8a30-4eac-873e-bf4f1ebfcb2d None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:23.268973 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dd749-8a30-4eac-873e-bf4f1ebfcb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:23.300242 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-7c0dd749-8a30-4eac-873e-bf4f1ebfcb2d None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:23.301468 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-7c0dd749-8a30-4eac-873e-bf4f1ebfcb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:23.308051 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 156/315] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:23 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:23.317182 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 160/316] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:23 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:23.333454 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d744e0-ad50-41b3-9698-afcc284b8d59 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:23.342350 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dd749-8a30-4eac-873e-bf4f1ebfcb2d None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:23.348613 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d744e0-ad50-41b3-9698-afcc284b8d59 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:23.355960 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dd749-8a30-4eac-873e-bf4f1ebfcb2d None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:23.359604 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e76d4-f13a-4451-8002-b05262dcd6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:23.360423 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e76d4-f13a-4451-8002-b05262dcd6ff admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:23.360700 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e76d4-f13a-4451-8002-b05262dcd6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:23.361001 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e76d4-f13a-4451-8002-b05262dcd6ff admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:23.369941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cb65c-4d80-4c89-9690-1b90998ecc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:23.370750 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cb65c-4d80-4c89-9690-1b90998ecc98 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:23.371025 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cb65c-4d80-4c89-9690-1b90998ecc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:23.371297 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cb65c-4d80-4c89-9690-1b90998ecc98 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:23.383174 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e76d4-f13a-4451-8002-b05262dcd6ff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:23.391968 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-e92e76d4-f13a-4451-8002-b05262dcd6ff admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:44:23.394669 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 157/317] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:44:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:23.395998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4cb65c-4d80-4c89-9690-1b90998ecc98 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:23.403550 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e76d4-f13a-4451-8002-b05262dcd6ff admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:23.415661 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-0c4cb65c-4d80-4c89-9690-1b90998ecc98 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:44:23.419631 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e76d4-f13a-4451-8002-b05262dcd6ff admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:23.422380 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 161/318] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:23.423671 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cb65c-4d80-4c89-9690-1b90998ecc98 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:23.426199 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c246a3-6f3d-41ae-9b5f-d726111a29c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:23.428022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c246a3-6f3d-41ae-9b5f-d726111a29c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:23.428307 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c246a3-6f3d-41ae-9b5f-d726111a29c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:23.428580 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c246a3-6f3d-41ae-9b5f-d726111a29c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:23.429366 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c246a3-6f3d-41ae-9b5f-d726111a29c6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:23.429668 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c246a3-6f3d-41ae-9b5f-d726111a29c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:23.436364 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c246a3-6f3d-41ae-9b5f-d726111a29c6 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:23.447034 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cb65c-4d80-4c89-9690-1b90998ecc98 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:23.453406 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 158/319] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:23.455023 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483e5d4-378a-4717-8278-40a20ecf2133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:23.455695 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483e5d4-378a-4717-8278-40a20ecf2133 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:23.456020 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483e5d4-378a-4717-8278-40a20ecf2133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:23.456340 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483e5d4-378a-4717-8278-40a20ecf2133 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:23.457131 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483e5d4-378a-4717-8278-40a20ecf2133 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:23.457434 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483e5d4-378a-4717-8278-40a20ecf2133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:23.459103 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483e5d4-378a-4717-8278-40a20ecf2133 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:23.461480 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c246a3-6f3d-41ae-9b5f-d726111a29c6 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:23.478285 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c246a3-6f3d-41ae-9b5f-d726111a29c6 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:23.484051 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 162/320] 10.222.0.96 () {56 vars in 1122 bytes} [Fri Jan 28 01:44:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:23.490490 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483e5d4-378a-4717-8278-40a20ecf2133 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:23.492049 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c8c64-56d7-4272-b25b-ac7e256b5ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:23.496675 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c8c64-56d7-4272-b25b-ac7e256b5ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:23.496980 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c8c64-56d7-4272-b25b-ac7e256b5ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:23.497253 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c8c64-56d7-4272-b25b-ac7e256b5ab5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:23.509316 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483e5d4-378a-4717-8278-40a20ecf2133 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:23.514464 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c8c64-56d7-4272-b25b-ac7e256b5ab5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:23.517006 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c8c64-56d7-4272-b25b-ac7e256b5ab5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:23.523280 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690c0b8-1adb-4b62-9caa-30e724f009ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:23.524544 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690c0b8-1adb-4b62-9caa-30e724f009ad admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:23.525250 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690c0b8-1adb-4b62-9caa-30e724f009ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:23.525736 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690c0b8-1adb-4b62-9caa-30e724f009ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:23.537365 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 159/321] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:23 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:44:23.545633 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c8c64-56d7-4272-b25b-ac7e256b5ab5 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:23.546825 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690c0b8-1adb-4b62-9caa-30e724f009ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:23.548891 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690c0b8-1adb-4b62-9caa-30e724f009ad admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:23.565125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c8c64-56d7-4272-b25b-ac7e256b5ab5 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:23.568720 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 163/322] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:23 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:23.573542 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1ff3e-1116-4267-89e4-2c98094de65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:23.574404 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1ff3e-1116-4267-89e4-2c98094de65c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:23.574680 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1ff3e-1116-4267-89e4-2c98094de65c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:23.574954 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1ff3e-1116-4267-89e4-2c98094de65c admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:23.576191 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1ff3e-1116-4267-89e4-2c98094de65c admin admin] RBAC: Authorizing `identity:get_project(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:23.577845 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690c0b8-1adb-4b62-9caa-30e724f009ad admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:23.582856 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1ff3e-1116-4267-89e4-2c98094de65c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:23.584704 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 160/323] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:23 2022] GET /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:23.591140 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690c0b8-1adb-4b62-9caa-30e724f009ad admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:23.594777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1ff3e-1116-4267-89e4-2c98094de65c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:23.597527 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf303ba-ca7a-4ddc-bbcf-13744029267d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:23.598480 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf303ba-ca7a-4ddc-bbcf-13744029267d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:23.598791 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf303ba-ca7a-4ddc-bbcf-13744029267d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:23.599065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf303ba-ca7a-4ddc-bbcf-13744029267d admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:23.600282 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf303ba-ca7a-4ddc-bbcf-13744029267d admin admin] RBAC: Authorizing `identity:get_project(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:23.603255 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf303ba-ca7a-4ddc-bbcf-13744029267d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:23.605512 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 164/324] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:23 2022] GET /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:23.616763 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf303ba-ca7a-4ddc-bbcf-13744029267d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:23.627654 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1ff3e-1116-4267-89e4-2c98094de65c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:23.630896 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf303ba-ca7a-4ddc-bbcf-13744029267d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:23.638248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048bbcd-8385-409f-916e-da47dbf0a347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:23.639110 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048bbcd-8385-409f-916e-da47dbf0a347 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:23.639387 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048bbcd-8385-409f-916e-da47dbf0a347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:23.639658 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048bbcd-8385-409f-916e-da47dbf0a347 admin admin] PATH_INFO: `/v3/groups/9ca862b44c3c402ba6d399f549aee851` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:23.641315 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048bbcd-8385-409f-916e-da47dbf0a347 admin admin] RBAC: Authorizing `identity:get_group(group_id=9ca862b44c3c402ba6d399f549aee851)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:23.643207 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048bbcd-8385-409f-916e-da47dbf0a347 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:23.644856 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 161/325] 10.222.0.96 () {56 vars in 1201 bytes} [Fri Jan 28 01:44:23 2022] GET /identity/v3/groups/9ca862b44c3c402ba6d399f549aee851 => generated 226 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:23.645514 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bc3a3-9ecf-4ca7-9e9a-2683330e4424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:23.646370 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bc3a3-9ecf-4ca7-9e9a-2683330e4424 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:23.646645 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bc3a3-9ecf-4ca7-9e9a-2683330e4424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:23.646914 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bc3a3-9ecf-4ca7-9e9a-2683330e4424 admin admin] PATH_INFO: `/v3/groups/9ca862b44c3c402ba6d399f549aee851` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:23.653697 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bc3a3-9ecf-4ca7-9e9a-2683330e4424 admin admin] RBAC: Authorizing `identity:get_group(group_id=9ca862b44c3c402ba6d399f549aee851)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:23.655631 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bc3a3-9ecf-4ca7-9e9a-2683330e4424 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:23.657363 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 165/326] 10.222.0.96 () {56 vars in 1201 bytes} [Fri Jan 28 01:44:23 2022] GET /identity/v3/groups/9ca862b44c3c402ba6d399f549aee851 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:23.659890 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048bbcd-8385-409f-916e-da47dbf0a347 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:23.665634 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bc3a3-9ecf-4ca7-9e9a-2683330e4424 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:23.678954 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bc3a3-9ecf-4ca7-9e9a-2683330e4424 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:23.680980 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048bbcd-8385-409f-916e-da47dbf0a347 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:23.688194 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97a65e-fa29-46b2-9a06-9e8585a0805d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:23.688878 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97a65e-fa29-46b2-9a06-9e8585a0805d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:23.689159 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97a65e-fa29-46b2-9a06-9e8585a0805d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:23.689408 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97a65e-fa29-46b2-9a06-9e8585a0805d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:23.690244 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97a65e-fa29-46b2-9a06-9e8585a0805d admin admin] RBAC: Adding query filter params (group.id=9ca862b44c3c402ba6d399f549aee851, role.id=fb4c25e67ee749378e33ec4843ae1dbf, scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:23.690553 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97a65e-fa29-46b2-9a06-9e8585a0805d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:23.692383 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97a65e-fa29-46b2-9a06-9e8585a0805d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:23.694885 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ee2e7-9aa5-4e21-8096-f822391b2e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:23.696173 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ee2e7-9aa5-4e21-8096-f822391b2e12 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:23.696602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ee2e7-9aa5-4e21-8096-f822391b2e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:23.697203 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ee2e7-9aa5-4e21-8096-f822391b2e12 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:23.698041 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ee2e7-9aa5-4e21-8096-f822391b2e12 admin admin] RBAC: Adding query filter params (group.id=9ca862b44c3c402ba6d399f549aee851, role.id=0a6e12c9b8034527a8aa1988febe09ac, scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:23.698351 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ee2e7-9aa5-4e21-8096-f822391b2e12 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:23.700327 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ee2e7-9aa5-4e21-8096-f822391b2e12 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:23.713028 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 162/327] 10.222.0.96 () {56 vars in 1397 bytes} [Fri Jan 28 01:44:23 2022] GET /identity/v3/role_assignments?group.id=9ca862b44c3c402ba6d399f549aee851&scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3&role.id=fb4c25e67ee749378e33ec4843ae1dbf => generated 611 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:23.715118 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 166/328] 10.222.0.96 () {56 vars in 1397 bytes} [Fri Jan 28 01:44:23 2022] GET /identity/v3/role_assignments?group.id=9ca862b44c3c402ba6d399f549aee851&scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3&role.id=0a6e12c9b8034527a8aa1988febe09ac => generated 611 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:24.052218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83499829-9a25-4ece-a252-c1e8124c36b6 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:24.052624 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83499829-9a25-4ece-a252-c1e8124c36b6 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:24.052848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83499829-9a25-4ece-a252-c1e8124c36b6 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:24.055543 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 163/329] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:24.067005 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a8eed-ddc6-4505-ac6a-2509d6fe5dcc None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:24.067330 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a8eed-ddc6-4505-ac6a-2509d6fe5dcc None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:24.067583 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a8eed-ddc6-4505-ac6a-2509d6fe5dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:24.089979 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-ee7a8eed-ddc6-4505-ac6a-2509d6fe5dcc None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:24.091196 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-ee7a8eed-ddc6-4505-ac6a-2509d6fe5dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:24.099378 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 167/330] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:24 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:24.124673 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83499829-9a25-4ece-a252-c1e8124c36b6 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:24.143905 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83499829-9a25-4ece-a252-c1e8124c36b6 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:24.149811 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3893c6-cac6-4732-bbf7-300865415e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:24.150933 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3893c6-cac6-4732-bbf7-300865415e45 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:24.151655 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3893c6-cac6-4732-bbf7-300865415e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:24.152203 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3893c6-cac6-4732-bbf7-300865415e45 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:24.165853 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3893c6-cac6-4732-bbf7-300865415e45 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:24.173221 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-df3893c6-cac6-4732-bbf7-300865415e45 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:44:24.175071 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 164/331] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:24.181516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a8eed-ddc6-4505-ac6a-2509d6fe5dcc None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:24.192829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a8eed-ddc6-4505-ac6a-2509d6fe5dcc None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:24.197749 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1983e0f-bde5-46e4-9872-9a50ac85cdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:24.199063 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1983e0f-bde5-46e4-9872-9a50ac85cdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:24.199493 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1983e0f-bde5-46e4-9872-9a50ac85cdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:24.199920 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1983e0f-bde5-46e4-9872-9a50ac85cdf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:24.200876 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1983e0f-bde5-46e4-9872-9a50ac85cdf3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:24.201354 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1983e0f-bde5-46e4-9872-9a50ac85cdf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:24.203110 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1983e0f-bde5-46e4-9872-9a50ac85cdf3 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:24.219713 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 168/332] 10.222.0.96 () {56 vars in 1122 bytes} [Fri Jan 28 01:44:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:24.226135 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3893c6-cac6-4732-bbf7-300865415e45 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:24.238886 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3893c6-cac6-4732-bbf7-300865415e45 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:24.245236 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526ef27-71d1-41d3-87b0-5a1175e84c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:24.245893 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526ef27-71d1-41d3-87b0-5a1175e84c63 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:24.246173 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526ef27-71d1-41d3-87b0-5a1175e84c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:24.246439 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526ef27-71d1-41d3-87b0-5a1175e84c63 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:24.258038 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526ef27-71d1-41d3-87b0-5a1175e84c63 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:24.259054 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526ef27-71d1-41d3-87b0-5a1175e84c63 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:24.269441 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 165/333] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:24 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:24.276758 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1983e0f-bde5-46e4-9872-9a50ac85cdf3 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:24.288345 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1983e0f-bde5-46e4-9872-9a50ac85cdf3 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:24.293535 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8830a64-3410-4fbc-a59b-e0062eea7c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:24.294400 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8830a64-3410-4fbc-a59b-e0062eea7c2a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:24.294676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8830a64-3410-4fbc-a59b-e0062eea7c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:24.294942 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8830a64-3410-4fbc-a59b-e0062eea7c2a admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:24.297942 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8830a64-3410-4fbc-a59b-e0062eea7c2a admin admin] RBAC: Authorizing `identity:get_project(project_id=65c96e1c663a4b7db4930772be89df09)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:24.300051 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8830a64-3410-4fbc-a59b-e0062eea7c2a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:24.302176 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 169/334] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:24 2022] GET /identity/v3/projects/65c96e1c663a4b7db4930772be89df09 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:24.308687 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526ef27-71d1-41d3-87b0-5a1175e84c63 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:24.319000 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526ef27-71d1-41d3-87b0-5a1175e84c63 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:24.325635 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d87b59-8f7c-4730-9395-6f67ca617290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:24.326492 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d87b59-8f7c-4730-9395-6f67ca617290 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:24.326767 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d87b59-8f7c-4730-9395-6f67ca617290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:24.327033 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d87b59-8f7c-4730-9395-6f67ca617290 admin admin] PATH_INFO: `/v3/groups/9ca862b44c3c402ba6d399f549aee851` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:24.328237 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d87b59-8f7c-4730-9395-6f67ca617290 admin admin] RBAC: Authorizing `identity:get_group(group_id=9ca862b44c3c402ba6d399f549aee851)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:24.330175 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d87b59-8f7c-4730-9395-6f67ca617290 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:24.331811 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 166/335] 10.222.0.96 () {56 vars in 1201 bytes} [Fri Jan 28 01:44:24 2022] GET /identity/v3/groups/9ca862b44c3c402ba6d399f549aee851 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:24.339257 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8830a64-3410-4fbc-a59b-e0062eea7c2a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:24.349732 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8830a64-3410-4fbc-a59b-e0062eea7c2a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:24.355243 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ed3df-d775-4b37-96bb-ac79d9fa67b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:24.355916 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ed3df-d775-4b37-96bb-ac79d9fa67b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:24.356198 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ed3df-d775-4b37-96bb-ac79d9fa67b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:24.356471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ed3df-d775-4b37-96bb-ac79d9fa67b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:24.357340 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ed3df-d775-4b37-96bb-ac79d9fa67b4 admin admin] RBAC: Adding query filter params (group.id=9ca862b44c3c402ba6d399f549aee851, role.id=0a6e12c9b8034527a8aa1988febe09ac, scope.project.id=65c96e1c663a4b7db4930772be89df09) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:24.357648 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ed3df-d775-4b37-96bb-ac79d9fa67b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:24.359498 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ed3df-d775-4b37-96bb-ac79d9fa67b4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:24.366644 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 170/336] 10.222.0.96 () {56 vars in 1397 bytes} [Fri Jan 28 01:44:24 2022] GET /identity/v3/role_assignments?group.id=9ca862b44c3c402ba6d399f549aee851&scope.project.id=65c96e1c663a4b7db4930772be89df09&role.id=0a6e12c9b8034527a8aa1988febe09ac => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:24.539201 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1518e-35f6-4841-9fc0-d3be00b912fd None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:24.540064 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1518e-35f6-4841-9fc0-d3be00b912fd None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:24.540333 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1518e-35f6-4841-9fc0-d3be00b912fd None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:24.542414 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 167/337] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:24.551220 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea8815-92e1-4c64-8be6-93977100a4db None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:24.551567 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea8815-92e1-4c64-8be6-93977100a4db None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:24.551849 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea8815-92e1-4c64-8be6-93977100a4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:24.578196 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-64ea8815-92e1-4c64-8be6-93977100a4db None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:24.579315 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-64ea8815-92e1-4c64-8be6-93977100a4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:24.588177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 171/338] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:24 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:24.613472 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1518e-35f6-4841-9fc0-d3be00b912fd None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:24.626431 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1518e-35f6-4841-9fc0-d3be00b912fd None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:24.630774 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7992b-f19a-4704-b99c-9665527204d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:24.631595 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7992b-f19a-4704-b99c-9665527204d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:24.631872 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7992b-f19a-4704-b99c-9665527204d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:24.632140 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7992b-f19a-4704-b99c-9665527204d6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:24.645600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7992b-f19a-4704-b99c-9665527204d6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:24.653782 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-22c7992b-f19a-4704-b99c-9665527204d6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:44:24.660507 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 168/339] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:24.661645 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea8815-92e1-4c64-8be6-93977100a4db None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:24.672228 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea8815-92e1-4c64-8be6-93977100a4db None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:24.678545 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c223e-14b8-4b83-bd92-7f2cf19d9b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:24.679286 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c223e-14b8-4b83-bd92-7f2cf19d9b5a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:24.679566 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c223e-14b8-4b83-bd92-7f2cf19d9b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:24.679838 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c223e-14b8-4b83-bd92-7f2cf19d9b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:24.680637 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c223e-14b8-4b83-bd92-7f2cf19d9b5a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:24.681018 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c223e-14b8-4b83-bd92-7f2cf19d9b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:24.683270 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c223e-14b8-4b83-bd92-7f2cf19d9b5a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:24.693179 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 172/340] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:24.700530 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7992b-f19a-4704-b99c-9665527204d6 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:24.711066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7992b-f19a-4704-b99c-9665527204d6 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:24.718435 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da468dcd-ad9c-4f44-90ae-19df338559b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:24.719088 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da468dcd-ad9c-4f44-90ae-19df338559b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:24.720832 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da468dcd-ad9c-4f44-90ae-19df338559b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:24.720832 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da468dcd-ad9c-4f44-90ae-19df338559b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:24.731441 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da468dcd-ad9c-4f44-90ae-19df338559b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:24.733240 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da468dcd-ad9c-4f44-90ae-19df338559b6 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:24.743828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 169/341] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:24 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:24.749990 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c223e-14b8-4b83-bd92-7f2cf19d9b5a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:24.760760 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c223e-14b8-4b83-bd92-7f2cf19d9b5a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:24.769062 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439be1fd-f50e-4fc7-b593-fd1f19d67ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:24.769927 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439be1fd-f50e-4fc7-b593-fd1f19d67ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:24.770210 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439be1fd-f50e-4fc7-b593-fd1f19d67ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:24.770480 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439be1fd-f50e-4fc7-b593-fd1f19d67ed0 admin admin] PATH_INFO: `/v3/projects/7ed2a96df227403c8d2cdfcff229008d` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:24.771688 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439be1fd-f50e-4fc7-b593-fd1f19d67ed0 admin admin] RBAC: Authorizing `identity:get_project(project_id=7ed2a96df227403c8d2cdfcff229008d)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:24.773530 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439be1fd-f50e-4fc7-b593-fd1f19d67ed0 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:24.775634 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 173/342] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:24 2022] GET /identity/v3/projects/7ed2a96df227403c8d2cdfcff229008d => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:24.782123 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da468dcd-ad9c-4f44-90ae-19df338559b6 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:24.791833 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da468dcd-ad9c-4f44-90ae-19df338559b6 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:24.796396 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38f4eb-5c74-4fef-9e32-3f208eb421bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:24.797311 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38f4eb-5c74-4fef-9e32-3f208eb421bb admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:24.797585 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38f4eb-5c74-4fef-9e32-3f208eb421bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:24.797851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38f4eb-5c74-4fef-9e32-3f208eb421bb admin admin] PATH_INFO: `/v3/groups/bcc02110ba6a405b829d9cf3e8f55b6d` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:24.799040 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38f4eb-5c74-4fef-9e32-3f208eb421bb admin admin] RBAC: Authorizing `identity:get_group(group_id=bcc02110ba6a405b829d9cf3e8f55b6d)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:24.800939 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38f4eb-5c74-4fef-9e32-3f208eb421bb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:24.802741 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 170/343] 10.222.0.96 () {56 vars in 1201 bytes} [Fri Jan 28 01:44:24 2022] GET /identity/v3/groups/bcc02110ba6a405b829d9cf3e8f55b6d => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:24.809799 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439be1fd-f50e-4fc7-b593-fd1f19d67ed0 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:24.819747 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439be1fd-f50e-4fc7-b593-fd1f19d67ed0 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:24.825138 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736257d9-d6f5-4adf-b371-627c61381110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:24.825738 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736257d9-d6f5-4adf-b371-627c61381110 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:24.826017 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736257d9-d6f5-4adf-b371-627c61381110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:24.826287 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736257d9-d6f5-4adf-b371-627c61381110 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:24.827106 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736257d9-d6f5-4adf-b371-627c61381110 admin admin] RBAC: Adding query filter params (group.id=bcc02110ba6a405b829d9cf3e8f55b6d, role.id=253c0a1dc8d6421298a7987caaa55676, scope.project.id=7ed2a96df227403c8d2cdfcff229008d) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:24.827414 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736257d9-d6f5-4adf-b371-627c61381110 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:24.829317 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736257d9-d6f5-4adf-b371-627c61381110 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:24.835507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 174/344] 10.222.0.96 () {56 vars in 1397 bytes} [Fri Jan 28 01:44:24 2022] GET /identity/v3/role_assignments?group.id=bcc02110ba6a405b829d9cf3e8f55b6d&scope.project.id=7ed2a96df227403c8d2cdfcff229008d&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:25.307662 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80769827-7d21-4a64-ae24-50757f6a40f8 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:25.308221 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80769827-7d21-4a64-ae24-50757f6a40f8 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:25.308221 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80769827-7d21-4a64-ae24-50757f6a40f8 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:25.310003 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 171/345] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:25.317859 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecf068-f9a4-43c3-9f80-0882788c34ae None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:25.318323 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecf068-f9a4-43c3-9f80-0882788c34ae None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:25.318433 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecf068-f9a4-43c3-9f80-0882788c34ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:25.336665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-48ecf068-f9a4-43c3-9f80-0882788c34ae None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:25.337878 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-48ecf068-f9a4-43c3-9f80-0882788c34ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:25.345294 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 175/346] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:25 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:25.371398 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80769827-7d21-4a64-ae24-50757f6a40f8 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:25.383356 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80769827-7d21-4a64-ae24-50757f6a40f8 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:25.387512 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daabc6-cc7d-4f66-8b5e-c90898d2a1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:25.388301 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daabc6-cc7d-4f66-8b5e-c90898d2a1ac admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:25.388579 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daabc6-cc7d-4f66-8b5e-c90898d2a1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:25.388881 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daabc6-cc7d-4f66-8b5e-c90898d2a1ac admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:25.399160 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87daabc6-cc7d-4f66-8b5e-c90898d2a1ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:25.406599 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-87daabc6-cc7d-4f66-8b5e-c90898d2a1ac admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:44:25.407772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 172/347] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:44:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:25.414786 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecf068-f9a4-43c3-9f80-0882788c34ae None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:25.423670 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecf068-f9a4-43c3-9f80-0882788c34ae None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:25.427981 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1f487-7872-47d0-bbe1-f21b015d6967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:25.428637 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1f487-7872-47d0-bbe1-f21b015d6967 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:25.428944 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1f487-7872-47d0-bbe1-f21b015d6967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:25.429214 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1f487-7872-47d0-bbe1-f21b015d6967 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:25.430543 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1f487-7872-47d0-bbe1-f21b015d6967 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:25.430848 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1f487-7872-47d0-bbe1-f21b015d6967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:25.432542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1f487-7872-47d0-bbe1-f21b015d6967 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:25.440910 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 176/348] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:25.447280 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daabc6-cc7d-4f66-8b5e-c90898d2a1ac admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:25.456973 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daabc6-cc7d-4f66-8b5e-c90898d2a1ac admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:25.461771 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ac684-3d90-4f8d-9863-9652c4d45312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:25.462403 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ac684-3d90-4f8d-9863-9652c4d45312 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:25.462683 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ac684-3d90-4f8d-9863-9652c4d45312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:25.462957 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ac684-3d90-4f8d-9863-9652c4d45312 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:25.472247 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ac684-3d90-4f8d-9863-9652c4d45312 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:25.474320 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ac684-3d90-4f8d-9863-9652c4d45312 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:25.484172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 173/349] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:25 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:25.490667 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1f487-7872-47d0-bbe1-f21b015d6967 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:25.500277 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1f487-7872-47d0-bbe1-f21b015d6967 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:25.504570 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3c8dd-cdd3-402d-9fe6-2c14c5178c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:25.505445 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3c8dd-cdd3-402d-9fe6-2c14c5178c9d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:25.505717 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3c8dd-cdd3-402d-9fe6-2c14c5178c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:25.505979 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3c8dd-cdd3-402d-9fe6-2c14c5178c9d admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:25.507125 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3c8dd-cdd3-402d-9fe6-2c14c5178c9d admin admin] RBAC: Authorizing `identity:get_project(project_id=65c96e1c663a4b7db4930772be89df09)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:25.509290 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3c8dd-cdd3-402d-9fe6-2c14c5178c9d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:25.510966 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 177/350] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:44:25 2022] GET /identity/v3/projects/65c96e1c663a4b7db4930772be89df09 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:25.517340 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ac684-3d90-4f8d-9863-9652c4d45312 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:25.527739 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ac684-3d90-4f8d-9863-9652c4d45312 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:25.532255 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917822bb-d303-493b-98c7-222612f3cc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:25.533147 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917822bb-d303-493b-98c7-222612f3cc70 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:25.533421 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917822bb-d303-493b-98c7-222612f3cc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:25.533689 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917822bb-d303-493b-98c7-222612f3cc70 admin admin] PATH_INFO: `/v3/groups/9ca862b44c3c402ba6d399f549aee851` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:25.534879 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917822bb-d303-493b-98c7-222612f3cc70 admin admin] RBAC: Authorizing `identity:get_group(group_id=9ca862b44c3c402ba6d399f549aee851)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:25.536746 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917822bb-d303-493b-98c7-222612f3cc70 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:25.538377 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 174/351] 10.222.0.96 () {56 vars in 1201 bytes} [Fri Jan 28 01:44:25 2022] GET /identity/v3/groups/9ca862b44c3c402ba6d399f549aee851 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:25.545443 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3c8dd-cdd3-402d-9fe6-2c14c5178c9d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:25.555053 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3c8dd-cdd3-402d-9fe6-2c14c5178c9d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:25.559494 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9901b8-a305-43ee-a9d4-f4aac5308ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:25.560069 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9901b8-a305-43ee-a9d4-f4aac5308ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:25.560341 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9901b8-a305-43ee-a9d4-f4aac5308ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:25.560608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9901b8-a305-43ee-a9d4-f4aac5308ca3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:25.561455 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9901b8-a305-43ee-a9d4-f4aac5308ca3 admin admin] RBAC: Adding query filter params (group.id=9ca862b44c3c402ba6d399f549aee851, role.id=fb4c25e67ee749378e33ec4843ae1dbf, scope.project.id=65c96e1c663a4b7db4930772be89df09) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:25.561760 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9901b8-a305-43ee-a9d4-f4aac5308ca3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:25.563585 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9901b8-a305-43ee-a9d4-f4aac5308ca3 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:25.569615 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 178/352] 10.222.0.96 () {56 vars in 1397 bytes} [Fri Jan 28 01:44:25 2022] GET /identity/v3/role_assignments?group.id=9ca862b44c3c402ba6d399f549aee851&scope.project.id=65c96e1c663a4b7db4930772be89df09&role.id=fb4c25e67ee749378e33ec4843ae1dbf => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:28.689936 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb378c-11f0-4fb8-8e71-bb29f46453cd None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:28.690474 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb378c-11f0-4fb8-8e71-bb29f46453cd None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:28.690474 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb378c-11f0-4fb8-8e71-bb29f46453cd None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:28.692599 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 175/353] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:28.701317 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85efd69-2fae-49ff-ac00-1d12c4b5e31c None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:28.701809 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85efd69-2fae-49ff-ac00-1d12c4b5e31c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:28.701909 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85efd69-2fae-49ff-ac00-1d12c4b5e31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:28.726584 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-c85efd69-2fae-49ff-ac00-1d12c4b5e31c None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:28.728410 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c85efd69-2fae-49ff-ac00-1d12c4b5e31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:28.735115 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d9a06-b228-45bb-adec-2ae4c193cec8 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:28.735394 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d9a06-b228-45bb-adec-2ae4c193cec8 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:28.735686 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d9a06-b228-45bb-adec-2ae4c193cec8 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:28.737980 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 176/354] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:44:28.741805 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 179/355] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:28 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:28.745585 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87814fa4-327c-4366-87e7-c8824b4c35ab None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:28.745868 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87814fa4-327c-4366-87e7-c8824b4c35ab None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:28.746141 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87814fa4-327c-4366-87e7-c8824b4c35ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:28.774553 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-87814fa4-327c-4366-87e7-c8824b4c35ab None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:28.775832 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-87814fa4-327c-4366-87e7-c8824b4c35ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:28.787367 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 177/356] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:28 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:28.807791 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85efd69-2fae-49ff-ac00-1d12c4b5e31c None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:28.817427 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85efd69-2fae-49ff-ac00-1d12c4b5e31c None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:28.824839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87814fa4-327c-4366-87e7-c8824b4c35ab None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:28.828944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87814fa4-327c-4366-87e7-c8824b4c35ab None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:28.829587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be423ef1-a836-47e1-bf7f-e99500d32b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:28.830562 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be423ef1-a836-47e1-bf7f-e99500d32b19 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:28.831005 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be423ef1-a836-47e1-bf7f-e99500d32b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:28.831432 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be423ef1-a836-47e1-bf7f-e99500d32b19 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:28.839675 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de3878-de54-4bce-adc9-21aa9336cee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:28.840146 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de3878-de54-4bce-adc9-21aa9336cee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:28.840423 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de3878-de54-4bce-adc9-21aa9336cee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:28.840691 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de3878-de54-4bce-adc9-21aa9336cee9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:28.848549 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be423ef1-a836-47e1-bf7f-e99500d32b19 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:28.850797 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be423ef1-a836-47e1-bf7f-e99500d32b19 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:28.856824 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de3878-de54-4bce-adc9-21aa9336cee9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:28.857821 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de3878-de54-4bce-adc9-21aa9336cee9 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:28.877573 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-be423ef1-a836-47e1-bf7f-e99500d32b19 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:28.879125 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 180/357] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:28.886365 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-82de3878-de54-4bce-adc9-21aa9336cee9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:28.887874 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 178/358] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:28.894054 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be423ef1-a836-47e1-bf7f-e99500d32b19 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:28.895264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de3878-de54-4bce-adc9-21aa9336cee9 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:28.910678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be423ef1-a836-47e1-bf7f-e99500d32b19 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:28.917870 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de3878-de54-4bce-adc9-21aa9336cee9 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:28.921444 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584fb9d-0818-4f79-b979-f3e68913f22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:28.922371 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584fb9d-0818-4f79-b979-f3e68913f22d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:28.922880 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584fb9d-0818-4f79-b979-f3e68913f22d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:28.923346 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584fb9d-0818-4f79-b979-f3e68913f22d admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:28.924286 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584fb9d-0818-4f79-b979-f3e68913f22d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:28.924788 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584fb9d-0818-4f79-b979-f3e68913f22d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:28.926608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584fb9d-0818-4f79-b979-f3e68913f22d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:28.938792 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe1a84-478f-4edf-9372-66e1aa0d1b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:28.939817 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe1a84-478f-4edf-9372-66e1aa0d1b39 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:28.940316 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe1a84-478f-4edf-9372-66e1aa0d1b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:28.940787 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe1a84-478f-4edf-9372-66e1aa0d1b39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:28.941736 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe1a84-478f-4edf-9372-66e1aa0d1b39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:28.942264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe1a84-478f-4edf-9372-66e1aa0d1b39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:28.943484 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING py.warnings [None req-28fe1a84-478f-4edf-9372-66e1aa0d1b39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:28.943484 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: warnings.warn(msg) Jan 28 01:44:28.943484 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: Jan 28 01:44:28.944694 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe1a84-478f-4edf-9372-66e1aa0d1b39 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:28.954850 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 181/359] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:28.963936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584fb9d-0818-4f79-b979-f3e68913f22d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:28.975638 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584fb9d-0818-4f79-b979-f3e68913f22d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:28.980791 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 179/360] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:28.987040 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe1a84-478f-4edf-9372-66e1aa0d1b39 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:28.989235 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f5c48-af79-4cd4-979c-2c3a05844d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:28.989921 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f5c48-af79-4cd4-979c-2c3a05844d68 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:28.990203 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f5c48-af79-4cd4-979c-2c3a05844d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:28.990475 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f5c48-af79-4cd4-979c-2c3a05844d68 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:28.991188 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f5c48-af79-4cd4-979c-2c3a05844d68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:28.993961 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f5c48-af79-4cd4-979c-2c3a05844d68 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:29.006866 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe1a84-478f-4edf-9372-66e1aa0d1b39 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:29.019430 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26914ba-c7b0-4e1e-8715-1178c26e4730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:29.020710 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26914ba-c7b0-4e1e-8715-1178c26e4730 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:29.021233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26914ba-c7b0-4e1e-8715-1178c26e4730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:29.021723 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26914ba-c7b0-4e1e-8715-1178c26e4730 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:29.022670 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26914ba-c7b0-4e1e-8715-1178c26e4730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:29.027448 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26914ba-c7b0-4e1e-8715-1178c26e4730 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:29.039687 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 182/361] 10.222.0.96 () {60 vars in 1153 bytes} [Fri Jan 28 01:44:28 2022] POST /identity/v3/users => generated 248 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:44:29.064981 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 180/362] 10.222.0.96 () {60 vars in 1153 bytes} [Fri Jan 28 01:44:28 2022] POST /identity/v3/users => generated 246 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:44:29.336969 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae4892-7048-4e47-aea5-42b400bc3a0a None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:29.337327 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae4892-7048-4e47-aea5-42b400bc3a0a None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:29.337433 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae4892-7048-4e47-aea5-42b400bc3a0a None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:29.339251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 183/363] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:29.347404 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f4377-e9a2-4d4a-9ce3-706e2edf26e4 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:29.347685 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f4377-e9a2-4d4a-9ce3-706e2edf26e4 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:29.347966 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f4377-e9a2-4d4a-9ce3-706e2edf26e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:29.370853 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-909f4377-e9a2-4d4a-9ce3-706e2edf26e4 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:29.372068 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-909f4377-e9a2-4d4a-9ce3-706e2edf26e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:29.383120 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 181/364] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:29 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:29.410433 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae4892-7048-4e47-aea5-42b400bc3a0a None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:29.426751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae4892-7048-4e47-aea5-42b400bc3a0a None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:29.434110 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b846f85-832a-4c57-82e6-de413fe7c697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:29.435286 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b846f85-832a-4c57-82e6-de413fe7c697 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:29.435798 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b846f85-832a-4c57-82e6-de413fe7c697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:29.436276 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b846f85-832a-4c57-82e6-de413fe7c697 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:29.451929 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b846f85-832a-4c57-82e6-de413fe7c697 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:29.453815 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b846f85-832a-4c57-82e6-de413fe7c697 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:29.475300 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-6b846f85-832a-4c57-82e6-de413fe7c697 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:29.477697 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 184/365] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:29.483974 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f4377-e9a2-4d4a-9ce3-706e2edf26e4 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:29.499501 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f4377-e9a2-4d4a-9ce3-706e2edf26e4 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:29.511776 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2600861-2dd9-42ed-8e46-487694b73c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:29.512834 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2600861-2dd9-42ed-8e46-487694b73c72 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:29.513314 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2600861-2dd9-42ed-8e46-487694b73c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:29.513798 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2600861-2dd9-42ed-8e46-487694b73c72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:29.514750 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2600861-2dd9-42ed-8e46-487694b73c72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:29.515251 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2600861-2dd9-42ed-8e46-487694b73c72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:29.517194 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2600861-2dd9-42ed-8e46-487694b73c72 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:29.517436 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a2479-1257-48b9-b75c-8f79ad168612 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:29.517684 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a2479-1257-48b9-b75c-8f79ad168612 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:29.517961 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a2479-1257-48b9-b75c-8f79ad168612 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:29.520163 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 185/366] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:29.540703 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 182/367] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:29.543563 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781993b-12e0-45b4-85b5-208e18956c94 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:29.550085 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2600861-2dd9-42ed-8e46-487694b73c72 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:29.551102 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781993b-12e0-45b4-85b5-208e18956c94 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:29.551970 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781993b-12e0-45b4-85b5-208e18956c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:29.571906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2600861-2dd9-42ed-8e46-487694b73c72 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:29.587159 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f692b-ebcf-41b8-8f12-2567599d5497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:29.588188 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f692b-ebcf-41b8-8f12-2567599d5497 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:29.588668 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f692b-ebcf-41b8-8f12-2567599d5497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:29.589160 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f692b-ebcf-41b8-8f12-2567599d5497 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:29.590115 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f692b-ebcf-41b8-8f12-2567599d5497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:29.592225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f692b-ebcf-41b8-8f12-2567599d5497 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:29.593448 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-3781993b-12e0-45b4-85b5-208e18956c94 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:29.596829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-3781993b-12e0-45b4-85b5-208e18956c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:29.616554 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 186/368] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:29 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:29.628555 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 183/369] 10.222.0.96 () {60 vars in 1153 bytes} [Fri Jan 28 01:44:29 2022] POST /identity/v3/users => generated 248 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:44:29.654847 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781993b-12e0-45b4-85b5-208e18956c94 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:29.667686 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781993b-12e0-45b4-85b5-208e18956c94 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:29.676102 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64375d24-f268-44bb-8347-246dad35ebbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:29.677534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64375d24-f268-44bb-8347-246dad35ebbf admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:29.678136 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64375d24-f268-44bb-8347-246dad35ebbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:29.678613 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64375d24-f268-44bb-8347-246dad35ebbf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:29.695335 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64375d24-f268-44bb-8347-246dad35ebbf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:29.698437 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64375d24-f268-44bb-8347-246dad35ebbf admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:29.722421 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-64375d24-f268-44bb-8347-246dad35ebbf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:29.724960 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 187/370] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:29.732745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f692b-ebcf-41b8-8f12-2567599d5497 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:29.744771 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f692b-ebcf-41b8-8f12-2567599d5497 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:29.754854 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3cdda-0174-408b-aa2b-7b0ccd1d2e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:29.755962 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3cdda-0174-408b-aa2b-7b0ccd1d2e0f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:29.756424 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3cdda-0174-408b-aa2b-7b0ccd1d2e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:29.756908 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3cdda-0174-408b-aa2b-7b0ccd1d2e0f admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:29.757978 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3cdda-0174-408b-aa2b-7b0ccd1d2e0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:29.758462 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3cdda-0174-408b-aa2b-7b0ccd1d2e0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:29.760290 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3cdda-0174-408b-aa2b-7b0ccd1d2e0f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:29.790433 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 184/371] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:29.796594 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64375d24-f268-44bb-8347-246dad35ebbf admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:29.811137 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64375d24-f268-44bb-8347-246dad35ebbf admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:29.819278 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27bace-4de4-4dd3-97ce-68c57a6a5c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:29.820280 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27bace-4de4-4dd3-97ce-68c57a6a5c03 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:29.820865 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27bace-4de4-4dd3-97ce-68c57a6a5c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:29.821364 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27bace-4de4-4dd3-97ce-68c57a6a5c03 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:29.822564 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27bace-4de4-4dd3-97ce-68c57a6a5c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:29.824777 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27bace-4de4-4dd3-97ce-68c57a6a5c03 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:29.863917 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 188/372] 10.222.0.96 () {60 vars in 1153 bytes} [Fri Jan 28 01:44:29 2022] POST /identity/v3/users => generated 249 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:44:30.309534 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbad06d-af48-422c-97e8-a4778f942a2b None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:30.309811 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbad06d-af48-422c-97e8-a4778f942a2b None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:30.310089 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbad06d-af48-422c-97e8-a4778f942a2b None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:30.312203 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 185/373] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:30.319587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1b728-6e38-4685-bf18-d5166a74880d None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:30.319873 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1b728-6e38-4685-bf18-d5166a74880d None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:30.320152 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1b728-6e38-4685-bf18-d5166a74880d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:30.346444 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-bfb1b728-6e38-4685-bf18-d5166a74880d None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:30.347650 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-bfb1b728-6e38-4685-bf18-d5166a74880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:30.358591 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 189/374] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:30 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:30.394896 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbad06d-af48-422c-97e8-a4778f942a2b None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:30.410848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbad06d-af48-422c-97e8-a4778f942a2b None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:30.418356 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35dc28-6668-44a3-9621-afac817e6a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:30.419035 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35dc28-6668-44a3-9621-afac817e6a59 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:30.419315 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35dc28-6668-44a3-9621-afac817e6a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:30.419585 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35dc28-6668-44a3-9621-afac817e6a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:30.420366 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35dc28-6668-44a3-9621-afac817e6a59 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:30.421984 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35dc28-6668-44a3-9621-afac817e6a59 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:30.438257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.sql.core [None req-cd35dc28-6668-44a3-9621-afac817e6a59 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jan 28 01:44:30.438257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jan 28 01:44:30.438257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [parameters: {'id': '02c9ae79dd284bf3a875fd42b648df15', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jan 28 01:44:30.438257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79481) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 28 01:44:30.452841 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-cd35dc28-6668-44a3-9621-afac817e6a59 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jan 28 01:44:30.458490 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 186/375] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:44:30 2022] POST /identity/v3/roles => generated 144 bytes in 64 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:30.465430 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1b728-6e38-4685-bf18-d5166a74880d None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:30.477840 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1b728-6e38-4685-bf18-d5166a74880d None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:30.489328 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d535d-1810-4e6c-8f3a-f9d35623b10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:30.490141 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d535d-1810-4e6c-8f3a-f9d35623b10e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:30.490422 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d535d-1810-4e6c-8f3a-f9d35623b10e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:30.490692 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d535d-1810-4e6c-8f3a-f9d35623b10e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:30.506194 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d535d-1810-4e6c-8f3a-f9d35623b10e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:30.513922 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-8f2d535d-1810-4e6c-8f3a-f9d35623b10e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:44:30.515164 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 190/376] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:44:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:30.521731 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35dc28-6668-44a3-9621-afac817e6a59 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:30.538356 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35dc28-6668-44a3-9621-afac817e6a59 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:30.544125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c35d3-b6d3-431f-9422-50aefab80ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:30.547370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c35d3-b6d3-431f-9422-50aefab80ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:30.547370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c35d3-b6d3-431f-9422-50aefab80ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:30.547370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c35d3-b6d3-431f-9422-50aefab80ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:30.547370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c35d3-b6d3-431f-9422-50aefab80ec4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:30.547370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c35d3-b6d3-431f-9422-50aefab80ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:30.549295 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c35d3-b6d3-431f-9422-50aefab80ec4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:30.570142 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 187/377] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:31.771058 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc71e01-d3b9-4397-a22f-9ebdd225ae9b None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:31.771563 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc71e01-d3b9-4397-a22f-9ebdd225ae9b None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:31.771636 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc71e01-d3b9-4397-a22f-9ebdd225ae9b None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:31.774213 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 191/378] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:31.782375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f3dc2-45aa-49f0-a1af-905de92f4fa6 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:31.782852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f3dc2-45aa-49f0-a1af-905de92f4fa6 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:31.782926 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f3dc2-45aa-49f0-a1af-905de92f4fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:31.802178 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-247f3dc2-45aa-49f0-a1af-905de92f4fa6 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:31.803287 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-247f3dc2-45aa-49f0-a1af-905de92f4fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:31.815327 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 188/379] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:31 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:31.840275 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc71e01-d3b9-4397-a22f-9ebdd225ae9b None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:31.859466 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc71e01-d3b9-4397-a22f-9ebdd225ae9b None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:31.867187 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2ab56-23ed-4aa9-ad51-8e6d11981495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:31.868045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2ab56-23ed-4aa9-ad51-8e6d11981495 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:31.868323 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2ab56-23ed-4aa9-ad51-8e6d11981495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:31.868591 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2ab56-23ed-4aa9-ad51-8e6d11981495 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:31.882539 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2ab56-23ed-4aa9-ad51-8e6d11981495 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:31.894604 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-95a2ab56-23ed-4aa9-ad51-8e6d11981495 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:44:31.896038 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 192/380] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:31.903779 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f3dc2-45aa-49f0-a1af-905de92f4fa6 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:31.918169 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f3dc2-45aa-49f0-a1af-905de92f4fa6 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:31.930267 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b927fe-f87e-4eea-ad48-98581ab37aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:31.931142 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b927fe-f87e-4eea-ad48-98581ab37aeb admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:31.931428 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b927fe-f87e-4eea-ad48-98581ab37aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:31.931701 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b927fe-f87e-4eea-ad48-98581ab37aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:31.932452 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b927fe-f87e-4eea-ad48-98581ab37aeb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:31.932753 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b927fe-f87e-4eea-ad48-98581ab37aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:31.934360 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b927fe-f87e-4eea-ad48-98581ab37aeb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:31.948168 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 189/381] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:44:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:31.954242 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2ab56-23ed-4aa9-ad51-8e6d11981495 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:31.962385 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab083d53-7a73-46fe-a44a-a5ee80cfaaef None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:31.962841 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab083d53-7a73-46fe-a44a-a5ee80cfaaef None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:31.963130 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab083d53-7a73-46fe-a44a-a5ee80cfaaef None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:31.965228 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 190/382] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:31.965418 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2ab56-23ed-4aa9-ad51-8e6d11981495 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:31.972497 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed210ce-06fd-4a2c-a7dc-7cacb19c7e57 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:31.972893 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed210ce-06fd-4a2c-a7dc-7cacb19c7e57 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:31.973242 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed210ce-06fd-4a2c-a7dc-7cacb19c7e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:31.980349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30780902-72b8-4b0c-8099-cc7044183528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:31.982020 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30780902-72b8-4b0c-8099-cc7044183528 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:31.985094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30780902-72b8-4b0c-8099-cc7044183528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:31.985449 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30780902-72b8-4b0c-8099-cc7044183528 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.001413 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-1ed210ce-06fd-4a2c-a7dc-7cacb19c7e57 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:32.003599 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1ed210ce-06fd-4a2c-a7dc-7cacb19c7e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:32.005529 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30780902-72b8-4b0c-8099-cc7044183528 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.009185 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30780902-72b8-4b0c-8099-cc7044183528 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.022987 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 191/383] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:31 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:32.039387 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-30780902-72b8-4b0c-8099-cc7044183528 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:32.040915 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 193/384] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:32.045501 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed210ce-06fd-4a2c-a7dc-7cacb19c7e57 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.053080 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30780902-72b8-4b0c-8099-cc7044183528 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.055766 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed210ce-06fd-4a2c-a7dc-7cacb19c7e57 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.065786 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5987c-b330-4c56-9213-12a366905768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.066692 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5987c-b330-4c56-9213-12a366905768 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.067215 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5987c-b330-4c56-9213-12a366905768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.067561 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5987c-b330-4c56-9213-12a366905768 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.075395 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30780902-72b8-4b0c-8099-cc7044183528 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.079278 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6962337-244d-449e-8afe-e79521727529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.080172 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6962337-244d-449e-8afe-e79521727529 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.080769 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6962337-244d-449e-8afe-e79521727529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.081237 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6962337-244d-449e-8afe-e79521727529 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.082147 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6962337-244d-449e-8afe-e79521727529 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:32.082629 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6962337-244d-449e-8afe-e79521727529 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.084439 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6962337-244d-449e-8afe-e79521727529 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.092835 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5987c-b330-4c56-9213-12a366905768 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:32.102142 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-5da5987c-b330-4c56-9213-12a366905768 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:44:32.104068 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 192/385] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:32.105434 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 194/386] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:32.111055 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6962337-244d-449e-8afe-e79521727529 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.111223 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5987c-b330-4c56-9213-12a366905768 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.126491 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6962337-244d-449e-8afe-e79521727529 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.133924 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5987c-b330-4c56-9213-12a366905768 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.137063 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d48f67-f9ad-4650-8e28-b480e2ce398a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.137977 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d48f67-f9ad-4650-8e28-b480e2ce398a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.138264 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d48f67-f9ad-4650-8e28-b480e2ce398a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.138541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d48f67-f9ad-4650-8e28-b480e2ce398a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.143066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d36f6-0df8-4ac5-9e7a-17119f816381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.144053 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d36f6-0df8-4ac5-9e7a-17119f816381 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.144597 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d36f6-0df8-4ac5-9e7a-17119f816381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.146190 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d36f6-0df8-4ac5-9e7a-17119f816381 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.147203 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d36f6-0df8-4ac5-9e7a-17119f816381 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:32.149387 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d36f6-0df8-4ac5-9e7a-17119f816381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.155434 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d36f6-0df8-4ac5-9e7a-17119f816381 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.159126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d48f67-f9ad-4650-8e28-b480e2ce398a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.161541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d48f67-f9ad-4650-8e28-b480e2ce398a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.177541 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 193/387] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:32.182820 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d36f6-0df8-4ac5-9e7a-17119f816381 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.187799 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-b4d48f67-f9ad-4650-8e28-b480e2ce398a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:44:32.189373 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 195/388] 10.222.0.96 () {56 vars in 1114 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:32.196911 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d48f67-f9ad-4650-8e28-b480e2ce398a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.198733 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d36f6-0df8-4ac5-9e7a-17119f816381 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.212231 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d48f67-f9ad-4650-8e28-b480e2ce398a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.214346 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cac0a-40c8-49ab-801d-9b1a91c9cdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.215743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cac0a-40c8-49ab-801d-9b1a91c9cdcb admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.216377 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cac0a-40c8-49ab-801d-9b1a91c9cdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.217737 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cac0a-40c8-49ab-801d-9b1a91c9cdcb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.222784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe117aa-e13e-4b6f-afc2-6c40814e3fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.225041 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe117aa-e13e-4b6f-afc2-6c40814e3fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.226570 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe117aa-e13e-4b6f-afc2-6c40814e3fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.227137 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe117aa-e13e-4b6f-afc2-6c40814e3fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.230174 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe117aa-e13e-4b6f-afc2-6c40814e3fa9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:32.230694 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe117aa-e13e-4b6f-afc2-6c40814e3fa9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.231994 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-fbe117aa-e13e-4b6f-afc2-6c40814e3fa9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:32.231994 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:44:32.231994 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:44:32.234802 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe117aa-e13e-4b6f-afc2-6c40814e3fa9 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.243351 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cac0a-40c8-49ab-801d-9b1a91c9cdcb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.247221 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cac0a-40c8-49ab-801d-9b1a91c9cdcb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.295199 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-f53cac0a-40c8-49ab-801d-9b1a91c9cdcb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:32.297762 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 194/389] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:32.314486 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cac0a-40c8-49ab-801d-9b1a91c9cdcb admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.322852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 196/390] 10.222.0.96 () {56 vars in 1154 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:32.328472 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cac0a-40c8-49ab-801d-9b1a91c9cdcb admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.329713 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe117aa-e13e-4b6f-afc2-6c40814e3fa9 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.342335 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe117aa-e13e-4b6f-afc2-6c40814e3fa9 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.345309 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ebc2c-2524-4535-b752-3167214537ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.346221 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ebc2c-2524-4535-b752-3167214537ea admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.346694 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ebc2c-2524-4535-b752-3167214537ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.347154 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ebc2c-2524-4535-b752-3167214537ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.348090 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ebc2c-2524-4535-b752-3167214537ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:32.349400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ebc2c-2524-4535-b752-3167214537ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.352634 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ebc2c-2524-4535-b752-3167214537ea admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.358345 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e232a2-70a9-4f06-bb23-21b6df43a386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.359291 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e232a2-70a9-4f06-bb23-21b6df43a386 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.359785 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e232a2-70a9-4f06-bb23-21b6df43a386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.360243 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e232a2-70a9-4f06-bb23-21b6df43a386 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.378571 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 195/391] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:32.385782 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e232a2-70a9-4f06-bb23-21b6df43a386 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.386319 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ebc2c-2524-4535-b752-3167214537ea admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.387834 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e232a2-70a9-4f06-bb23-21b6df43a386 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.396841 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ebc2c-2524-4535-b752-3167214537ea admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.402083 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c97bc6-d258-4b1e-a8de-4fa31265a200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.403170 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c97bc6-d258-4b1e-a8de-4fa31265a200 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.403277 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 197/392] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:32.403767 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c97bc6-d258-4b1e-a8de-4fa31265a200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.404234 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c97bc6-d258-4b1e-a8de-4fa31265a200 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.409415 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e232a2-70a9-4f06-bb23-21b6df43a386 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.413393 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c97bc6-d258-4b1e-a8de-4fa31265a200 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.415716 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c97bc6-d258-4b1e-a8de-4fa31265a200 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.424576 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e232a2-70a9-4f06-bb23-21b6df43a386 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.432420 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-32c97bc6-d258-4b1e-a8de-4fa31265a200 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 28 01:44:32.434638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 196/393] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:32.435419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ba85f-ded0-44a4-9708-3c8a9961d6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.436296 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ba85f-ded0-44a4-9708-3c8a9961d6ba admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.436581 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ba85f-ded0-44a4-9708-3c8a9961d6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.442620 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ba85f-ded0-44a4-9708-3c8a9961d6ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.443719 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c97bc6-d258-4b1e-a8de-4fa31265a200 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.463080 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c97bc6-d258-4b1e-a8de-4fa31265a200 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.464500 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ba85f-ded0-44a4-9708-3c8a9961d6ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.466965 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ba85f-ded0-44a4-9708-3c8a9961d6ba admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.475757 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb0e54-de03-4ff7-9d60-5bff26b798b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.480371 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb0e54-de03-4ff7-9d60-5bff26b798b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.480961 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb0e54-de03-4ff7-9d60-5bff26b798b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.481401 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb0e54-de03-4ff7-9d60-5bff26b798b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.482527 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb0e54-de03-4ff7-9d60-5bff26b798b9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:32.483173 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb0e54-de03-4ff7-9d60-5bff26b798b9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.485547 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING py.warnings [None req-ebbb0e54-de03-4ff7-9d60-5bff26b798b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:32.485547 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: warnings.warn(msg) Jan 28 01:44:32.485547 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: Jan 28 01:44:32.488235 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb0e54-de03-4ff7-9d60-5bff26b798b9 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.512379 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-9c0ba85f-ded0-44a4-9708-3c8a9961d6ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:32.515576 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 198/394] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:32.524493 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ba85f-ded0-44a4-9708-3c8a9961d6ba admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.550155 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ba85f-ded0-44a4-9708-3c8a9961d6ba admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.562555 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898b272-ac6f-4159-956a-3c76630d99d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.563480 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898b272-ac6f-4159-956a-3c76630d99d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.564027 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898b272-ac6f-4159-956a-3c76630d99d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.565290 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898b272-ac6f-4159-956a-3c76630d99d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.566094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898b272-ac6f-4159-956a-3c76630d99d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:32.566408 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898b272-ac6f-4159-956a-3c76630d99d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.568013 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898b272-ac6f-4159-956a-3c76630d99d7 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.578548 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 197/395] 10.222.0.96 () {56 vars in 1158 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:32.588950 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb0e54-de03-4ff7-9d60-5bff26b798b9 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.596899 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 199/396] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:32.603676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898b272-ac6f-4159-956a-3c76630d99d7 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.615004 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb0e54-de03-4ff7-9d60-5bff26b798b9 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.621558 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898b272-ac6f-4159-956a-3c76630d99d7 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.627424 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad2d81-6b52-411b-a702-cbe50564911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.628088 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad2d81-6b52-411b-a702-cbe50564911e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.628366 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad2d81-6b52-411b-a702-cbe50564911e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.628637 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad2d81-6b52-411b-a702-cbe50564911e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.635373 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff3d85-4f39-4e7c-8cf1-e1093d82fb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.636208 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff3d85-4f39-4e7c-8cf1-e1093d82fb6a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.636486 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff3d85-4f39-4e7c-8cf1-e1093d82fb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.636754 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff3d85-4f39-4e7c-8cf1-e1093d82fb6a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.645796 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad2d81-6b52-411b-a702-cbe50564911e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.647610 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad2d81-6b52-411b-a702-cbe50564911e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.659662 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff3d85-4f39-4e7c-8cf1-e1093d82fb6a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.661821 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff3d85-4f39-4e7c-8cf1-e1093d82fb6a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.665350 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 198/397] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:44:32.670318 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad2d81-6b52-411b-a702-cbe50564911e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.687534 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad2d81-6b52-411b-a702-cbe50564911e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.691304 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-8aff3d85-4f39-4e7c-8cf1-e1093d82fb6a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:32.692582 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 200/398] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:32.698071 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d14ad-b2dd-4b64-83a6-2f948e109d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.698980 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d14ad-b2dd-4b64-83a6-2f948e109d72 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.699290 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d14ad-b2dd-4b64-83a6-2f948e109d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.699499 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d14ad-b2dd-4b64-83a6-2f948e109d72 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.701218 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff3d85-4f39-4e7c-8cf1-e1093d82fb6a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.712044 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff3d85-4f39-4e7c-8cf1-e1093d82fb6a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.717312 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031b533-a1d3-44d6-a0fe-57a0249d6278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.717974 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031b533-a1d3-44d6-a0fe-57a0249d6278 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.718306 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031b533-a1d3-44d6-a0fe-57a0249d6278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.718579 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031b533-a1d3-44d6-a0fe-57a0249d6278 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.718683 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d14ad-b2dd-4b64-83a6-2f948e109d72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.719418 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031b533-a1d3-44d6-a0fe-57a0249d6278 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:32.719722 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031b533-a1d3-44d6-a0fe-57a0249d6278 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.720536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d14ad-b2dd-4b64-83a6-2f948e109d72 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.720846 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-0031b533-a1d3-44d6-a0fe-57a0249d6278 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:32.720846 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:44:32.720846 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:44:32.722078 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031b533-a1d3-44d6-a0fe-57a0249d6278 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.743775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 201/399] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:32.750230 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031b533-a1d3-44d6-a0fe-57a0249d6278 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.754579 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-390d14ad-b2dd-4b64-83a6-2f948e109d72 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:32.756944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 199/400] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:32.761436 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031b533-a1d3-44d6-a0fe-57a0249d6278 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.768554 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428af831-5662-4b38-9395-a416d756ed9f None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.768875 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428af831-5662-4b38-9395-a416d756ed9f None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.769288 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428af831-5662-4b38-9395-a416d756ed9f None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.771342 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 200/401] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:44:32.771578 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a0e0a-55dc-4146-a389-d7d515e299a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.772114 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428af831-5662-4b38-9395-a416d756ed9f None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.772275 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a0e0a-55dc-4146-a389-d7d515e299a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.772556 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a0e0a-55dc-4146-a389-d7d515e299a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.772856 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a0e0a-55dc-4146-a389-d7d515e299a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.774578 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a0e0a-55dc-4146-a389-d7d515e299a4 admin admin] RBAC: Adding query filter params (role.id=4d7fce301eec49a7a54390167747fe24, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=cc85f5db9c3c47fca68ebab33b0bb73c) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:32.775003 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a0e0a-55dc-4146-a389-d7d515e299a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.778216 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a0e0a-55dc-4146-a389-d7d515e299a4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.784124 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 202/402] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/role_assignments?user.id=cc85f5db9c3c47fca68ebab33b0bb73c&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=4d7fce301eec49a7a54390167747fe24 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:32.785442 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae46e5-40f1-43ef-9717-d936d3a6d7ea None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.785726 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae46e5-40f1-43ef-9717-d936d3a6d7ea None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.785996 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae46e5-40f1-43ef-9717-d936d3a6d7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.794692 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428af831-5662-4b38-9395-a416d756ed9f None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.799317 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce5adf-3fe3-4d7a-bfd2-7d042d13803f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.800026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce5adf-3fe3-4d7a-bfd2-7d042d13803f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.800302 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce5adf-3fe3-4d7a-bfd2-7d042d13803f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.800629 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce5adf-3fe3-4d7a-bfd2-7d042d13803f admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.801455 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce5adf-3fe3-4d7a-bfd2-7d042d13803f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:32.801756 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce5adf-3fe3-4d7a-bfd2-7d042d13803f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.803509 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce5adf-3fe3-4d7a-bfd2-7d042d13803f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.809334 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-16ae46e5-40f1-43ef-9717-d936d3a6d7ea None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:32.811003 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-16ae46e5-40f1-43ef-9717-d936d3a6d7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:32.818851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 201/403] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:32.819719 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 203/404] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:32 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:32.826835 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce5adf-3fe3-4d7a-bfd2-7d042d13803f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.838802 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce5adf-3fe3-4d7a-bfd2-7d042d13803f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.843766 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0582776-718b-4772-a9ea-97bc479090ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.846011 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f1724-58e1-4058-969a-cf393c3c727b None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.846292 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f1724-58e1-4058-969a-cf393c3c727b None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.846613 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f1724-58e1-4058-969a-cf393c3c727b None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.848726 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 204/405] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:44:32.849512 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f1724-58e1-4058-969a-cf393c3c727b None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.850815 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0582776-718b-4772-a9ea-97bc479090ac admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.851095 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0582776-718b-4772-a9ea-97bc479090ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.851366 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0582776-718b-4772-a9ea-97bc479090ac admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.860285 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0582776-718b-4772-a9ea-97bc479090ac admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.862454 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0582776-718b-4772-a9ea-97bc479090ac admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.866034 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f1724-58e1-4058-969a-cf393c3c727b None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.871765 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59edc92-35ba-4f13-81c0-48c08460270c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.872977 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59edc92-35ba-4f13-81c0-48c08460270c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.873469 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59edc92-35ba-4f13-81c0-48c08460270c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.873946 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59edc92-35ba-4f13-81c0-48c08460270c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.878308 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-c0582776-718b-4772-a9ea-97bc479090ac admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:32.879881 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 202/406] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:32.881225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a8e32-fd21-4656-8ed6-911f05886abc None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.881514 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a8e32-fd21-4656-8ed6-911f05886abc None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.881788 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a8e32-fd21-4656-8ed6-911f05886abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.897976 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59edc92-35ba-4f13-81c0-48c08460270c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:32.906968 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-d59edc92-35ba-4f13-81c0-48c08460270c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:44:32.908455 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 205/407] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:32.909141 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59edc92-35ba-4f13-81c0-48c08460270c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.920714 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59edc92-35ba-4f13-81c0-48c08460270c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.926104 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb72938-c35a-4a38-a228-ad83d99587d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.926696 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb72938-c35a-4a38-a228-ad83d99587d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.926977 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb72938-c35a-4a38-a228-ad83d99587d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.927247 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb72938-c35a-4a38-a228-ad83d99587d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.928121 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb72938-c35a-4a38-a228-ad83d99587d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:32.928429 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb72938-c35a-4a38-a228-ad83d99587d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.931066 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb72938-c35a-4a38-a228-ad83d99587d5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.947550 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 206/408] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:32.948261 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb72938-c35a-4a38-a228-ad83d99587d5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:32.966586 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb72938-c35a-4a38-a228-ad83d99587d5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:32.971673 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98870d7c-08bd-42a8-a8cc-9fea726ed1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:32.972366 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98870d7c-08bd-42a8-a8cc-9fea726ed1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:32.972706 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98870d7c-08bd-42a8-a8cc-9fea726ed1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:32.973094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98870d7c-08bd-42a8-a8cc-9fea726ed1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:32.973998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98870d7c-08bd-42a8-a8cc-9fea726ed1a1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:32.974358 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98870d7c-08bd-42a8-a8cc-9fea726ed1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:32.976089 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98870d7c-08bd-42a8-a8cc-9fea726ed1a1 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:32.987338 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 207/409] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:32.992835 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98870d7c-08bd-42a8-a8cc-9fea726ed1a1 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.000349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98870d7c-08bd-42a8-a8cc-9fea726ed1a1 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.005463 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3336e-49b5-461c-91da-9bd26ee3c860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.006193 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3336e-49b5-461c-91da-9bd26ee3c860 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.006475 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3336e-49b5-461c-91da-9bd26ee3c860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.006747 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3336e-49b5-461c-91da-9bd26ee3c860 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.007639 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3336e-49b5-461c-91da-9bd26ee3c860 admin admin] RBAC: Adding query filter params (role.id=4d7fce301eec49a7a54390167747fe24, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=07298acc960e4154be7c79f2368a1952) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:33.008070 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3336e-49b5-461c-91da-9bd26ee3c860 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.011154 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3336e-49b5-461c-91da-9bd26ee3c860 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.017913 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 208/410] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:32 2022] GET /identity/v3/role_assignments?user.id=07298acc960e4154be7c79f2368a1952&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=4d7fce301eec49a7a54390167747fe24 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:33.018657 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3336e-49b5-461c-91da-9bd26ee3c860 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.038846 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3336e-49b5-461c-91da-9bd26ee3c860 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.044153 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-f83a8e32-fd21-4656-8ed6-911f05886abc None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:33.045812 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-f83a8e32-fd21-4656-8ed6-911f05886abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:33.055729 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f4f39-50d3-4e98-b8b5-b6d0f9ee3f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.058188 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f4f39-50d3-4e98-b8b5-b6d0f9ee3f29 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.059374 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f4f39-50d3-4e98-b8b5-b6d0f9ee3f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.059873 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f4f39-50d3-4e98-b8b5-b6d0f9ee3f29 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.072786 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 203/411] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:32 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:33.082733 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f4f39-50d3-4e98-b8b5-b6d0f9ee3f29 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.085075 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f4f39-50d3-4e98-b8b5-b6d0f9ee3f29 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.103870 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-6c7f4f39-50d3-4e98-b8b5-b6d0f9ee3f29 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:33.105865 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 209/412] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:33.112391 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a8e32-fd21-4656-8ed6-911f05886abc None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.123422 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a8e32-fd21-4656-8ed6-911f05886abc None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.124828 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f4f39-50d3-4e98-b8b5-b6d0f9ee3f29 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.136655 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb1612-b931-4d2f-8912-bd697b2d8f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.138100 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb1612-b931-4d2f-8912-bd697b2d8f6f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.139439 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb1612-b931-4d2f-8912-bd697b2d8f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.139970 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb1612-b931-4d2f-8912-bd697b2d8f6f admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.141324 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb1612-b931-4d2f-8912-bd697b2d8f6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:33.142015 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb1612-b931-4d2f-8912-bd697b2d8f6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.145752 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f4f39-50d3-4e98-b8b5-b6d0f9ee3f29 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.146578 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb1612-b931-4d2f-8912-bd697b2d8f6f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.157442 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590fe1b-3921-43ab-a4c2-76b359c8c1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.160349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590fe1b-3921-43ab-a4c2-76b359c8c1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.160918 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590fe1b-3921-43ab-a4c2-76b359c8c1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.161403 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590fe1b-3921-43ab-a4c2-76b359c8c1f1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.180830 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 204/413] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:33.182508 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590fe1b-3921-43ab-a4c2-76b359c8c1f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:33.190930 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb1612-b931-4d2f-8912-bd697b2d8f6f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.191384 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-2590fe1b-3921-43ab-a4c2-76b359c8c1f1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:44:33.192939 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 210/414] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:33.205935 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590fe1b-3921-43ab-a4c2-76b359c8c1f1 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.209218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb1612-b931-4d2f-8912-bd697b2d8f6f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.218934 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590fe1b-3921-43ab-a4c2-76b359c8c1f1 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.219316 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcfcb0-d7c9-47f1-af2c-08bdfc1a3d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.220201 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcfcb0-d7c9-47f1-af2c-08bdfc1a3d43 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.220438 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcfcb0-d7c9-47f1-af2c-08bdfc1a3d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.220673 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcfcb0-d7c9-47f1-af2c-08bdfc1a3d43 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.226782 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf428a9e-1b37-4a59-9e54-c9072bdd5cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.227861 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf428a9e-1b37-4a59-9e54-c9072bdd5cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.228397 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf428a9e-1b37-4a59-9e54-c9072bdd5cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.228845 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf428a9e-1b37-4a59-9e54-c9072bdd5cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.229801 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf428a9e-1b37-4a59-9e54-c9072bdd5cd4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:33.230295 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf428a9e-1b37-4a59-9e54-c9072bdd5cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.232123 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf428a9e-1b37-4a59-9e54-c9072bdd5cd4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.233482 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcfcb0-d7c9-47f1-af2c-08bdfc1a3d43 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.237177 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcfcb0-d7c9-47f1-af2c-08bdfc1a3d43 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.250800 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 211/415] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:33.253777 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf428a9e-1b37-4a59-9e54-c9072bdd5cd4 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.261415 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-00dcfcb0-d7c9-47f1-af2c-08bdfc1a3d43 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 28 01:44:33.271288 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf428a9e-1b37-4a59-9e54-c9072bdd5cd4 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.274180 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 205/416] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:33.279062 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5f5af-7428-4de8-94cf-678327998159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.280133 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5f5af-7428-4de8-94cf-678327998159 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.280670 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5f5af-7428-4de8-94cf-678327998159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.281803 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcfcb0-d7c9-47f1-af2c-08bdfc1a3d43 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.283094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5f5af-7428-4de8-94cf-678327998159 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.298379 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcfcb0-d7c9-47f1-af2c-08bdfc1a3d43 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.300561 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5f5af-7428-4de8-94cf-678327998159 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.302652 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5f5af-7428-4de8-94cf-678327998159 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.314086 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cd5d1-e066-46d7-8b13-b3fdaa1a114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.314766 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cd5d1-e066-46d7-8b13-b3fdaa1a114e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.315061 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cd5d1-e066-46d7-8b13-b3fdaa1a114e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.315348 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cd5d1-e066-46d7-8b13-b3fdaa1a114e admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.316708 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cd5d1-e066-46d7-8b13-b3fdaa1a114e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:33.317232 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cd5d1-e066-46d7-8b13-b3fdaa1a114e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.319193 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cd5d1-e066-46d7-8b13-b3fdaa1a114e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.323325 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-b8d5f5af-7428-4de8-94cf-678327998159 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:33.325091 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 212/417] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:33.333022 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5f5af-7428-4de8-94cf-678327998159 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.348516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5f5af-7428-4de8-94cf-678327998159 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.354667 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794cec6-d277-4aae-acf3-1fce7462397e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.355680 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794cec6-d277-4aae-acf3-1fce7462397e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.356228 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794cec6-d277-4aae-acf3-1fce7462397e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.356769 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794cec6-d277-4aae-acf3-1fce7462397e admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.357735 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794cec6-d277-4aae-acf3-1fce7462397e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:33.358290 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794cec6-d277-4aae-acf3-1fce7462397e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.360181 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794cec6-d277-4aae-acf3-1fce7462397e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.374474 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 213/418] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:33.375025 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 206/419] 10.222.0.96 () {56 vars in 1158 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:33.380873 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794cec6-d277-4aae-acf3-1fce7462397e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.382752 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cd5d1-e066-46d7-8b13-b3fdaa1a114e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.401303 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794cec6-d277-4aae-acf3-1fce7462397e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.405895 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cd5d1-e066-46d7-8b13-b3fdaa1a114e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.415505 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218f7b3-40fd-43cf-ac1a-20b4860f9203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.417833 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0642615-39f0-4c26-84d4-c7be85c22e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.419331 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218f7b3-40fd-43cf-ac1a-20b4860f9203 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.419894 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0642615-39f0-4c26-84d4-c7be85c22e60 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.420467 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218f7b3-40fd-43cf-ac1a-20b4860f9203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.420947 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0642615-39f0-4c26-84d4-c7be85c22e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.421979 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0642615-39f0-4c26-84d4-c7be85c22e60 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.422181 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218f7b3-40fd-43cf-ac1a-20b4860f9203 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.439156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218f7b3-40fd-43cf-ac1a-20b4860f9203 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.442297 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0642615-39f0-4c26-84d4-c7be85c22e60 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.444248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0642615-39f0-4c26-84d4-c7be85c22e60 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.444864 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218f7b3-40fd-43cf-ac1a-20b4860f9203 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.463845 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 207/420] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:33.465141 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0642615-39f0-4c26-84d4-c7be85c22e60 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.474088 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0642615-39f0-4c26-84d4-c7be85c22e60 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.480856 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791adf1-0872-4e01-9385-cb233f817754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.480856 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791adf1-0872-4e01-9385-cb233f817754 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.480856 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791adf1-0872-4e01-9385-cb233f817754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.480856 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791adf1-0872-4e01-9385-cb233f817754 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.481669 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-5218f7b3-40fd-43cf-ac1a-20b4860f9203 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 28 01:44:33.483281 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 214/421] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:33.489773 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218f7b3-40fd-43cf-ac1a-20b4860f9203 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.493230 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791adf1-0872-4e01-9385-cb233f817754 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.495173 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791adf1-0872-4e01-9385-cb233f817754 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.505896 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218f7b3-40fd-43cf-ac1a-20b4860f9203 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.512996 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-7791adf1-0872-4e01-9385-cb233f817754 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:33.514325 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 208/422] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:33.520037 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f640c-6518-445a-882f-721742f8c4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.520256 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791adf1-0872-4e01-9385-cb233f817754 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.521533 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f640c-6518-445a-882f-721742f8c4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.522088 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f640c-6518-445a-882f-721742f8c4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.522556 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f640c-6518-445a-882f-721742f8c4f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.524147 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f640c-6518-445a-882f-721742f8c4f4 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:33.525017 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f640c-6518-445a-882f-721742f8c4f4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.527376 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f640c-6518-445a-882f-721742f8c4f4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.538506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791adf1-0872-4e01-9385-cb233f817754 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.563136 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c2a01-99ea-4cfe-8507-b73537675412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.564225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c2a01-99ea-4cfe-8507-b73537675412 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.564955 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c2a01-99ea-4cfe-8507-b73537675412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.565462 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c2a01-99ea-4cfe-8507-b73537675412 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.566454 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c2a01-99ea-4cfe-8507-b73537675412 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:33.566954 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c2a01-99ea-4cfe-8507-b73537675412 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.568832 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c2a01-99ea-4cfe-8507-b73537675412 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.574724 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 215/423] 10.222.0.96 () {56 vars in 1160 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:33.588771 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f640c-6518-445a-882f-721742f8c4f4 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.598354 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 209/424] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:33.603428 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f640c-6518-445a-882f-721742f8c4f4 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.605979 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c2a01-99ea-4cfe-8507-b73537675412 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.612566 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632c6b4-5d69-48f8-9193-ea9c4db9617d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.613572 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632c6b4-5d69-48f8-9193-ea9c4db9617d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.614052 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632c6b4-5d69-48f8-9193-ea9c4db9617d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.614924 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632c6b4-5d69-48f8-9193-ea9c4db9617d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.626736 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c2a01-99ea-4cfe-8507-b73537675412 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.633802 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632c6b4-5d69-48f8-9193-ea9c4db9617d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.636958 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083db74-de9b-444b-8b86-5a60322d3fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.637993 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083db74-de9b-444b-8b86-5a60322d3fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.638770 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632c6b4-5d69-48f8-9193-ea9c4db9617d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.639232 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083db74-de9b-444b-8b86-5a60322d3fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.640159 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083db74-de9b-444b-8b86-5a60322d3fa3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.655293 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083db74-de9b-444b-8b86-5a60322d3fa3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.657590 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083db74-de9b-444b-8b86-5a60322d3fa3 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.658791 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 216/425] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:44:33.665130 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632c6b4-5d69-48f8-9193-ea9c4db9617d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.681958 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632c6b4-5d69-48f8-9193-ea9c4db9617d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.685517 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-0083db74-de9b-444b-8b86-5a60322d3fa3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:33.687138 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521eaaa5-9c26-4639-9354-104a17c12bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.687323 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 210/426] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:33.688407 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521eaaa5-9c26-4639-9354-104a17c12bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.688909 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521eaaa5-9c26-4639-9354-104a17c12bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.689105 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1fd03-2c2d-4185-a5e2-041be1e78f68 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.689424 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1fd03-2c2d-4185-a5e2-041be1e78f68 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.689784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521eaaa5-9c26-4639-9354-104a17c12bf6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.689890 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1fd03-2c2d-4185-a5e2-041be1e78f68 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.696945 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 211/427] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:33.700203 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1fd03-2c2d-4185-a5e2-041be1e78f68 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.706928 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521eaaa5-9c26-4639-9354-104a17c12bf6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.708780 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521eaaa5-9c26-4639-9354-104a17c12bf6 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.714487 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1fd03-2c2d-4185-a5e2-041be1e78f68 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.719730 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b5626-2729-40de-b822-808d1f3d6d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.720671 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b5626-2729-40de-b822-808d1f3d6d0d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.721183 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b5626-2729-40de-b822-808d1f3d6d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.721633 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b5626-2729-40de-b822-808d1f3d6d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.722818 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b5626-2729-40de-b822-808d1f3d6d0d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:33.723397 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b5626-2729-40de-b822-808d1f3d6d0d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.724638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING py.warnings [None req-954b5626-2729-40de-b822-808d1f3d6d0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:33.724638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: warnings.warn(msg) Jan 28 01:44:33.724638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: Jan 28 01:44:33.726264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b5626-2729-40de-b822-808d1f3d6d0d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.729873 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-521eaaa5-9c26-4639-9354-104a17c12bf6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:33.731903 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 217/428] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:33.739250 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e7744-bfaf-49fd-a074-e45099520788 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.739560 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e7744-bfaf-49fd-a074-e45099520788 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.739795 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e7744-bfaf-49fd-a074-e45099520788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.753320 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 212/429] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:33.754259 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b5626-2729-40de-b822-808d1f3d6d0d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.765829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-984e7744-bfaf-49fd-a074-e45099520788 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:33.767048 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b5626-2729-40de-b822-808d1f3d6d0d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.767582 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-984e7744-bfaf-49fd-a074-e45099520788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:33.772248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998292ac-7be4-4947-a124-f145db17a705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.772976 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998292ac-7be4-4947-a124-f145db17a705 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.773257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998292ac-7be4-4947-a124-f145db17a705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.773556 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998292ac-7be4-4947-a124-f145db17a705 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.774337 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998292ac-7be4-4947-a124-f145db17a705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:33.774761 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998292ac-7be4-4947-a124-f145db17a705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.776497 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998292ac-7be4-4947-a124-f145db17a705 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.777380 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 218/430] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:33 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:33.778763 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e7744-bfaf-49fd-a074-e45099520788 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.788788 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e7744-bfaf-49fd-a074-e45099520788 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.801040 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 213/431] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:33.803845 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178972a4-93a1-460b-bd66-20f4aaae4b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.805283 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178972a4-93a1-460b-bd66-20f4aaae4b94 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.805732 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178972a4-93a1-460b-bd66-20f4aaae4b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.806145 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178972a4-93a1-460b-bd66-20f4aaae4b94 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.807196 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178972a4-93a1-460b-bd66-20f4aaae4b94 admin admin] RBAC: Adding query filter params (role.id=4d7fce301eec49a7a54390167747fe24, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=eb36af30d0fe4369b4459f333cb64a36) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:33.808255 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998292ac-7be4-4947-a124-f145db17a705 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.808747 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178972a4-93a1-460b-bd66-20f4aaae4b94 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.810810 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178972a4-93a1-460b-bd66-20f4aaae4b94 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.818689 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 219/432] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/role_assignments?user.id=eb36af30d0fe4369b4459f333cb64a36&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=4d7fce301eec49a7a54390167747fe24 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:33.820030 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178972a4-93a1-460b-bd66-20f4aaae4b94 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.836926 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998292ac-7be4-4947-a124-f145db17a705 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.843355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178972a4-93a1-460b-bd66-20f4aaae4b94 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.845451 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca92c6-cae0-44dc-ac8e-3913ed821ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.846548 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca92c6-cae0-44dc-ac8e-3913ed821ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.847062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca92c6-cae0-44dc-ac8e-3913ed821ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.847495 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca92c6-cae0-44dc-ac8e-3913ed821ca5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.850175 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce4d2c-cfb4-4a5d-8250-1cb75ee04019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.851149 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce4d2c-cfb4-4a5d-8250-1cb75ee04019 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.851577 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce4d2c-cfb4-4a5d-8250-1cb75ee04019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.852011 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce4d2c-cfb4-4a5d-8250-1cb75ee04019 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.857466 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca92c6-cae0-44dc-ac8e-3913ed821ca5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.859778 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca92c6-cae0-44dc-ac8e-3913ed821ca5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.865690 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce4d2c-cfb4-4a5d-8250-1cb75ee04019 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.869981 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce4d2c-cfb4-4a5d-8250-1cb75ee04019 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.877651 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-2dca92c6-cae0-44dc-ac8e-3913ed821ca5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:33.879474 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 214/433] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:33.890654 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca92c6-cae0-44dc-ac8e-3913ed821ca5 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.900231 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-c2ce4d2c-cfb4-4a5d-8250-1cb75ee04019 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:33.901964 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 220/434] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:33.909164 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce4d2c-cfb4-4a5d-8250-1cb75ee04019 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.910387 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca92c6-cae0-44dc-ac8e-3913ed821ca5 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.922226 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce4d2c-cfb4-4a5d-8250-1cb75ee04019 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.926184 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe626c85-2f02-43d4-acc8-c9e63d50a57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.927080 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe626c85-2f02-43d4-acc8-c9e63d50a57e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.927722 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe626c85-2f02-43d4-acc8-c9e63d50a57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.928440 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe626c85-2f02-43d4-acc8-c9e63d50a57e admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.930153 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe626c85-2f02-43d4-acc8-c9e63d50a57e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:33.931111 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe626c85-2f02-43d4-acc8-c9e63d50a57e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.934692 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe626c85-2f02-43d4-acc8-c9e63d50a57e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.935586 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26340a20-e802-4c9d-8753-f1e786f935a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.936397 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26340a20-e802-4c9d-8753-f1e786f935a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.936847 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26340a20-e802-4c9d-8753-f1e786f935a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.937543 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26340a20-e802-4c9d-8753-f1e786f935a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.939952 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26340a20-e802-4c9d-8753-f1e786f935a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:33.940266 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26340a20-e802-4c9d-8753-f1e786f935a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.943624 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26340a20-e802-4c9d-8753-f1e786f935a9 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:33.955902 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 215/435] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:33.965676 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe626c85-2f02-43d4-acc8-c9e63d50a57e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.971465 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 221/436] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:33.983540 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe626c85-2f02-43d4-acc8-c9e63d50a57e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:33.987812 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26340a20-e802-4c9d-8753-f1e786f935a9 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:33.990252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc3ce2-4e08-4ea0-a8f1-36db6e533fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:33.990922 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc3ce2-4e08-4ea0-a8f1-36db6e533fff admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:33.991246 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc3ce2-4e08-4ea0-a8f1-36db6e533fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:33.991525 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc3ce2-4e08-4ea0-a8f1-36db6e533fff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:33.992627 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc3ce2-4e08-4ea0-a8f1-36db6e533fff admin admin] RBAC: Adding query filter params (role.id=4d7fce301eec49a7a54390167747fe24, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=4acc32735f0a418ba5620f6225500402) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:33.992884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc3ce2-4e08-4ea0-a8f1-36db6e533fff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:33.994848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc3ce2-4e08-4ea0-a8f1-36db6e533fff admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:34.003323 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 216/437] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:33 2022] GET /identity/v3/role_assignments?user.id=4acc32735f0a418ba5620f6225500402&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=4d7fce301eec49a7a54390167747fe24 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:34.013099 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26340a20-e802-4c9d-8753-f1e786f935a9 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:34.027366 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e5b85-7595-4487-aff8-9150d5cca9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:34.028429 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e5b85-7595-4487-aff8-9150d5cca9bd admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:34.028874 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e5b85-7595-4487-aff8-9150d5cca9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:34.029326 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e5b85-7595-4487-aff8-9150d5cca9bd admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:34.030548 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e5b85-7595-4487-aff8-9150d5cca9bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:34.033839 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e5b85-7595-4487-aff8-9150d5cca9bd admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:34.063786 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 222/438] 10.222.0.96 () {60 vars in 1153 bytes} [Fri Jan 28 01:44:33 2022] POST /identity/v3/users => generated 247 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:44:35.441047 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9172361-888f-4a81-8f53-8ed23e200458 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:35.441563 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9172361-888f-4a81-8f53-8ed23e200458 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:35.441563 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9172361-888f-4a81-8f53-8ed23e200458 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:35.443362 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 217/439] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:35.456776 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09f633-7208-4579-b006-44919bffd816 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:35.457516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09f633-7208-4579-b006-44919bffd816 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:35.457516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09f633-7208-4579-b006-44919bffd816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:35.485394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-ba09f633-7208-4579-b006-44919bffd816 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:35.486626 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-ba09f633-7208-4579-b006-44919bffd816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:35.500045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 223/440] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:35 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:35.538128 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9172361-888f-4a81-8f53-8ed23e200458 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:35.555862 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9172361-888f-4a81-8f53-8ed23e200458 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:35.563849 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd7f73-6df1-4eb1-a1c6-f607e2f5d5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:35.564652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd7f73-6df1-4eb1-a1c6-f607e2f5d5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:35.564960 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd7f73-6df1-4eb1-a1c6-f607e2f5d5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:35.565232 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd7f73-6df1-4eb1-a1c6-f607e2f5d5c2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:35.585853 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd7f73-6df1-4eb1-a1c6-f607e2f5d5c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:35.593264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-a6bd7f73-6df1-4eb1-a1c6-f607e2f5d5c2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:44:35.594694 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 218/441] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:35.600904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09f633-7208-4579-b006-44919bffd816 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:35.614041 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09f633-7208-4579-b006-44919bffd816 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:35.622449 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a61ea8-fad3-4ac0-97b3-1ac919a86b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:35.623142 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a61ea8-fad3-4ac0-97b3-1ac919a86b5e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:35.623419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a61ea8-fad3-4ac0-97b3-1ac919a86b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:35.623690 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a61ea8-fad3-4ac0-97b3-1ac919a86b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:35.624440 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a61ea8-fad3-4ac0-97b3-1ac919a86b5e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:35.624744 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a61ea8-fad3-4ac0-97b3-1ac919a86b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:35.626373 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a61ea8-fad3-4ac0-97b3-1ac919a86b5e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:35.641383 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 224/442] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:44:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:35.647564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd7f73-6df1-4eb1-a1c6-f607e2f5d5c2 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:35.667395 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd7f73-6df1-4eb1-a1c6-f607e2f5d5c2 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:35.675954 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23041c39-2190-474e-ad2d-a20491d8cc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:35.676760 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23041c39-2190-474e-ad2d-a20491d8cc94 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:35.677079 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23041c39-2190-474e-ad2d-a20491d8cc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:35.677350 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23041c39-2190-474e-ad2d-a20491d8cc94 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:35.693337 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23041c39-2190-474e-ad2d-a20491d8cc94 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:35.695113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23041c39-2190-474e-ad2d-a20491d8cc94 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:35.719092 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-23041c39-2190-474e-ad2d-a20491d8cc94 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:35.720618 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 219/443] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:35.727647 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a61ea8-fad3-4ac0-97b3-1ac919a86b5e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:35.743181 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a61ea8-fad3-4ac0-97b3-1ac919a86b5e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:35.749897 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c6dec-b988-48fa-a1c2-3367626f8c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:35.750571 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c6dec-b988-48fa-a1c2-3367626f8c39 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:35.750853 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c6dec-b988-48fa-a1c2-3367626f8c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:35.751125 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c6dec-b988-48fa-a1c2-3367626f8c39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:35.751855 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c6dec-b988-48fa-a1c2-3367626f8c39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:35.752157 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c6dec-b988-48fa-a1c2-3367626f8c39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:35.753808 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c6dec-b988-48fa-a1c2-3367626f8c39 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:35.774165 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 225/444] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:35.780828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23041c39-2190-474e-ad2d-a20491d8cc94 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:35.792683 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23041c39-2190-474e-ad2d-a20491d8cc94 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:35.801562 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d3a00-c921-4b6c-96d8-f5db1737a7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:35.802389 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d3a00-c921-4b6c-96d8-f5db1737a7cf admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:35.802648 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d3a00-c921-4b6c-96d8-f5db1737a7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:35.802929 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d3a00-c921-4b6c-96d8-f5db1737a7cf admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:35.818161 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d3a00-c921-4b6c-96d8-f5db1737a7cf admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:35.820224 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d3a00-c921-4b6c-96d8-f5db1737a7cf admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:35.840985 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-935d3a00-c921-4b6c-96d8-f5db1737a7cf admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:44:35.842525 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 220/445] 10.222.0.96 () {56 vars in 1114 bytes} [Fri Jan 28 01:44:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:35.848789 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c6dec-b988-48fa-a1c2-3367626f8c39 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:35.859816 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c6dec-b988-48fa-a1c2-3367626f8c39 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:35.866189 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc850e-04a9-45bd-b936-c7b6604de1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:35.867188 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc850e-04a9-45bd-b936-c7b6604de1bb admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:35.868651 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc850e-04a9-45bd-b936-c7b6604de1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:35.869131 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc850e-04a9-45bd-b936-c7b6604de1bb admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:35.870206 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc850e-04a9-45bd-b936-c7b6604de1bb admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:35.870540 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc850e-04a9-45bd-b936-c7b6604de1bb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:35.873126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc850e-04a9-45bd-b936-c7b6604de1bb admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:35.884856 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a1078-cf8f-48e1-b217-877def2cd907 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:35.884856 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a1078-cf8f-48e1-b217-877def2cd907 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:35.884856 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a1078-cf8f-48e1-b217-877def2cd907 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:35.891187 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 221/446] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:35.908227 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 226/447] 10.222.0.96 () {56 vars in 1154 bytes} [Fri Jan 28 01:44:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:35.912948 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec133f96-b25a-437b-a99b-34ee41607ba9 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:35.913223 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec133f96-b25a-437b-a99b-34ee41607ba9 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:35.913502 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec133f96-b25a-437b-a99b-34ee41607ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:35.919715 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc850e-04a9-45bd-b936-c7b6604de1bb admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:35.930535 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc850e-04a9-45bd-b936-c7b6604de1bb admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:35.942274 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-ec133f96-b25a-437b-a99b-34ee41607ba9 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:35.943674 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ec133f96-b25a-437b-a99b-34ee41607ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:35.946851 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d8a22-370a-4563-a13c-0d3b932741eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:35.948480 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d8a22-370a-4563-a13c-0d3b932741eb admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:35.949329 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d8a22-370a-4563-a13c-0d3b932741eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:35.949801 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d8a22-370a-4563-a13c-0d3b932741eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:35.957306 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 222/448] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:35 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:35.971852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d8a22-370a-4563-a13c-0d3b932741eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:35.973745 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d8a22-370a-4563-a13c-0d3b932741eb admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:35.984260 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec133f96-b25a-437b-a99b-34ee41607ba9 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:35.997362 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec133f96-b25a-437b-a99b-34ee41607ba9 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:36.003743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaae473-90d9-439c-8d02-dffbb9410d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:36.004637 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaae473-90d9-439c-8d02-dffbb9410d6d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.004945 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaae473-90d9-439c-8d02-dffbb9410d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.005216 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaae473-90d9-439c-8d02-dffbb9410d6d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.016607 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-1c3d8a22-370a-4563-a13c-0d3b932741eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:36.024904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 227/449] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:36.025445 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaae473-90d9-439c-8d02-dffbb9410d6d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:36.026111 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d8a22-370a-4563-a13c-0d3b932741eb admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:36.033518 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-abaae473-90d9-439c-8d02-dffbb9410d6d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:44:36.035025 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 223/450] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:36.042193 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d8a22-370a-4563-a13c-0d3b932741eb admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:36.048206 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaae473-90d9-439c-8d02-dffbb9410d6d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:36.055937 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448931c-eb42-4c1a-af16-538179b0563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:36.056838 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448931c-eb42-4c1a-af16-538179b0563f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.057214 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448931c-eb42-4c1a-af16-538179b0563f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.057609 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448931c-eb42-4c1a-af16-538179b0563f admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.058345 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448931c-eb42-4c1a-af16-538179b0563f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:36.058648 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448931c-eb42-4c1a-af16-538179b0563f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:36.060288 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448931c-eb42-4c1a-af16-538179b0563f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:36.061235 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaae473-90d9-439c-8d02-dffbb9410d6d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:36.072304 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70ec25-dfb4-4dee-adca-d08db09cee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:36.073920 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70ec25-dfb4-4dee-adca-d08db09cee2c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.074622 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70ec25-dfb4-4dee-adca-d08db09cee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.075653 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70ec25-dfb4-4dee-adca-d08db09cee2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.077556 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70ec25-dfb4-4dee-adca-d08db09cee2c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:36.078628 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70ec25-dfb4-4dee-adca-d08db09cee2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:36.080833 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70ec25-dfb4-4dee-adca-d08db09cee2c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:36.087932 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 228/451] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:36.096868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448931c-eb42-4c1a-af16-538179b0563f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:36.105082 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 224/452] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:44:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:36.111873 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70ec25-dfb4-4dee-adca-d08db09cee2c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:36.112517 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448931c-eb42-4c1a-af16-538179b0563f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:36.125462 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279473a3-05a5-4543-95bf-371ba079bd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:36.126596 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279473a3-05a5-4543-95bf-371ba079bd1b admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.127027 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279473a3-05a5-4543-95bf-371ba079bd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.128026 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279473a3-05a5-4543-95bf-371ba079bd1b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.128902 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70ec25-dfb4-4dee-adca-d08db09cee2c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:36.138432 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49702f42-330f-41fa-b71f-266193b6d48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:36.140403 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49702f42-330f-41fa-b71f-266193b6d48a admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.140877 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49702f42-330f-41fa-b71f-266193b6d48a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.141932 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49702f42-330f-41fa-b71f-266193b6d48a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.146285 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279473a3-05a5-4543-95bf-371ba079bd1b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:36.151055 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279473a3-05a5-4543-95bf-371ba079bd1b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:36.165677 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49702f42-330f-41fa-b71f-266193b6d48a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:36.167727 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49702f42-330f-41fa-b71f-266193b6d48a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:36.190091 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-279473a3-05a5-4543-95bf-371ba079bd1b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:36.192593 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 229/453] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:36.199602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279473a3-05a5-4543-95bf-371ba079bd1b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:36.205674 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-49702f42-330f-41fa-b71f-266193b6d48a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:36.208272 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 225/454] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:36.214617 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279473a3-05a5-4543-95bf-371ba079bd1b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:36.216048 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49702f42-330f-41fa-b71f-266193b6d48a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:36.229420 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49702f42-330f-41fa-b71f-266193b6d48a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:36.230866 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e61c8-8554-41fa-a069-5bee7571dd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:36.232008 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e61c8-8554-41fa-a069-5bee7571dd2c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.233317 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e61c8-8554-41fa-a069-5bee7571dd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.233758 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e61c8-8554-41fa-a069-5bee7571dd2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.234693 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e61c8-8554-41fa-a069-5bee7571dd2c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:36.235093 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e61c8-8554-41fa-a069-5bee7571dd2c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:36.237243 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243815bc-1dee-4cbc-88a7-84c7d22e9566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:36.237379 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e61c8-8554-41fa-a069-5bee7571dd2c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:36.238189 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243815bc-1dee-4cbc-88a7-84c7d22e9566 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.238669 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243815bc-1dee-4cbc-88a7-84c7d22e9566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.239076 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243815bc-1dee-4cbc-88a7-84c7d22e9566 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.239995 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243815bc-1dee-4cbc-88a7-84c7d22e9566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:36.240426 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243815bc-1dee-4cbc-88a7-84c7d22e9566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:36.242287 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243815bc-1dee-4cbc-88a7-84c7d22e9566 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:36.255361 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 226/455] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:36.261654 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243815bc-1dee-4cbc-88a7-84c7d22e9566 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:36.261936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 230/456] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:36.268431 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e61c8-8554-41fa-a069-5bee7571dd2c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:36.276841 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243815bc-1dee-4cbc-88a7-84c7d22e9566 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:36.279934 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e61c8-8554-41fa-a069-5bee7571dd2c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:36.284641 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a22cf8-d1d9-4057-927d-698037c18eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:36.285986 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a22cf8-d1d9-4057-927d-698037c18eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.286741 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a22cf8-d1d9-4057-927d-698037c18eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.287014 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a22cf8-d1d9-4057-927d-698037c18eb6 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.290049 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63e5c0-8a6f-4938-8d7e-e4fe98047052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:36.292344 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63e5c0-8a6f-4938-8d7e-e4fe98047052 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.293098 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63e5c0-8a6f-4938-8d7e-e4fe98047052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.293205 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63e5c0-8a6f-4938-8d7e-e4fe98047052 admin admin] PATH_INFO: `/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/cc85f5db9c3c47fca68ebab33b0bb73c/roles/4d7fce301eec49a7a54390167747fe24` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.300290 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a22cf8-d1d9-4057-927d-698037c18eb6 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:36.303083 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a22cf8-d1d9-4057-927d-698037c18eb6 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:36.313431 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63e5c0-8a6f-4938-8d7e-e4fe98047052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356ecb479ba24136a7c38cb5a58a0a18, user_id=cc85f5db9c3c47fca68ebab33b0bb73c, role_id=4d7fce301eec49a7a54390167747fe24)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:36.316131 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63e5c0-8a6f-4938-8d7e-e4fe98047052 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:36.319189 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-56a22cf8-d1d9-4057-927d-698037c18eb6 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 28 01:44:36.322056 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 227/457] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:36.328677 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a22cf8-d1d9-4057-927d-698037c18eb6 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:36.339622 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 231/458] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:44:36 2022] PUT /identity/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/cc85f5db9c3c47fca68ebab33b0bb73c/roles/4d7fce301eec49a7a54390167747fe24 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:44:36.347142 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a22cf8-d1d9-4057-927d-698037c18eb6 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:36.423878 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eff609-b605-40bf-aed1-d117c5332f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:36.424912 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eff609-b605-40bf-aed1-d117c5332f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.425438 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eff609-b605-40bf-aed1-d117c5332f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.425898 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eff609-b605-40bf-aed1-d117c5332f94 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.426891 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eff609-b605-40bf-aed1-d117c5332f94 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:36.427348 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eff609-b605-40bf-aed1-d117c5332f94 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:36.429518 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eff609-b605-40bf-aed1-d117c5332f94 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:36.453470 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 228/459] 10.222.0.96 () {56 vars in 1158 bytes} [Fri Jan 28 01:44:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:36.460085 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63e5c0-8a6f-4938-8d7e-e4fe98047052 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:36.472157 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63e5c0-8a6f-4938-8d7e-e4fe98047052 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:36.478564 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b15c5-ceed-41c9-99ad-e5b3cddd1265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:36.479923 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b15c5-ceed-41c9-99ad-e5b3cddd1265 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.480388 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b15c5-ceed-41c9-99ad-e5b3cddd1265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.480830 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b15c5-ceed-41c9-99ad-e5b3cddd1265 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.495089 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b15c5-ceed-41c9-99ad-e5b3cddd1265 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:36.497292 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b15c5-ceed-41c9-99ad-e5b3cddd1265 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:36.516286 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-e09b15c5-ceed-41c9-99ad-e5b3cddd1265 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:36.518150 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 232/460] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:36.528044 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eff609-b605-40bf-aed1-d117c5332f94 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:36.553877 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eff609-b605-40bf-aed1-d117c5332f94 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:36.559871 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337806aa-b44c-49c3-98a3-2d0c598cfbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:36.560836 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337806aa-b44c-49c3-98a3-2d0c598cfbfe admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.561257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337806aa-b44c-49c3-98a3-2d0c598cfbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.561728 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337806aa-b44c-49c3-98a3-2d0c598cfbfe admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.562600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337806aa-b44c-49c3-98a3-2d0c598cfbfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:36.563041 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337806aa-b44c-49c3-98a3-2d0c598cfbfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:36.564784 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337806aa-b44c-49c3-98a3-2d0c598cfbfe admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:36.581661 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 229/461] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:36.588730 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b15c5-ceed-41c9-99ad-e5b3cddd1265 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:36.599451 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b15c5-ceed-41c9-99ad-e5b3cddd1265 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:36.605775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ec25e-0617-4995-a1e1-d20e9b7cbdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:36.607385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ec25e-0617-4995-a1e1-d20e9b7cbdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.607826 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ec25e-0617-4995-a1e1-d20e9b7cbdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.608254 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ec25e-0617-4995-a1e1-d20e9b7cbdc6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.618805 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ec25e-0617-4995-a1e1-d20e9b7cbdc6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:36.621276 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ec25e-0617-4995-a1e1-d20e9b7cbdc6 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:36.642414 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-b74ec25e-0617-4995-a1e1-d20e9b7cbdc6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:36.644236 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 233/462] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:36.652265 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337806aa-b44c-49c3-98a3-2d0c598cfbfe admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:36.662649 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337806aa-b44c-49c3-98a3-2d0c598cfbfe admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:36.668332 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9d652-dad4-48fd-a76e-8aec244ee305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:36.669403 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9d652-dad4-48fd-a76e-8aec244ee305 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.669826 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9d652-dad4-48fd-a76e-8aec244ee305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.670239 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9d652-dad4-48fd-a76e-8aec244ee305 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.671233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9d652-dad4-48fd-a76e-8aec244ee305 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:36.671696 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9d652-dad4-48fd-a76e-8aec244ee305 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:36.673919 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9d652-dad4-48fd-a76e-8aec244ee305 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:36.688020 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 230/463] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:36.694917 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ec25e-0617-4995-a1e1-d20e9b7cbdc6 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:36.707607 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ec25e-0617-4995-a1e1-d20e9b7cbdc6 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:36.715446 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e60fc-3fa1-4ab6-b067-b37d048e348d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:36.716830 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e60fc-3fa1-4ab6-b067-b37d048e348d admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.717312 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e60fc-3fa1-4ab6-b067-b37d048e348d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.717729 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e60fc-3fa1-4ab6-b067-b37d048e348d admin admin] PATH_INFO: `/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/07298acc960e4154be7c79f2368a1952/roles/4d7fce301eec49a7a54390167747fe24` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.733757 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c1571-9cd6-49bc-89f4-0e69ec90c2cb None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.734292 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c1571-9cd6-49bc-89f4-0e69ec90c2cb None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.734770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c1571-9cd6-49bc-89f4-0e69ec90c2cb None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.736928 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 231/464] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:44:36.742004 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e60fc-3fa1-4ab6-b067-b37d048e348d admin admin] RBAC: Authorizing `identity:create_grant(project_id=356ecb479ba24136a7c38cb5a58a0a18, user_id=07298acc960e4154be7c79f2368a1952, role_id=4d7fce301eec49a7a54390167747fe24)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:36.745936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e60fc-3fa1-4ab6-b067-b37d048e348d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:36.748135 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124a76f-9e59-415f-8f51-bcb44bcbdd2d None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.748427 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124a76f-9e59-415f-8f51-bcb44bcbdd2d None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.748705 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124a76f-9e59-415f-8f51-bcb44bcbdd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.763803 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 234/465] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:44:36 2022] PUT /identity/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/07298acc960e4154be7c79f2368a1952/roles/4d7fce301eec49a7a54390167747fe24 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:44:36.790120 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-e124a76f-9e59-415f-8f51-bcb44bcbdd2d None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:36.791440 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-e124a76f-9e59-415f-8f51-bcb44bcbdd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:36.840108 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525291bc-37b6-4e21-ba00-92d29bd705ae None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.840438 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525291bc-37b6-4e21-ba00-92d29bd705ae None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.840656 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525291bc-37b6-4e21-ba00-92d29bd705ae None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.842795 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 235/466] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:36.850783 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456c1e2-8587-4d41-83ce-b77e3340b638 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.851135 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456c1e2-8587-4d41-83ce-b77e3340b638 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.851335 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456c1e2-8587-4d41-83ce-b77e3340b638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.862251 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 232/467] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:36 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:36.880591 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-1456c1e2-8587-4d41-83ce-b77e3340b638 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:36.881858 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-1456c1e2-8587-4d41-83ce-b77e3340b638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:36.891260 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 236/468] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:36 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:36.905438 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124a76f-9e59-415f-8f51-bcb44bcbdd2d None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:36.915671 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124a76f-9e59-415f-8f51-bcb44bcbdd2d None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:36.926667 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9551f6-2604-4216-8a6c-ef6f3c03be28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:36.927699 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9551f6-2604-4216-8a6c-ef6f3c03be28 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.927982 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9551f6-2604-4216-8a6c-ef6f3c03be28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.928309 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9551f6-2604-4216-8a6c-ef6f3c03be28 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.935988 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456c1e2-8587-4d41-83ce-b77e3340b638 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:36.952582 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456c1e2-8587-4d41-83ce-b77e3340b638 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:36.961579 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9551f6-2604-4216-8a6c-ef6f3c03be28 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:36.966369 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936dda8-6076-4190-90d3-9b29fc3240ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:36.967175 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936dda8-6076-4190-90d3-9b29fc3240ac admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:36.967457 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936dda8-6076-4190-90d3-9b29fc3240ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:36.967731 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936dda8-6076-4190-90d3-9b29fc3240ac admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:36.968464 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-8e9551f6-2604-4216-8a6c-ef6f3c03be28 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:44:36.970035 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 233/469] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:36.977531 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9551f6-2604-4216-8a6c-ef6f3c03be28 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:36.984910 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936dda8-6076-4190-90d3-9b29fc3240ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:36.993839 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-d936dda8-6076-4190-90d3-9b29fc3240ac admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:44:36.995165 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9551f6-2604-4216-8a6c-ef6f3c03be28 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:36.995669 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 237/470] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:37.002201 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936dda8-6076-4190-90d3-9b29fc3240ac admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.003001 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c8f40-b38d-4a7c-81ff-20ee063386ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.004005 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8f40-b38d-4a7c-81ff-20ee063386ab admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.004524 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8f40-b38d-4a7c-81ff-20ee063386ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.004986 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8f40-b38d-4a7c-81ff-20ee063386ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.006008 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c8f40-b38d-4a7c-81ff-20ee063386ab admin admin] RBAC: Adding query filter params (name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:37.006507 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c8f40-b38d-4a7c-81ff-20ee063386ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.008706 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c8f40-b38d-4a7c-81ff-20ee063386ab admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.013772 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936dda8-6076-4190-90d3-9b29fc3240ac admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.021144 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 234/471] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:44:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:37.021770 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2eecf-728c-4022-834a-07f2937f2132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.022534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2eecf-728c-4022-834a-07f2937f2132 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.022939 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2eecf-728c-4022-834a-07f2937f2132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.023290 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2eecf-728c-4022-834a-07f2937f2132 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.025809 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2eecf-728c-4022-834a-07f2937f2132 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:37.025809 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2eecf-728c-4022-834a-07f2937f2132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.027888 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c8f40-b38d-4a7c-81ff-20ee063386ab admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.029208 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2eecf-728c-4022-834a-07f2937f2132 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.041480 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c8f40-b38d-4a7c-81ff-20ee063386ab admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.047983 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 238/472] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:37.055909 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15dc4b-5563-4da7-b62b-658c447b64bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.056875 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15dc4b-5563-4da7-b62b-658c447b64bb admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.057232 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15dc4b-5563-4da7-b62b-658c447b64bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.057626 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15dc4b-5563-4da7-b62b-658c447b64bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.057867 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2eecf-728c-4022-834a-07f2937f2132 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.069918 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2eecf-728c-4022-834a-07f2937f2132 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.070102 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15dc4b-5563-4da7-b62b-658c447b64bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.072952 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15dc4b-5563-4da7-b62b-658c447b64bb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.076522 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40bed3-eb51-47bd-865b-6ba4a00ba866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.077595 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40bed3-eb51-47bd-865b-6ba4a00ba866 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.078076 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40bed3-eb51-47bd-865b-6ba4a00ba866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.078542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40bed3-eb51-47bd-865b-6ba4a00ba866 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.096769 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40bed3-eb51-47bd-865b-6ba4a00ba866 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.099456 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40bed3-eb51-47bd-865b-6ba4a00ba866 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.119122 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-6c40bed3-eb51-47bd-865b-6ba4a00ba866 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:37.119335 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-1b15dc4b-5563-4da7-b62b-658c447b64bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:37.120879 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 235/473] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:37.121279 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 239/474] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:37.126868 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15dc4b-5563-4da7-b62b-658c447b64bb admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.129678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40bed3-eb51-47bd-865b-6ba4a00ba866 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.140935 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40bed3-eb51-47bd-865b-6ba4a00ba866 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.146504 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3eef1-bdb1-4701-a119-a119705fe1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.147606 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3eef1-bdb1-4701-a119-a119705fe1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.148094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3eef1-bdb1-4701-a119-a119705fe1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.148615 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3eef1-bdb1-4701-a119-a119705fe1b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.149610 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3eef1-bdb1-4701-a119-a119705fe1b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:37.150012 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15dc4b-5563-4da7-b62b-658c447b64bb admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.150291 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3eef1-bdb1-4701-a119-a119705fe1b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.152457 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3eef1-bdb1-4701-a119-a119705fe1b0 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.166254 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdc912-3344-4539-bfb6-5ca3ffdb0063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.167065 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdc912-3344-4539-bfb6-5ca3ffdb0063 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.167344 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdc912-3344-4539-bfb6-5ca3ffdb0063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.167661 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdc912-3344-4539-bfb6-5ca3ffdb0063 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.167860 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 240/475] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:37.173058 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdc912-3344-4539-bfb6-5ca3ffdb0063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:37.173058 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdc912-3344-4539-bfb6-5ca3ffdb0063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.173058 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdc912-3344-4539-bfb6-5ca3ffdb0063 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.178406 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3eef1-bdb1-4701-a119-a119705fe1b0 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.189858 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3eef1-bdb1-4701-a119-a119705fe1b0 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.196181 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b613966-07b8-4be3-a265-c920b97679af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.197080 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 236/476] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:37.198027 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b613966-07b8-4be3-a265-c920b97679af admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.198518 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b613966-07b8-4be3-a265-c920b97679af admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.198994 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b613966-07b8-4be3-a265-c920b97679af admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.204928 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdc912-3344-4539-bfb6-5ca3ffdb0063 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.208712 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b613966-07b8-4be3-a265-c920b97679af admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.211187 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b613966-07b8-4be3-a265-c920b97679af admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.227362 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-7b613966-07b8-4be3-a265-c920b97679af admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 28 01:44:37.229421 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 241/477] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:37.236879 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdc912-3344-4539-bfb6-5ca3ffdb0063 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.238260 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b613966-07b8-4be3-a265-c920b97679af admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.249159 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b613966-07b8-4be3-a265-c920b97679af admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.249510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00b507-9d35-4a8c-b577-3a93a0705f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.250365 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00b507-9d35-4a8c-b577-3a93a0705f01 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.250605 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00b507-9d35-4a8c-b577-3a93a0705f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.250877 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00b507-9d35-4a8c-b577-3a93a0705f01 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.255362 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e6517-c75a-43e1-8d94-9bca4ecdcd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.256320 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e6517-c75a-43e1-8d94-9bca4ecdcd96 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.256841 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e6517-c75a-43e1-8d94-9bca4ecdcd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.257314 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e6517-c75a-43e1-8d94-9bca4ecdcd96 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.259462 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e6517-c75a-43e1-8d94-9bca4ecdcd96 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:37.259999 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e6517-c75a-43e1-8d94-9bca4ecdcd96 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.262098 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e6517-c75a-43e1-8d94-9bca4ecdcd96 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.270096 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00b507-9d35-4a8c-b577-3a93a0705f01 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.272073 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00b507-9d35-4a8c-b577-3a93a0705f01 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.284059 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 242/478] 10.222.0.96 () {56 vars in 1160 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:37.290663 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e6517-c75a-43e1-8d94-9bca4ecdcd96 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.307006 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-dc00b507-9d35-4a8c-b577-3a93a0705f01 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 28 01:44:37.308280 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 237/479] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:37.313964 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e6517-c75a-43e1-8d94-9bca4ecdcd96 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.315636 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00b507-9d35-4a8c-b577-3a93a0705f01 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.325544 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd834d-4e67-4600-bd46-a525f8560210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.326360 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd834d-4e67-4600-bd46-a525f8560210 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.326640 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd834d-4e67-4600-bd46-a525f8560210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.326918 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd834d-4e67-4600-bd46-a525f8560210 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.334695 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00b507-9d35-4a8c-b577-3a93a0705f01 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.346016 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd834d-4e67-4600-bd46-a525f8560210 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.347876 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd834d-4e67-4600-bd46-a525f8560210 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.351424 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab08ea-77be-4217-97d1-e97d46de9db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.352158 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab08ea-77be-4217-97d1-e97d46de9db6 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.352439 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab08ea-77be-4217-97d1-e97d46de9db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.352718 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab08ea-77be-4217-97d1-e97d46de9db6 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.353578 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab08ea-77be-4217-97d1-e97d46de9db6 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:37.353888 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab08ea-77be-4217-97d1-e97d46de9db6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.355739 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab08ea-77be-4217-97d1-e97d46de9db6 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.386909 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-f7cd834d-4e67-4600-bd46-a525f8560210 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:37.388177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 243/480] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:37.395220 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd834d-4e67-4600-bd46-a525f8560210 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.397583 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 238/481] 10.222.0.96 () {56 vars in 1158 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:37.404556 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab08ea-77be-4217-97d1-e97d46de9db6 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.413745 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd834d-4e67-4600-bd46-a525f8560210 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.418938 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82257394-d007-4a12-822f-7825a58262ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.419634 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82257394-d007-4a12-822f-7825a58262ee admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.419916 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82257394-d007-4a12-822f-7825a58262ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.420190 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82257394-d007-4a12-822f-7825a58262ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.421018 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82257394-d007-4a12-822f-7825a58262ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:37.421362 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82257394-d007-4a12-822f-7825a58262ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.421739 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab08ea-77be-4217-97d1-e97d46de9db6 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.422975 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82257394-d007-4a12-822f-7825a58262ee admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.427278 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fe39d-a297-4432-b065-40f8950c4213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.428251 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fe39d-a297-4432-b065-40f8950c4213 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.428689 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fe39d-a297-4432-b065-40f8950c4213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.429119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fe39d-a297-4432-b065-40f8950c4213 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.436589 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 244/482] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:37.442522 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9e4df-d8e6-4a61-a3d1-997e246493f6 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.442522 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9e4df-d8e6-4a61-a3d1-997e246493f6 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.442776 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9e4df-d8e6-4a61-a3d1-997e246493f6 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.443363 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fe39d-a297-4432-b065-40f8950c4213 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.444597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 245/483] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:37.451465 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9e4df-d8e6-4a61-a3d1-997e246493f6 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.451654 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fe39d-a297-4432-b065-40f8950c4213 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.470910 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9e4df-d8e6-4a61-a3d1-997e246493f6 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.475534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd6df1-42db-4925-8463-2a3ec7d8e533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.476501 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd6df1-42db-4925-8463-2a3ec7d8e533 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.477616 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd6df1-42db-4925-8463-2a3ec7d8e533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.477971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd6df1-42db-4925-8463-2a3ec7d8e533 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.480855 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-740fe39d-a297-4432-b065-40f8950c4213 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:37.483223 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 239/484] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:37.484790 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57ead8-1e24-4d53-9f29-c27691114c01 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.485241 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57ead8-1e24-4d53-9f29-c27691114c01 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.485976 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57ead8-1e24-4d53-9f29-c27691114c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.486670 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd6df1-42db-4925-8463-2a3ec7d8e533 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.488910 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd6df1-42db-4925-8463-2a3ec7d8e533 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.504935 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-e6dd6df1-42db-4925-8463-2a3ec7d8e533 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:37.506268 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 246/485] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:37.507099 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd6df1-42db-4925-8463-2a3ec7d8e533 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.509503 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-6e57ead8-1e24-4d53-9f29-c27691114c01 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:37.511295 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-6e57ead8-1e24-4d53-9f29-c27691114c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:37.520389 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 240/486] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:37 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:37.529101 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57ead8-1e24-4d53-9f29-c27691114c01 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.531941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd6df1-42db-4925-8463-2a3ec7d8e533 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.543326 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43536b-7efb-4fa9-991f-a23cb4ae85ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.544096 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43536b-7efb-4fa9-991f-a23cb4ae85ba admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.544524 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43536b-7efb-4fa9-991f-a23cb4ae85ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.544892 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43536b-7efb-4fa9-991f-a23cb4ae85ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.545803 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43536b-7efb-4fa9-991f-a23cb4ae85ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:37.546964 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43536b-7efb-4fa9-991f-a23cb4ae85ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.549107 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57ead8-1e24-4d53-9f29-c27691114c01 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.551746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43536b-7efb-4fa9-991f-a23cb4ae85ba admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.557783 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd5b93-fb49-48ee-b16f-51078f1f83ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.558655 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd5b93-fb49-48ee-b16f-51078f1f83ef admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.559073 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd5b93-fb49-48ee-b16f-51078f1f83ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.559505 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd5b93-fb49-48ee-b16f-51078f1f83ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.560422 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd5b93-fb49-48ee-b16f-51078f1f83ef admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:37.560898 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd5b93-fb49-48ee-b16f-51078f1f83ef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.563915 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd5b93-fb49-48ee-b16f-51078f1f83ef admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.566832 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 247/487] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:37.567731 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43536b-7efb-4fa9-991f-a23cb4ae85ba admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.579267 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 241/488] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:37.579555 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43536b-7efb-4fa9-991f-a23cb4ae85ba admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.580614 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd5b93-fb49-48ee-b16f-51078f1f83ef admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.589981 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f03c6-174f-4529-bcea-32a2af611157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.590928 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f03c6-174f-4529-bcea-32a2af611157 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.591282 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f03c6-174f-4529-bcea-32a2af611157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.591630 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd5b93-fb49-48ee-b16f-51078f1f83ef admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.591744 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f03c6-174f-4529-bcea-32a2af611157 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.597024 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c9c99-f298-4565-ad65-2bf6c1d27ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.598294 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c9c99-f298-4565-ad65-2bf6c1d27ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.598873 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c9c99-f298-4565-ad65-2bf6c1d27ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.599280 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c9c99-f298-4565-ad65-2bf6c1d27ac3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.604389 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f03c6-174f-4529-bcea-32a2af611157 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:37.607988 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c9c99-f298-4565-ad65-2bf6c1d27ac3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.610160 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c9c99-f298-4565-ad65-2bf6c1d27ac3 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.611922 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-631f03c6-174f-4529-bcea-32a2af611157 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:44:37.613319 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 248/489] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:37.614121 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f03c6-174f-4529-bcea-32a2af611157 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.626445 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f03c6-174f-4529-bcea-32a2af611157 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.626982 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-6a7c9c99-f298-4565-ad65-2bf6c1d27ac3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:37.628448 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 242/490] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:37.636733 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c9c99-f298-4565-ad65-2bf6c1d27ac3 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.638369 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9fa92-6264-498b-87a8-fe7df10bc6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.639683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9fa92-6264-498b-87a8-fe7df10bc6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.640132 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9fa92-6264-498b-87a8-fe7df10bc6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.640573 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9fa92-6264-498b-87a8-fe7df10bc6e6 admin admin] PATH_INFO: `/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/4acc32735f0a418ba5620f6225500402/roles/4d7fce301eec49a7a54390167747fe24` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.652924 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c9c99-f298-4565-ad65-2bf6c1d27ac3 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.660876 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d89795-4d68-4043-b7bc-1199ffdad192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.661666 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9fa92-6264-498b-87a8-fe7df10bc6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356ecb479ba24136a7c38cb5a58a0a18, user_id=4acc32735f0a418ba5620f6225500402, role_id=4d7fce301eec49a7a54390167747fe24)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.662182 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d89795-4d68-4043-b7bc-1199ffdad192 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.662600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d89795-4d68-4043-b7bc-1199ffdad192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.663015 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d89795-4d68-4043-b7bc-1199ffdad192 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.663929 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d89795-4d68-4043-b7bc-1199ffdad192 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:37.664566 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d89795-4d68-4043-b7bc-1199ffdad192 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.664771 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9fa92-6264-498b-87a8-fe7df10bc6e6 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.666697 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d89795-4d68-4043-b7bc-1199ffdad192 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.680828 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 249/491] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:44:37 2022] PUT /identity/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/4acc32735f0a418ba5620f6225500402/roles/4d7fce301eec49a7a54390167747fe24 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:44:37.683453 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 243/492] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:37.684602 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d89795-4d68-4043-b7bc-1199ffdad192 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.689950 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9fa92-6264-498b-87a8-fe7df10bc6e6 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.696961 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d89795-4d68-4043-b7bc-1199ffdad192 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.774875 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9fa92-6264-498b-87a8-fe7df10bc6e6 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.786022 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ee0b5-9b26-4170-b910-d94b8e91bd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.789928 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ee0b5-9b26-4170-b910-d94b8e91bd68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.790389 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ee0b5-9b26-4170-b910-d94b8e91bd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.790820 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ee0b5-9b26-4170-b910-d94b8e91bd68 admin admin] PATH_INFO: `/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/eb36af30d0fe4369b4459f333cb64a36/roles/4d7fce301eec49a7a54390167747fe24` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.807357 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac4a0a-cdc9-4524-aff1-5b812871e4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.808041 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac4a0a-cdc9-4524-aff1-5b812871e4ef admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.808380 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac4a0a-cdc9-4524-aff1-5b812871e4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.808655 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac4a0a-cdc9-4524-aff1-5b812871e4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.810101 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac4a0a-cdc9-4524-aff1-5b812871e4ef admin admin] RBAC: Adding query filter params (name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:37.810500 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac4a0a-cdc9-4524-aff1-5b812871e4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.812418 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac4a0a-cdc9-4524-aff1-5b812871e4ef admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.823758 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 244/493] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:37.825834 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ee0b5-9b26-4170-b910-d94b8e91bd68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356ecb479ba24136a7c38cb5a58a0a18, user_id=eb36af30d0fe4369b4459f333cb64a36, role_id=4d7fce301eec49a7a54390167747fe24)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.830499 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac4a0a-cdc9-4524-aff1-5b812871e4ef admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.831584 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ee0b5-9b26-4170-b910-d94b8e91bd68 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.850424 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac4a0a-cdc9-4524-aff1-5b812871e4ef admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:37.861091 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 250/494] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:44:37 2022] PUT /identity/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/eb36af30d0fe4369b4459f333cb64a36/roles/4d7fce301eec49a7a54390167747fe24 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:44:37.864421 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a56632-c527-4664-8055-47119da802ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:37.865336 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a56632-c527-4664-8055-47119da802ee admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:37.865625 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a56632-c527-4664-8055-47119da802ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:37.865950 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a56632-c527-4664-8055-47119da802ee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:37.880020 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a56632-c527-4664-8055-47119da802ee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:37.882116 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a56632-c527-4664-8055-47119da802ee admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:37.903632 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-35a56632-c527-4664-8055-47119da802ee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:37.905116 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 245/495] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:37.914563 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ee0b5-9b26-4170-b910-d94b8e91bd68 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:37.998632 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ee0b5-9b26-4170-b910-d94b8e91bd68 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:38.003682 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f9917-485b-4cd3-92a5-74c212b84dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:38.004353 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f9917-485b-4cd3-92a5-74c212b84dee admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:38.004683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f9917-485b-4cd3-92a5-74c212b84dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:38.004990 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f9917-485b-4cd3-92a5-74c212b84dee admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:38.005725 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f9917-485b-4cd3-92a5-74c212b84dee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:38.006030 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f9917-485b-4cd3-92a5-74c212b84dee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:38.007672 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f9917-485b-4cd3-92a5-74c212b84dee admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:38.022135 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 251/496] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:38.030050 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a56632-c527-4664-8055-47119da802ee admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:38.043861 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a56632-c527-4664-8055-47119da802ee admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:38.049067 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232df89-85a1-4d40-b099-2367449c31e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:38.050028 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232df89-85a1-4d40-b099-2367449c31e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:38.050377 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232df89-85a1-4d40-b099-2367449c31e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:38.050719 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232df89-85a1-4d40-b099-2367449c31e4 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:38.062616 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232df89-85a1-4d40-b099-2367449c31e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:38.064892 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232df89-85a1-4d40-b099-2367449c31e4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:38.084018 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-8232df89-85a1-4d40-b099-2367449c31e4 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:44:38.085835 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 246/497] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:38.092684 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f9917-485b-4cd3-92a5-74c212b84dee admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:38.104723 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f9917-485b-4cd3-92a5-74c212b84dee admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:38.109757 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec689d4-2fca-4951-b53a-3b0f54dc090e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:38.110470 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec689d4-2fca-4951-b53a-3b0f54dc090e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:38.110821 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec689d4-2fca-4951-b53a-3b0f54dc090e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:38.111163 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec689d4-2fca-4951-b53a-3b0f54dc090e admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:38.112067 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec689d4-2fca-4951-b53a-3b0f54dc090e admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:38.112442 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec689d4-2fca-4951-b53a-3b0f54dc090e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:38.114415 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec689d4-2fca-4951-b53a-3b0f54dc090e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:38.145737 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 252/498] 10.222.0.96 () {56 vars in 1156 bytes} [Fri Jan 28 01:44:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:38.152642 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232df89-85a1-4d40-b099-2367449c31e4 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:38.165714 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232df89-85a1-4d40-b099-2367449c31e4 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:38.178702 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954160d-0d62-48a1-bb79-93b3312c02d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:38.179488 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954160d-0d62-48a1-bb79-93b3312c02d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:38.179849 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954160d-0d62-48a1-bb79-93b3312c02d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:38.180224 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954160d-0d62-48a1-bb79-93b3312c02d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:38.196857 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954160d-0d62-48a1-bb79-93b3312c02d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:38.196857 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954160d-0d62-48a1-bb79-93b3312c02d5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:38.210252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 247/499] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:38 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:38.217218 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec689d4-2fca-4951-b53a-3b0f54dc090e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:38.229630 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec689d4-2fca-4951-b53a-3b0f54dc090e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:38.234510 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c3763-81e8-43c5-ab09-cd97d64aa56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:38.235402 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c3763-81e8-43c5-ab09-cd97d64aa56d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:38.235684 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c3763-81e8-43c5-ab09-cd97d64aa56d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:38.235956 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c3763-81e8-43c5-ab09-cd97d64aa56d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:38.253098 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c3763-81e8-43c5-ab09-cd97d64aa56d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:38.255081 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c3763-81e8-43c5-ab09-cd97d64aa56d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:38.279941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-3e4c3763-81e8-43c5-ab09-cd97d64aa56d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:38.281402 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 253/500] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:38.287955 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954160d-0d62-48a1-bb79-93b3312c02d5 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:38.302331 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954160d-0d62-48a1-bb79-93b3312c02d5 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:38.311999 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee78968-89bc-41c3-a8f8-0aba9d67c4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:38.312956 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee78968-89bc-41c3-a8f8-0aba9d67c4ba admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:38.313385 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee78968-89bc-41c3-a8f8-0aba9d67c4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:38.313801 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee78968-89bc-41c3-a8f8-0aba9d67c4ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:38.314704 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee78968-89bc-41c3-a8f8-0aba9d67c4ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:38.315155 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee78968-89bc-41c3-a8f8-0aba9d67c4ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:38.316912 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee78968-89bc-41c3-a8f8-0aba9d67c4ba admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:38.339242 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 248/501] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:38.345838 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c3763-81e8-43c5-ab09-cd97d64aa56d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:38.362454 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c3763-81e8-43c5-ab09-cd97d64aa56d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:38.370728 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3f4bb-77cf-405b-b125-21aa42f16a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:38.371580 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3f4bb-77cf-405b-b125-21aa42f16a34 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:38.371907 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3f4bb-77cf-405b-b125-21aa42f16a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:38.372218 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3f4bb-77cf-405b-b125-21aa42f16a34 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:38.385037 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3f4bb-77cf-405b-b125-21aa42f16a34 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:38.387085 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3f4bb-77cf-405b-b125-21aa42f16a34 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:38.402914 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-f3d3f4bb-77cf-405b-b125-21aa42f16a34 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:38.404123 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 254/502] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:38.410951 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee78968-89bc-41c3-a8f8-0aba9d67c4ba admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:38.436319 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee78968-89bc-41c3-a8f8-0aba9d67c4ba admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:38.447079 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bcc02-eee9-4451-a2a9-c3b86579cbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:38.447751 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bcc02-eee9-4451-a2a9-c3b86579cbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:38.448035 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bcc02-eee9-4451-a2a9-c3b86579cbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:38.448312 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bcc02-eee9-4451-a2a9-c3b86579cbb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:38.449156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bcc02-eee9-4451-a2a9-c3b86579cbb2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:38.449471 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bcc02-eee9-4451-a2a9-c3b86579cbb2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:38.451313 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bcc02-eee9-4451-a2a9-c3b86579cbb2 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:38.470204 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 249/503] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:38.476926 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3f4bb-77cf-405b-b125-21aa42f16a34 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:38.495988 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3f4bb-77cf-405b-b125-21aa42f16a34 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:38.504736 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e24e9-a439-40a4-babf-19bc10579fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:38.505462 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e24e9-a439-40a4-babf-19bc10579fbb admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:38.505738 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e24e9-a439-40a4-babf-19bc10579fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:38.506007 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e24e9-a439-40a4-babf-19bc10579fbb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:38.506880 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e24e9-a439-40a4-babf-19bc10579fbb admin admin] RBAC: Adding query filter params (role.id=4d7fce301eec49a7a54390167747fe24, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=83a2c3b2815f46b0ac27944f004c4821) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:38.507185 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e24e9-a439-40a4-babf-19bc10579fbb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:38.509849 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e24e9-a439-40a4-babf-19bc10579fbb admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:38.521154 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 255/504] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:38 2022] GET /identity/v3/role_assignments?user.id=83a2c3b2815f46b0ac27944f004c4821&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=4d7fce301eec49a7a54390167747fe24 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:39.620470 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d0876-ce08-4da0-9b6e-fe8f26e04ccc None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:39.621051 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d0876-ce08-4da0-9b6e-fe8f26e04ccc None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:39.621275 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d0876-ce08-4da0-9b6e-fe8f26e04ccc None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:39.624006 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 250/505] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:39.631279 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14fb44-40d3-4c35-a202-16e91de20a9c None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:39.631790 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14fb44-40d3-4c35-a202-16e91de20a9c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:39.631866 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14fb44-40d3-4c35-a202-16e91de20a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:39.668821 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-1a14fb44-40d3-4c35-a202-16e91de20a9c None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:39.670068 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-1a14fb44-40d3-4c35-a202-16e91de20a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:39.684904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 256/506] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:39 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:39.728034 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d0876-ce08-4da0-9b6e-fe8f26e04ccc None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:39.740508 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d0876-ce08-4da0-9b6e-fe8f26e04ccc None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:39.747382 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb1772-fa80-4c98-8b08-a3a8ee71acc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:39.748363 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb1772-fa80-4c98-8b08-a3a8ee71acc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:39.748662 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb1772-fa80-4c98-8b08-a3a8ee71acc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:39.749044 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb1772-fa80-4c98-8b08-a3a8ee71acc9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:39.761672 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb1772-fa80-4c98-8b08-a3a8ee71acc9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:39.769830 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-fedb1772-fa80-4c98-8b08-a3a8ee71acc9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:44:39.771608 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 251/507] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:39.779798 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14fb44-40d3-4c35-a202-16e91de20a9c None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:39.791450 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14fb44-40d3-4c35-a202-16e91de20a9c None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:39.796019 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4833c18-4516-437f-a1a7-e39a07c4113c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:39.796714 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4833c18-4516-437f-a1a7-e39a07c4113c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:39.797018 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4833c18-4516-437f-a1a7-e39a07c4113c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:39.797311 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4833c18-4516-437f-a1a7-e39a07c4113c admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:39.798052 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4833c18-4516-437f-a1a7-e39a07c4113c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:39.798352 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4833c18-4516-437f-a1a7-e39a07c4113c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:39.801022 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4833c18-4516-437f-a1a7-e39a07c4113c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:39.816483 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 257/508] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:44:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:39.825338 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb1772-fa80-4c98-8b08-a3a8ee71acc9 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:39.836432 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb1772-fa80-4c98-8b08-a3a8ee71acc9 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:39.849390 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63206652-b0d5-4646-bae3-597deaba4ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:39.850190 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63206652-b0d5-4646-bae3-597deaba4ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:39.850467 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63206652-b0d5-4646-bae3-597deaba4ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:39.850736 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63206652-b0d5-4646-bae3-597deaba4ea5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:39.864192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63206652-b0d5-4646-bae3-597deaba4ea5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:39.866704 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63206652-b0d5-4646-bae3-597deaba4ea5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:39.885661 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-63206652-b0d5-4646-bae3-597deaba4ea5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:39.887201 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 252/509] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:39.893342 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4833c18-4516-437f-a1a7-e39a07c4113c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:39.904097 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4833c18-4516-437f-a1a7-e39a07c4113c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:39.908973 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d586beb-e7b8-4c2f-ac7c-01dc2f5d3b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:39.909648 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d586beb-e7b8-4c2f-ac7c-01dc2f5d3b78 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:39.909920 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d586beb-e7b8-4c2f-ac7c-01dc2f5d3b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:39.910186 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d586beb-e7b8-4c2f-ac7c-01dc2f5d3b78 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:39.910919 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d586beb-e7b8-4c2f-ac7c-01dc2f5d3b78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:39.911216 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d586beb-e7b8-4c2f-ac7c-01dc2f5d3b78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:39.912901 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d586beb-e7b8-4c2f-ac7c-01dc2f5d3b78 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:39.934285 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 258/510] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:39.940456 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63206652-b0d5-4646-bae3-597deaba4ea5 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:39.950975 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63206652-b0d5-4646-bae3-597deaba4ea5 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:39.955618 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f2f3f-fb5b-4ea5-bb9d-6d0cc17492f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:39.956418 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f2f3f-fb5b-4ea5-bb9d-6d0cc17492f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:39.956696 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f2f3f-fb5b-4ea5-bb9d-6d0cc17492f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:39.957004 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f2f3f-fb5b-4ea5-bb9d-6d0cc17492f5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:39.965315 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f2f3f-fb5b-4ea5-bb9d-6d0cc17492f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:39.967407 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f2f3f-fb5b-4ea5-bb9d-6d0cc17492f5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:39.982411 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-7f9f2f3f-fb5b-4ea5-bb9d-6d0cc17492f5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:44:39.983936 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 253/511] 10.222.0.96 () {56 vars in 1114 bytes} [Fri Jan 28 01:44:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:39.989993 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d586beb-e7b8-4c2f-ac7c-01dc2f5d3b78 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.000916 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d586beb-e7b8-4c2f-ac7c-01dc2f5d3b78 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.005890 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84dcf5-4676-4676-8576-152e87880eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.006751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84dcf5-4676-4676-8576-152e87880eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.007098 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84dcf5-4676-4676-8576-152e87880eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.007479 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84dcf5-4676-4676-8576-152e87880eb0 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.009116 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84dcf5-4676-4676-8576-152e87880eb0 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:40.010789 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828bc86-4973-4751-aae2-d02eca120478 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.010972 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84dcf5-4676-4676-8576-152e87880eb0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:40.011259 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828bc86-4973-4751-aae2-d02eca120478 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.011621 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828bc86-4973-4751-aae2-d02eca120478 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.012961 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84dcf5-4676-4676-8576-152e87880eb0 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:40.014006 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 254/512] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:40.023980 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309fa2d-c7f3-4891-a8b5-02392e8485de None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.024322 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309fa2d-c7f3-4891-a8b5-02392e8485de None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.024597 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309fa2d-c7f3-4891-a8b5-02392e8485de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.051268 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-e309fa2d-c7f3-4891-a8b5-02392e8485de None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:40.052498 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-e309fa2d-c7f3-4891-a8b5-02392e8485de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:40.061450 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 259/513] 10.222.0.96 () {56 vars in 1154 bytes} [Fri Jan 28 01:44:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:40.067378 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84dcf5-4676-4676-8576-152e87880eb0 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.072891 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 255/514] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:40 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:40.086403 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84dcf5-4676-4676-8576-152e87880eb0 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.102764 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb602a5-19d6-479a-b868-ac7bf7102b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.103418 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb602a5-19d6-479a-b868-ac7bf7102b15 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.103697 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb602a5-19d6-479a-b868-ac7bf7102b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.103965 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb602a5-19d6-479a-b868-ac7bf7102b15 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.110058 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309fa2d-c7f3-4891-a8b5-02392e8485de None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.121365 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb602a5-19d6-479a-b868-ac7bf7102b15 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:40.122365 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309fa2d-c7f3-4891-a8b5-02392e8485de None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.123204 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb602a5-19d6-479a-b868-ac7bf7102b15 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:40.136341 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ac66c-c7c0-406f-b312-38cceb676e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.137073 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ac66c-c7c0-406f-b312-38cceb676e92 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.137349 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ac66c-c7c0-406f-b312-38cceb676e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.138472 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ac66c-c7c0-406f-b312-38cceb676e92 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.139343 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 260/515] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:40 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:40.152434 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb602a5-19d6-479a-b868-ac7bf7102b15 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.157074 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ac66c-c7c0-406f-b312-38cceb676e92 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:40.164166 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-8c6ac66c-c7c0-406f-b312-38cceb676e92 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:44:40.167174 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 256/516] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:40.170133 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb602a5-19d6-479a-b868-ac7bf7102b15 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.178806 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ac66c-c7c0-406f-b312-38cceb676e92 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.180152 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a35a2a-d8c1-4a1a-870c-8e0c53ecd5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.181024 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a35a2a-d8c1-4a1a-870c-8e0c53ecd5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.181485 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a35a2a-d8c1-4a1a-870c-8e0c53ecd5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.181757 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a35a2a-d8c1-4a1a-870c-8e0c53ecd5c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.190779 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ac66c-c7c0-406f-b312-38cceb676e92 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.197558 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f774f5c-c4bd-4ca2-9edb-f34bef966490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.198372 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f774f5c-c4bd-4ca2-9edb-f34bef966490 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.198755 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f774f5c-c4bd-4ca2-9edb-f34bef966490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.199125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f774f5c-c4bd-4ca2-9edb-f34bef966490 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.199969 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f774f5c-c4bd-4ca2-9edb-f34bef966490 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:40.200395 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f774f5c-c4bd-4ca2-9edb-f34bef966490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:40.202186 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f774f5c-c4bd-4ca2-9edb-f34bef966490 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:40.206091 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a35a2a-d8c1-4a1a-870c-8e0c53ecd5c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:40.208040 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a35a2a-d8c1-4a1a-870c-8e0c53ecd5c0 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:40.215970 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 257/517] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:44:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:40.226086 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f774f5c-c4bd-4ca2-9edb-f34bef966490 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.244700 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-c2a35a2a-d8c1-4a1a-870c-8e0c53ecd5c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:40.248441 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f774f5c-c4bd-4ca2-9edb-f34bef966490 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.254558 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 261/518] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:40.256818 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a35a2a-d8c1-4a1a-870c-8e0c53ecd5c0 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.261588 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72251519-8ed3-4035-9969-3d4515fd6793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.262403 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72251519-8ed3-4035-9969-3d4515fd6793 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.264079 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72251519-8ed3-4035-9969-3d4515fd6793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.264362 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72251519-8ed3-4035-9969-3d4515fd6793 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.277698 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a35a2a-d8c1-4a1a-870c-8e0c53ecd5c0 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.285653 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72251519-8ed3-4035-9969-3d4515fd6793 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:40.287175 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab680ddd-706b-409d-ad05-ecbadec77cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.287833 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab680ddd-706b-409d-ad05-ecbadec77cbd admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.289927 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72251519-8ed3-4035-9969-3d4515fd6793 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:40.290488 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab680ddd-706b-409d-ad05-ecbadec77cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.290774 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab680ddd-706b-409d-ad05-ecbadec77cbd admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.292617 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab680ddd-706b-409d-ad05-ecbadec77cbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:40.293019 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab680ddd-706b-409d-ad05-ecbadec77cbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:40.295093 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab680ddd-706b-409d-ad05-ecbadec77cbd admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:40.319978 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-72251519-8ed3-4035-9969-3d4515fd6793 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:40.321236 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 258/519] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:40.328168 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 262/520] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:40.329193 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72251519-8ed3-4035-9969-3d4515fd6793 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.335436 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab680ddd-706b-409d-ad05-ecbadec77cbd admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.346897 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab680ddd-706b-409d-ad05-ecbadec77cbd admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.350887 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72251519-8ed3-4035-9969-3d4515fd6793 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.355780 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730734e-155d-4e9e-a4e1-895c423032d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.356445 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730734e-155d-4e9e-a4e1-895c423032d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.356723 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730734e-155d-4e9e-a4e1-895c423032d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.357014 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730734e-155d-4e9e-a4e1-895c423032d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.357737 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730734e-155d-4e9e-a4e1-895c423032d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:40.358032 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730734e-155d-4e9e-a4e1-895c423032d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:40.359616 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730734e-155d-4e9e-a4e1-895c423032d4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:40.368819 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80436e56-c7f4-47dc-a1e3-29251f109226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.368819 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80436e56-c7f4-47dc-a1e3-29251f109226 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.368819 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80436e56-c7f4-47dc-a1e3-29251f109226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.368819 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80436e56-c7f4-47dc-a1e3-29251f109226 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.375375 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 263/521] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:40.381238 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730734e-155d-4e9e-a4e1-895c423032d4 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.382390 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80436e56-c7f4-47dc-a1e3-29251f109226 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:40.385178 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80436e56-c7f4-47dc-a1e3-29251f109226 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:40.395043 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730734e-155d-4e9e-a4e1-895c423032d4 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.406993 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702ecbc-a571-4584-bfdf-2658e62dc719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.407786 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702ecbc-a571-4584-bfdf-2658e62dc719 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.409471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702ecbc-a571-4584-bfdf-2658e62dc719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.409757 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702ecbc-a571-4584-bfdf-2658e62dc719 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.424123 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-80436e56-c7f4-47dc-a1e3-29251f109226 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:40.426906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 259/522] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:40.427894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702ecbc-a571-4584-bfdf-2658e62dc719 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:40.430854 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702ecbc-a571-4584-bfdf-2658e62dc719 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:40.433675 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80436e56-c7f4-47dc-a1e3-29251f109226 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.451225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80436e56-c7f4-47dc-a1e3-29251f109226 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.466210 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-a702ecbc-a571-4584-bfdf-2658e62dc719 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 28 01:44:40.468430 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00770-e0ca-424d-855c-99d5085103cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.469334 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00770-e0ca-424d-855c-99d5085103cf admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.469845 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00770-e0ca-424d-855c-99d5085103cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.470348 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00770-e0ca-424d-855c-99d5085103cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.471285 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c00770-e0ca-424d-855c-99d5085103cf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:40.471593 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c00770-e0ca-424d-855c-99d5085103cf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:40.474600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c00770-e0ca-424d-855c-99d5085103cf admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:40.477526 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 264/523] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:40.482490 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702ecbc-a571-4584-bfdf-2658e62dc719 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.501547 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702ecbc-a571-4584-bfdf-2658e62dc719 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.502226 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 260/524] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:40.505716 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00770-e0ca-424d-855c-99d5085103cf admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.511624 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a999a-0667-4f65-ab96-e28337265619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.512299 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a999a-0667-4f65-ab96-e28337265619 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.512580 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a999a-0667-4f65-ab96-e28337265619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.514565 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a999a-0667-4f65-ab96-e28337265619 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.516363 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a999a-0667-4f65-ab96-e28337265619 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:40.516686 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a999a-0667-4f65-ab96-e28337265619 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:40.522990 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a999a-0667-4f65-ab96-e28337265619 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:40.524893 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00770-e0ca-424d-855c-99d5085103cf admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.542191 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9de97-3e2e-4147-99d4-444dd42380ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.542949 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9de97-3e2e-4147-99d4-444dd42380ea admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.543234 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9de97-3e2e-4147-99d4-444dd42380ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.543510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9de97-3e2e-4147-99d4-444dd42380ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.544439 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9de97-3e2e-4147-99d4-444dd42380ea admin admin] RBAC: Adding query filter params (role.id=4d7fce301eec49a7a54390167747fe24, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=cc85f5db9c3c47fca68ebab33b0bb73c) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:40.544767 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9de97-3e2e-4147-99d4-444dd42380ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:40.546207 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 265/525] 10.222.0.96 () {56 vars in 1158 bytes} [Fri Jan 28 01:44:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:40.548173 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9de97-3e2e-4147-99d4-444dd42380ea admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:40.557735 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a999a-0667-4f65-ab96-e28337265619 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.559803 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 261/526] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:40 2022] GET /identity/v3/role_assignments?user.id=cc85f5db9c3c47fca68ebab33b0bb73c&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=4d7fce301eec49a7a54390167747fe24 => generated 608 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:40.582068 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a999a-0667-4f65-ab96-e28337265619 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.587864 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1c420-e628-475c-a07b-61a79e636199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.588890 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1c420-e628-475c-a07b-61a79e636199 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.589373 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1c420-e628-475c-a07b-61a79e636199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.589826 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1c420-e628-475c-a07b-61a79e636199 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.605989 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1c420-e628-475c-a07b-61a79e636199 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:40.607797 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1c420-e628-475c-a07b-61a79e636199 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:40.629414 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 266/527] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:40 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:44:40.636103 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9de97-3e2e-4147-99d4-444dd42380ea admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.650047 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9de97-3e2e-4147-99d4-444dd42380ea admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.657272 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05573980-0aa5-4ce5-8c11-7e18a9ada999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.658810 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05573980-0aa5-4ce5-8c11-7e18a9ada999 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.659248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05573980-0aa5-4ce5-8c11-7e18a9ada999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.659667 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05573980-0aa5-4ce5-8c11-7e18a9ada999 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.679581 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05573980-0aa5-4ce5-8c11-7e18a9ada999 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:40.681814 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05573980-0aa5-4ce5-8c11-7e18a9ada999 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:40.705945 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-05573980-0aa5-4ce5-8c11-7e18a9ada999 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:40.707441 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 262/528] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:40.714697 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1c420-e628-475c-a07b-61a79e636199 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.731480 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1c420-e628-475c-a07b-61a79e636199 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.745744 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0181daa-f302-45c2-97e3-cd78c52fa8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.746431 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0181daa-f302-45c2-97e3-cd78c52fa8ff admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.746710 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0181daa-f302-45c2-97e3-cd78c52fa8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.746981 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0181daa-f302-45c2-97e3-cd78c52fa8ff admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.747734 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0181daa-f302-45c2-97e3-cd78c52fa8ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:40.748035 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0181daa-f302-45c2-97e3-cd78c52fa8ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:40.749738 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0181daa-f302-45c2-97e3-cd78c52fa8ff admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:40.766480 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 267/529] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:40.774748 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05573980-0aa5-4ce5-8c11-7e18a9ada999 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.790830 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05573980-0aa5-4ce5-8c11-7e18a9ada999 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.797074 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d047c-84db-463c-9fc9-afd772ff628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.797930 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d047c-84db-463c-9fc9-afd772ff628c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.798205 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d047c-84db-463c-9fc9-afd772ff628c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.798521 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d047c-84db-463c-9fc9-afd772ff628c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.806428 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d047c-84db-463c-9fc9-afd772ff628c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:40.808480 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d047c-84db-463c-9fc9-afd772ff628c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:40.824139 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-828d047c-84db-463c-9fc9-afd772ff628c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:40.825721 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 263/530] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:40.831947 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0181daa-f302-45c2-97e3-cd78c52fa8ff admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.848332 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0181daa-f302-45c2-97e3-cd78c52fa8ff admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.848768 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b3130-b267-4a37-9d0f-a3d8a3908a26 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.849192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b3130-b267-4a37-9d0f-a3d8a3908a26 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.849464 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b3130-b267-4a37-9d0f-a3d8a3908a26 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.857902 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 264/531] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:40.858086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492774ac-5a36-4d1d-a092-92a0eb7a1cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.858086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492774ac-5a36-4d1d-a092-92a0eb7a1cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.858086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492774ac-5a36-4d1d-a092-92a0eb7a1cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.858086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492774ac-5a36-4d1d-a092-92a0eb7a1cb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.858380 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492774ac-5a36-4d1d-a092-92a0eb7a1cb0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:40.860815 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492774ac-5a36-4d1d-a092-92a0eb7a1cb0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:40.860815 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492774ac-5a36-4d1d-a092-92a0eb7a1cb0 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:40.864653 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356bcc2-0783-459e-bb7c-66cbabd5fd69 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.864957 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356bcc2-0783-459e-bb7c-66cbabd5fd69 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.865223 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356bcc2-0783-459e-bb7c-66cbabd5fd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.885211 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-6356bcc2-0783-459e-bb7c-66cbabd5fd69 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:40.886431 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-6356bcc2-0783-459e-bb7c-66cbabd5fd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:40.892896 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 268/532] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:40.896829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492774ac-5a36-4d1d-a092-92a0eb7a1cb0 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.907320 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 265/533] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:40 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:40.908260 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492774ac-5a36-4d1d-a092-92a0eb7a1cb0 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.913061 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417dff6b-6df3-491e-9968-81f77f5757ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.913830 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dff6b-6df3-491e-9968-81f77f5757ff admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.914235 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dff6b-6df3-491e-9968-81f77f5757ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.915278 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dff6b-6df3-491e-9968-81f77f5757ff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.916281 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417dff6b-6df3-491e-9968-81f77f5757ff admin admin] RBAC: Adding query filter params (role.id=4d7fce301eec49a7a54390167747fe24, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=07298acc960e4154be7c79f2368a1952) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:40.916599 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417dff6b-6df3-491e-9968-81f77f5757ff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:40.918808 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417dff6b-6df3-491e-9968-81f77f5757ff admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:40.926245 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 269/534] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:40 2022] GET /identity/v3/role_assignments?user.id=07298acc960e4154be7c79f2368a1952&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=4d7fce301eec49a7a54390167747fe24 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:40.947794 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356bcc2-0783-459e-bb7c-66cbabd5fd69 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:40.958699 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356bcc2-0783-459e-bb7c-66cbabd5fd69 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:40.967556 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057b8b9-fc19-46fb-933d-c7181cba458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:40.968506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057b8b9-fc19-46fb-933d-c7181cba458c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:40.968787 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057b8b9-fc19-46fb-933d-c7181cba458c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:40.969084 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057b8b9-fc19-46fb-933d-c7181cba458c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:40.987202 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057b8b9-fc19-46fb-933d-c7181cba458c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:40.994447 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-c057b8b9-fc19-46fb-933d-c7181cba458c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:44:40.996121 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 266/535] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:41.003052 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417dff6b-6df3-491e-9968-81f77f5757ff admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.019472 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417dff6b-6df3-491e-9968-81f77f5757ff admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.028089 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2257ca-7293-4e0d-b052-daa96d7f041f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.029212 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2257ca-7293-4e0d-b052-daa96d7f041f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.029650 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2257ca-7293-4e0d-b052-daa96d7f041f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.030082 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2257ca-7293-4e0d-b052-daa96d7f041f admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.031212 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2257ca-7293-4e0d-b052-daa96d7f041f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:41.031756 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2257ca-7293-4e0d-b052-daa96d7f041f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.032495 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425c3eb-d73e-4cd7-a342-493b7f1a55ba None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.032788 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425c3eb-d73e-4cd7-a342-493b7f1a55ba None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.033090 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425c3eb-d73e-4cd7-a342-493b7f1a55ba None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.034087 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2257ca-7293-4e0d-b052-daa96d7f041f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.035264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 267/536] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:41.043514 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5925df6-0503-4dfd-b729-9d6707ac0695 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.043790 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5925df6-0503-4dfd-b729-9d6707ac0695 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.044066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5925df6-0503-4dfd-b729-9d6707ac0695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.045800 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 270/537] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:41.052119 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2257ca-7293-4e0d-b052-daa96d7f041f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.063375 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2257ca-7293-4e0d-b052-daa96d7f041f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.068772 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6a365-11b0-47fc-8d83-4b4e8e7fa084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.069957 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6a365-11b0-47fc-8d83-4b4e8e7fa084 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.070962 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6a365-11b0-47fc-8d83-4b4e8e7fa084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.071414 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6a365-11b0-47fc-8d83-4b4e8e7fa084 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.084650 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6a365-11b0-47fc-8d83-4b4e8e7fa084 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.088088 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6a365-11b0-47fc-8d83-4b4e8e7fa084 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.094046 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-e5925df6-0503-4dfd-b729-9d6707ac0695 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:41.095276 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-e5925df6-0503-4dfd-b729-9d6707ac0695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:41.110228 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-a7b6a365-11b0-47fc-8d83-4b4e8e7fa084 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:41.117177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 271/538] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:41.119700 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6a365-11b0-47fc-8d83-4b4e8e7fa084 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.120869 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 268/539] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:41 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:41.134776 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6a365-11b0-47fc-8d83-4b4e8e7fa084 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.140601 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353110d-93de-41ab-a07f-b65cb002fe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.142043 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353110d-93de-41ab-a07f-b65cb002fe11 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.142676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353110d-93de-41ab-a07f-b65cb002fe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.143366 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353110d-93de-41ab-a07f-b65cb002fe11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.144923 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353110d-93de-41ab-a07f-b65cb002fe11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:41.145508 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353110d-93de-41ab-a07f-b65cb002fe11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.148106 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353110d-93de-41ab-a07f-b65cb002fe11 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.157812 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5925df6-0503-4dfd-b729-9d6707ac0695 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.169054 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 272/540] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:41.170686 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353110d-93de-41ab-a07f-b65cb002fe11 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.175320 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5925df6-0503-4dfd-b729-9d6707ac0695 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.183609 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353110d-93de-41ab-a07f-b65cb002fe11 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.186992 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adebe7e-9ecf-4edc-87a3-1482aa86cf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.187885 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adebe7e-9ecf-4edc-87a3-1482aa86cf33 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.188202 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adebe7e-9ecf-4edc-87a3-1482aa86cf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.188479 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adebe7e-9ecf-4edc-87a3-1482aa86cf33 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.190214 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5efd9c-4eff-44cc-b36f-93444dc00109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.191193 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5efd9c-4eff-44cc-b36f-93444dc00109 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.191615 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5efd9c-4eff-44cc-b36f-93444dc00109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.192043 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5efd9c-4eff-44cc-b36f-93444dc00109 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.201816 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adebe7e-9ecf-4edc-87a3-1482aa86cf33 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:41.203561 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5efd9c-4eff-44cc-b36f-93444dc00109 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.205796 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5efd9c-4eff-44cc-b36f-93444dc00109 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.209677 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-0adebe7e-9ecf-4edc-87a3-1482aa86cf33 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:44:41.212964 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 269/541] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:41.213586 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141b11a-1f2a-40c6-ae74-732c51a5fa76 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.213972 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141b11a-1f2a-40c6-ae74-732c51a5fa76 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.214387 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141b11a-1f2a-40c6-ae74-732c51a5fa76 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.216370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 270/542] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:41.221331 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141b11a-1f2a-40c6-ae74-732c51a5fa76 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.224072 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-0a5efd9c-4eff-44cc-b36f-93444dc00109 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 28 01:44:41.225488 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 273/543] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:41.230166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6539d8-d94b-47a5-9f44-0e7832f750df None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.230450 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6539d8-d94b-47a5-9f44-0e7832f750df None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.230726 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6539d8-d94b-47a5-9f44-0e7832f750df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.239241 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141b11a-1f2a-40c6-ae74-732c51a5fa76 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.247459 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03593f-209d-43c1-95cf-80df9faee918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.248134 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03593f-209d-43c1-95cf-80df9faee918 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.248415 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03593f-209d-43c1-95cf-80df9faee918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.249820 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03593f-209d-43c1-95cf-80df9faee918 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.249820 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03593f-209d-43c1-95cf-80df9faee918 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:41.249820 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03593f-209d-43c1-95cf-80df9faee918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.251568 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03593f-209d-43c1-95cf-80df9faee918 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.255690 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-1f6539d8-d94b-47a5-9f44-0e7832f750df None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:41.257218 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-1f6539d8-d94b-47a5-9f44-0e7832f750df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:41.262718 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 271/544] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:41.263639 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03593f-209d-43c1-95cf-80df9faee918 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.268018 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 274/545] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:41 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:41.269175 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6539d8-d94b-47a5-9f44-0e7832f750df None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.279902 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6539d8-d94b-47a5-9f44-0e7832f750df None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.284828 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa262e7f-6639-4115-92e4-f1daa31b201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.285952 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa262e7f-6639-4115-92e4-f1daa31b201c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.286500 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa262e7f-6639-4115-92e4-f1daa31b201c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.286984 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa262e7f-6639-4115-92e4-f1daa31b201c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.287246 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03593f-209d-43c1-95cf-80df9faee918 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.300642 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa262e7f-6639-4115-92e4-f1daa31b201c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.301512 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb13a1d-109a-40db-b983-5000c390c833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.302190 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb13a1d-109a-40db-b983-5000c390c833 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.302473 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb13a1d-109a-40db-b983-5000c390c833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.302740 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb13a1d-109a-40db-b983-5000c390c833 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.303123 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa262e7f-6639-4115-92e4-f1daa31b201c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.303674 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb13a1d-109a-40db-b983-5000c390c833 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:41.303970 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb13a1d-109a-40db-b983-5000c390c833 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.306284 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb13a1d-109a-40db-b983-5000c390c833 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.323181 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-aa262e7f-6639-4115-92e4-f1daa31b201c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:41.324590 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 275/546] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:41.325925 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa262e7f-6639-4115-92e4-f1daa31b201c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.332909 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 272/547] 10.222.0.96 () {56 vars in 1160 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:41.333815 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb13a1d-109a-40db-b983-5000c390c833 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.340357 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa262e7f-6639-4115-92e4-f1daa31b201c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.346428 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae381d-8b77-4185-820b-44f40b618588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.346840 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb13a1d-109a-40db-b983-5000c390c833 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.347838 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae381d-8b77-4185-820b-44f40b618588 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.348255 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae381d-8b77-4185-820b-44f40b618588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.348845 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae381d-8b77-4185-820b-44f40b618588 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.353098 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60c114-dbea-42ce-b139-ec6f31e3d210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.353848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60c114-dbea-42ce-b139-ec6f31e3d210 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.354189 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60c114-dbea-42ce-b139-ec6f31e3d210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.354596 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60c114-dbea-42ce-b139-ec6f31e3d210 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.355388 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60c114-dbea-42ce-b139-ec6f31e3d210 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:41.355756 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60c114-dbea-42ce-b139-ec6f31e3d210 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.357923 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60c114-dbea-42ce-b139-ec6f31e3d210 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.370291 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae381d-8b77-4185-820b-44f40b618588 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:41.373160 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 273/548] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:41.374270 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60c114-dbea-42ce-b139-ec6f31e3d210 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.378991 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-5eae381d-8b77-4185-820b-44f40b618588 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:44:41.381288 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 276/549] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:41.382924 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae381d-8b77-4185-820b-44f40b618588 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.386196 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60c114-dbea-42ce-b139-ec6f31e3d210 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.391836 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52c92d-2fd4-4d87-bfa3-e26f88852191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.392856 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52c92d-2fd4-4d87-bfa3-e26f88852191 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.393258 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52c92d-2fd4-4d87-bfa3-e26f88852191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.393616 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52c92d-2fd4-4d87-bfa3-e26f88852191 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.394978 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae381d-8b77-4185-820b-44f40b618588 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.402132 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7045a-5f52-4014-8dbe-8436f0a66b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.403401 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7045a-5f52-4014-8dbe-8436f0a66b5c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.403805 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52c92d-2fd4-4d87-bfa3-e26f88852191 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.404025 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7045a-5f52-4014-8dbe-8436f0a66b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.404470 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7045a-5f52-4014-8dbe-8436f0a66b5c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.405858 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52c92d-2fd4-4d87-bfa3-e26f88852191 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.416822 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 274/550] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:41.417320 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7045a-5f52-4014-8dbe-8436f0a66b5c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.419588 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7045a-5f52-4014-8dbe-8436f0a66b5c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.423316 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52c92d-2fd4-4d87-bfa3-e26f88852191 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.434335 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52c92d-2fd4-4d87-bfa3-e26f88852191 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.436909 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-73a7045a-5f52-4014-8dbe-8436f0a66b5c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 28 01:44:41.438651 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 277/551] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:41.439376 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3c8b1-1b38-4892-8982-ed24f3d1c03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.439825 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7045a-5f52-4014-8dbe-8436f0a66b5c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.440234 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3c8b1-1b38-4892-8982-ed24f3d1c03c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.440618 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3c8b1-1b38-4892-8982-ed24f3d1c03c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.441056 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3c8b1-1b38-4892-8982-ed24f3d1c03c admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.441892 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3c8b1-1b38-4892-8982-ed24f3d1c03c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:41.442296 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3c8b1-1b38-4892-8982-ed24f3d1c03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.444119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3c8b1-1b38-4892-8982-ed24f3d1c03c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.452911 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7045a-5f52-4014-8dbe-8436f0a66b5c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.454591 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 275/552] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:41.455572 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3c8b1-1b38-4892-8982-ed24f3d1c03c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.458257 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18972062-14da-4525-a9e8-64b3d6e921ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.459247 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18972062-14da-4525-a9e8-64b3d6e921ca admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.459718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18972062-14da-4525-a9e8-64b3d6e921ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.460129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18972062-14da-4525-a9e8-64b3d6e921ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.466995 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3c8b1-1b38-4892-8982-ed24f3d1c03c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.472189 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35394c-8380-415a-a0ee-90389863aeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.473472 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35394c-8380-415a-a0ee-90389863aeac admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.473858 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35394c-8380-415a-a0ee-90389863aeac admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.474239 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35394c-8380-415a-a0ee-90389863aeac admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.475472 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35394c-8380-415a-a0ee-90389863aeac admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:41.475882 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35394c-8380-415a-a0ee-90389863aeac admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.476093 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18972062-14da-4525-a9e8-64b3d6e921ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.478819 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35394c-8380-415a-a0ee-90389863aeac admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.479730 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18972062-14da-4525-a9e8-64b3d6e921ca admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.499735 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 276/553] 10.222.0.96 () {56 vars in 1158 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:41.500842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35394c-8380-415a-a0ee-90389863aeac admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.501444 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-18972062-14da-4525-a9e8-64b3d6e921ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:41.503140 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 278/554] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:41.505260 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18972062-14da-4525-a9e8-64b3d6e921ca admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.517030 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18972062-14da-4525-a9e8-64b3d6e921ca admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.517220 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35394c-8380-415a-a0ee-90389863aeac admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.522026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471838d-c6a9-46f4-a310-ae854439e575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.522232 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de998f7a-0cea-4409-ac42-98295e5ec5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.523235 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471838d-c6a9-46f4-a310-ae854439e575 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.524331 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471838d-c6a9-46f4-a310-ae854439e575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.525175 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471838d-c6a9-46f4-a310-ae854439e575 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.525417 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de998f7a-0cea-4409-ac42-98295e5ec5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.525838 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de998f7a-0cea-4409-ac42-98295e5ec5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.526257 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de998f7a-0cea-4409-ac42-98295e5ec5c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.540941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de998f7a-0cea-4409-ac42-98295e5ec5c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.543123 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471838d-c6a9-46f4-a310-ae854439e575 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.543530 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de998f7a-0cea-4409-ac42-98295e5ec5c2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.545218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471838d-c6a9-46f4-a310-ae854439e575 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.555675 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 279/555] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:41.558099 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de998f7a-0cea-4409-ac42-98295e5ec5c2 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.567513 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-2471838d-c6a9-46f4-a310-ae854439e575 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:41.569097 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 277/556] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:41.569398 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de998f7a-0cea-4409-ac42-98295e5ec5c2 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.570151 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471838d-c6a9-46f4-a310-ae854439e575 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.575451 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b3e83-e93d-4cc5-b036-a16b845ca95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.576400 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b3e83-e93d-4cc5-b036-a16b845ca95e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.576849 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b3e83-e93d-4cc5-b036-a16b845ca95e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.577288 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b3e83-e93d-4cc5-b036-a16b845ca95e admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.579001 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b3e83-e93d-4cc5-b036-a16b845ca95e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:41.579700 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b3e83-e93d-4cc5-b036-a16b845ca95e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.582674 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b3e83-e93d-4cc5-b036-a16b845ca95e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.583989 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471838d-c6a9-46f4-a310-ae854439e575 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.590265 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbff3f1-e9f7-4f08-af79-479654c733f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.591197 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbff3f1-e9f7-4f08-af79-479654c733f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.591586 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbff3f1-e9f7-4f08-af79-479654c733f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.591966 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbff3f1-e9f7-4f08-af79-479654c733f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.599547 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 280/557] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:41.600634 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b3e83-e93d-4cc5-b036-a16b845ca95e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.611493 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbff3f1-e9f7-4f08-af79-479654c733f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.613832 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbff3f1-e9f7-4f08-af79-479654c733f3 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.614536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b3e83-e93d-4cc5-b036-a16b845ca95e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.621207 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356be68f-2b14-4372-86d8-5740f6e6951a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.622998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356be68f-2b14-4372-86d8-5740f6e6951a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.623479 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356be68f-2b14-4372-86d8-5740f6e6951a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.623910 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356be68f-2b14-4372-86d8-5740f6e6951a admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.625288 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356be68f-2b14-4372-86d8-5740f6e6951a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:41.626050 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356be68f-2b14-4372-86d8-5740f6e6951a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.627864 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356be68f-2b14-4372-86d8-5740f6e6951a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.634541 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-bfbff3f1-e9f7-4f08-af79-479654c733f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:41.636233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 278/558] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:41.637777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbff3f1-e9f7-4f08-af79-479654c733f3 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.642996 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 281/559] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:41.644241 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356be68f-2b14-4372-86d8-5740f6e6951a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.649436 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbff3f1-e9f7-4f08-af79-479654c733f3 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.655308 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f0352-5e58-4078-bcde-bbcc2b69f8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.656311 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f0352-5e58-4078-bcde-bbcc2b69f8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.656700 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f0352-5e58-4078-bcde-bbcc2b69f8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.657127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f0352-5e58-4078-bcde-bbcc2b69f8d6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.658139 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356be68f-2b14-4372-86d8-5740f6e6951a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.663836 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b90f79-5321-451f-9943-3200cc6ba7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.664727 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f0352-5e58-4078-bcde-bbcc2b69f8d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.665623 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b90f79-5321-451f-9943-3200cc6ba7cb admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.666048 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b90f79-5321-451f-9943-3200cc6ba7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.666461 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b90f79-5321-451f-9943-3200cc6ba7cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.667061 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f0352-5e58-4078-bcde-bbcc2b69f8d6 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.667542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b90f79-5321-451f-9943-3200cc6ba7cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:41.667987 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b90f79-5321-451f-9943-3200cc6ba7cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.670269 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b90f79-5321-451f-9943-3200cc6ba7cb admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.682693 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-018f0352-5e58-4078-bcde-bbcc2b69f8d6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:41.683714 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 282/560] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:41.684815 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b90f79-5321-451f-9943-3200cc6ba7cb admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.688852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 279/561] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:41.689767 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f0352-5e58-4078-bcde-bbcc2b69f8d6 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.696016 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b90f79-5321-451f-9943-3200cc6ba7cb admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.702815 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dac5e4-3710-43cc-b457-2aaa1244b385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.703979 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dac5e4-3710-43cc-b457-2aaa1244b385 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.705195 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dac5e4-3710-43cc-b457-2aaa1244b385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.705638 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dac5e4-3710-43cc-b457-2aaa1244b385 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.706580 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f0352-5e58-4078-bcde-bbcc2b69f8d6 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.713161 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722f290-84c0-4809-8f19-0877d78e8adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.714144 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722f290-84c0-4809-8f19-0877d78e8adc admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.714538 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722f290-84c0-4809-8f19-0877d78e8adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.714941 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722f290-84c0-4809-8f19-0877d78e8adc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.716385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dac5e4-3710-43cc-b457-2aaa1244b385 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.719706 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dac5e4-3710-43cc-b457-2aaa1244b385 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.724192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722f290-84c0-4809-8f19-0877d78e8adc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.726417 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722f290-84c0-4809-8f19-0877d78e8adc admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.737956 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-90dac5e4-3710-43cc-b457-2aaa1244b385 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:44:41.739455 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 283/562] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:41.740456 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dac5e4-3710-43cc-b457-2aaa1244b385 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.742837 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-6722f290-84c0-4809-8f19-0877d78e8adc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:41.744468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 280/563] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:41.746610 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722f290-84c0-4809-8f19-0877d78e8adc admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.754660 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dac5e4-3710-43cc-b457-2aaa1244b385 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.761299 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722f290-84c0-4809-8f19-0877d78e8adc admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.761522 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623b8bf-5c1a-4ab9-a9b5-4628d9de902d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.762591 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623b8bf-5c1a-4ab9-a9b5-4628d9de902d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.763182 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623b8bf-5c1a-4ab9-a9b5-4628d9de902d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.763639 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623b8bf-5c1a-4ab9-a9b5-4628d9de902d admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.764725 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623b8bf-5c1a-4ab9-a9b5-4628d9de902d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:41.765378 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623b8bf-5c1a-4ab9-a9b5-4628d9de902d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.766454 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceea79-0caa-4984-a0a3-87299c882068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.767255 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceea79-0caa-4984-a0a3-87299c882068 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.767639 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceea79-0caa-4984-a0a3-87299c882068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.768017 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceea79-0caa-4984-a0a3-87299c882068 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.768294 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623b8bf-5c1a-4ab9-a9b5-4628d9de902d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.770769 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ceea79-0caa-4984-a0a3-87299c882068 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:41.771246 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ceea79-0caa-4984-a0a3-87299c882068 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.773242 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ceea79-0caa-4984-a0a3-87299c882068 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.784385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 284/564] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:41.784822 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623b8bf-5c1a-4ab9-a9b5-4628d9de902d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.795288 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 281/565] 10.222.0.96 () {56 vars in 1156 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:41.795698 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623b8bf-5c1a-4ab9-a9b5-4628d9de902d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.796544 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceea79-0caa-4984-a0a3-87299c882068 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.800980 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28488666-4297-43d1-a7c0-dde56f7a6601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.801791 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28488666-4297-43d1-a7c0-dde56f7a6601 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.802211 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28488666-4297-43d1-a7c0-dde56f7a6601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.802744 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28488666-4297-43d1-a7c0-dde56f7a6601 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.803565 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28488666-4297-43d1-a7c0-dde56f7a6601 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:41.803995 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28488666-4297-43d1-a7c0-dde56f7a6601 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.806779 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28488666-4297-43d1-a7c0-dde56f7a6601 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.809401 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceea79-0caa-4984-a0a3-87299c882068 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.814303 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f3194-279e-4489-8f8f-463687756a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.815187 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3194-279e-4489-8f8f-463687756a1e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.815653 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3194-279e-4489-8f8f-463687756a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.815935 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3194-279e-4489-8f8f-463687756a1e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.816780 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f3194-279e-4489-8f8f-463687756a1e admin admin] RBAC: Adding query filter params (role.id=4d7fce301eec49a7a54390167747fe24, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=4acc32735f0a418ba5620f6225500402) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:41.817166 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f3194-279e-4489-8f8f-463687756a1e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.819067 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f3194-279e-4489-8f8f-463687756a1e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.822544 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 285/566] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:41.823796 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28488666-4297-43d1-a7c0-dde56f7a6601 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.826496 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 282/567] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/role_assignments?user.id=4acc32735f0a418ba5620f6225500402&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=4d7fce301eec49a7a54390167747fe24 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:41.834011 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f3194-279e-4489-8f8f-463687756a1e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.836185 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28488666-4297-43d1-a7c0-dde56f7a6601 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.852283 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19cdd4-2023-4076-bf2b-c683f73b5aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.853629 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19cdd4-2023-4076-bf2b-c683f73b5aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.854227 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19cdd4-2023-4076-bf2b-c683f73b5aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.854711 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19cdd4-2023-4076-bf2b-c683f73b5aa8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.861154 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f3194-279e-4489-8f8f-463687756a1e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.873084 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19cdd4-2023-4076-bf2b-c683f73b5aa8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.875611 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19cdd4-2023-4076-bf2b-c683f73b5aa8 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.882699 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fdaf5-a5d5-46be-9dd0-97f4f985bdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.883434 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fdaf5-a5d5-46be-9dd0-97f4f985bdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.883716 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fdaf5-a5d5-46be-9dd0-97f4f985bdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.883991 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fdaf5-a5d5-46be-9dd0-97f4f985bdd4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.884852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fdaf5-a5d5-46be-9dd0-97f4f985bdd4 admin admin] RBAC: Adding query filter params (role.id=4d7fce301eec49a7a54390167747fe24, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=eb36af30d0fe4369b4459f333cb64a36) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:41.885164 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fdaf5-a5d5-46be-9dd0-97f4f985bdd4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.887035 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fdaf5-a5d5-46be-9dd0-97f4f985bdd4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.896705 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-aa19cdd4-2023-4076-bf2b-c683f73b5aa8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:41.898941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 286/568] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:41.907674 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 283/569] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/role_assignments?user.id=eb36af30d0fe4369b4459f333cb64a36&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=4d7fce301eec49a7a54390167747fe24 => generated 608 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:41.910243 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19cdd4-2023-4076-bf2b-c683f73b5aa8 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.921907 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19cdd4-2023-4076-bf2b-c683f73b5aa8 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.926895 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b268e-6579-43a8-a241-55c16a8f9686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.927631 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b268e-6579-43a8-a241-55c16a8f9686 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.927905 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b268e-6579-43a8-a241-55c16a8f9686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.928173 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b268e-6579-43a8-a241-55c16a8f9686 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.929095 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b268e-6579-43a8-a241-55c16a8f9686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:41.929447 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b268e-6579-43a8-a241-55c16a8f9686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.932063 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b268e-6579-43a8-a241-55c16a8f9686 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:41.947401 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 287/570] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:41.953845 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fdaf5-a5d5-46be-9dd0-97f4f985bdd4 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:41.965473 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fdaf5-a5d5-46be-9dd0-97f4f985bdd4 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:41.970678 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c68fa-0ef2-4678-a78b-495288e0950c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:41.971934 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c68fa-0ef2-4678-a78b-495288e0950c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:41.972457 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c68fa-0ef2-4678-a78b-495288e0950c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:41.972983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c68fa-0ef2-4678-a78b-495288e0950c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:41.982109 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c68fa-0ef2-4678-a78b-495288e0950c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:41.984642 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c68fa-0ef2-4678-a78b-495288e0950c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:42.000265 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-748c68fa-0ef2-4678-a78b-495288e0950c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:42.002288 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 284/571] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:42.009205 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b268e-6579-43a8-a241-55c16a8f9686 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:42.027009 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b268e-6579-43a8-a241-55c16a8f9686 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:42.035930 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ce4af-98d4-4ff9-8f16-ba6edd4dc2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:42.036601 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ce4af-98d4-4ff9-8f16-ba6edd4dc2af admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:42.036913 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ce4af-98d4-4ff9-8f16-ba6edd4dc2af admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:42.037185 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ce4af-98d4-4ff9-8f16-ba6edd4dc2af admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:42.037979 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ce4af-98d4-4ff9-8f16-ba6edd4dc2af admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:42.038285 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ce4af-98d4-4ff9-8f16-ba6edd4dc2af admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:42.040431 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ce4af-98d4-4ff9-8f16-ba6edd4dc2af admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:42.056512 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 288/572] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:42.067001 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c68fa-0ef2-4678-a78b-495288e0950c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:42.078438 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c68fa-0ef2-4678-a78b-495288e0950c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:42.083294 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e0ca1-b1ae-4d47-ba8d-8788ea8584df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:42.084358 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e0ca1-b1ae-4d47-ba8d-8788ea8584df admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:42.084754 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e0ca1-b1ae-4d47-ba8d-8788ea8584df admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:42.085191 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e0ca1-b1ae-4d47-ba8d-8788ea8584df admin admin] PATH_INFO: `/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/83a2c3b2815f46b0ac27944f004c4821/roles/4d7fce301eec49a7a54390167747fe24` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:42.101457 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e0ca1-b1ae-4d47-ba8d-8788ea8584df admin admin] RBAC: Authorizing `identity:create_grant(project_id=356ecb479ba24136a7c38cb5a58a0a18, user_id=83a2c3b2815f46b0ac27944f004c4821, role_id=4d7fce301eec49a7a54390167747fe24)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:42.104312 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e0ca1-b1ae-4d47-ba8d-8788ea8584df admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:42.124529 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 285/573] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:44:42 2022] PUT /identity/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/83a2c3b2815f46b0ac27944f004c4821/roles/4d7fce301eec49a7a54390167747fe24 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:44:43.535377 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de118145-6ef1-481e-9e9b-11952c089f5f None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:43.536389 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de118145-6ef1-481e-9e9b-11952c089f5f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:43.536937 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de118145-6ef1-481e-9e9b-11952c089f5f None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:43.539006 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 289/574] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:43.549638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648ffea-03c4-4961-a82b-697bed51f9e9 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:43.550128 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648ffea-03c4-4961-a82b-697bed51f9e9 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:43.550199 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648ffea-03c4-4961-a82b-697bed51f9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:43.577994 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-d648ffea-03c4-4961-a82b-697bed51f9e9 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:43.579234 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-d648ffea-03c4-4961-a82b-697bed51f9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:43.664521 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 286/575] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:43 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:43.701312 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de118145-6ef1-481e-9e9b-11952c089f5f None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:43.720322 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de118145-6ef1-481e-9e9b-11952c089f5f None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:43.725061 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc090b83-fd0f-40bb-8ad5-893bc8ac0a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:43.726096 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc090b83-fd0f-40bb-8ad5-893bc8ac0a21 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:43.727226 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc090b83-fd0f-40bb-8ad5-893bc8ac0a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:43.727705 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc090b83-fd0f-40bb-8ad5-893bc8ac0a21 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:43.749991 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc090b83-fd0f-40bb-8ad5-893bc8ac0a21 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:43.757076 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-fc090b83-fd0f-40bb-8ad5-893bc8ac0a21 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:44:43.758837 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 290/576] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:43.765424 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648ffea-03c4-4961-a82b-697bed51f9e9 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:43.775756 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648ffea-03c4-4961-a82b-697bed51f9e9 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:43.780635 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a9018-c80d-4a7c-8cb1-d79597d57648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:43.781341 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a9018-c80d-4a7c-8cb1-d79597d57648 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:43.781619 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a9018-c80d-4a7c-8cb1-d79597d57648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:43.781893 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a9018-c80d-4a7c-8cb1-d79597d57648 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:43.782645 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a9018-c80d-4a7c-8cb1-d79597d57648 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:43.782950 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a9018-c80d-4a7c-8cb1-d79597d57648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:43.784546 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a9018-c80d-4a7c-8cb1-d79597d57648 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:43.794967 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 287/577] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:43.800569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc090b83-fd0f-40bb-8ad5-893bc8ac0a21 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:43.813920 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc090b83-fd0f-40bb-8ad5-893bc8ac0a21 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:43.818574 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4200e4e-b56f-4ee9-8a77-0169bc80185e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:43.819513 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4200e4e-b56f-4ee9-8a77-0169bc80185e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:43.819948 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4200e4e-b56f-4ee9-8a77-0169bc80185e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:43.820387 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4200e4e-b56f-4ee9-8a77-0169bc80185e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:43.838938 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4200e4e-b56f-4ee9-8a77-0169bc80185e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:43.841058 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4200e4e-b56f-4ee9-8a77-0169bc80185e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:43.868281 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-c4200e4e-b56f-4ee9-8a77-0169bc80185e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:43.870049 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 291/578] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:43.875959 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a9018-c80d-4a7c-8cb1-d79597d57648 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:43.890861 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a9018-c80d-4a7c-8cb1-d79597d57648 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:43.901396 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeb8cc-7540-402a-af6c-7720193ec662 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:43.902215 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeb8cc-7540-402a-af6c-7720193ec662 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:43.902625 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeb8cc-7540-402a-af6c-7720193ec662 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:43.902733 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acbfe9-7067-429b-a98b-afff46f67249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:43.903487 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acbfe9-7067-429b-a98b-afff46f67249 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:43.903866 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acbfe9-7067-429b-a98b-afff46f67249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:43.904235 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acbfe9-7067-429b-a98b-afff46f67249 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:43.905103 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acbfe9-7067-429b-a98b-afff46f67249 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:43.905524 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acbfe9-7067-429b-a98b-afff46f67249 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:43.906941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 292/579] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:43.912836 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acbfe9-7067-429b-a98b-afff46f67249 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:43.914441 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc70f31-11ad-4f1e-be9b-d3b20401a12d None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:43.914904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc70f31-11ad-4f1e-be9b-d3b20401a12d None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:43.915312 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc70f31-11ad-4f1e-be9b-d3b20401a12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:43.924145 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 288/580] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:43.929937 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acbfe9-7067-429b-a98b-afff46f67249 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:43.947974 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acbfe9-7067-429b-a98b-afff46f67249 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:43.949193 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-4fc70f31-11ad-4f1e-be9b-d3b20401a12d None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:43.951058 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-4fc70f31-11ad-4f1e-be9b-d3b20401a12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:43.958855 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651c590-9565-4934-a25a-96d1605bdc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:43.959774 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651c590-9565-4934-a25a-96d1605bdc14 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:43.960162 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651c590-9565-4934-a25a-96d1605bdc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:43.960543 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651c590-9565-4934-a25a-96d1605bdc14 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:43.971986 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 293/581] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:43 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:43.973478 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651c590-9565-4934-a25a-96d1605bdc14 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:43.975581 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651c590-9565-4934-a25a-96d1605bdc14 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:43.994893 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-c651c590-9565-4934-a25a-96d1605bdc14 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:44:43.996468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 289/582] 10.222.0.96 () {56 vars in 1114 bytes} [Fri Jan 28 01:44:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:43.997583 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc70f31-11ad-4f1e-be9b-d3b20401a12d None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:44.002920 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651c590-9565-4934-a25a-96d1605bdc14 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:44.007012 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc70f31-11ad-4f1e-be9b-d3b20401a12d None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:44.012285 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623c50e-8682-4be4-9d1b-5d550dc4fb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:44.013107 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623c50e-8682-4be4-9d1b-5d550dc4fb09 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.013386 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623c50e-8682-4be4-9d1b-5d550dc4fb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.013654 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623c50e-8682-4be4-9d1b-5d550dc4fb09 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.015255 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651c590-9565-4934-a25a-96d1605bdc14 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:44.027572 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e155dc9-e9d4-41bd-b7e3-00af89595877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:44.028272 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e155dc9-e9d4-41bd-b7e3-00af89595877 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.028550 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e155dc9-e9d4-41bd-b7e3-00af89595877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.028838 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e155dc9-e9d4-41bd-b7e3-00af89595877 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.029684 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e155dc9-e9d4-41bd-b7e3-00af89595877 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:44.029991 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e155dc9-e9d4-41bd-b7e3-00af89595877 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:44.031831 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e155dc9-e9d4-41bd-b7e3-00af89595877 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:44.037774 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623c50e-8682-4be4-9d1b-5d550dc4fb09 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:44.040062 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623c50e-8682-4be4-9d1b-5d550dc4fb09 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:44.062724 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 290/583] 10.222.0.96 () {56 vars in 1154 bytes} [Fri Jan 28 01:44:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:44.068324 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e155dc9-e9d4-41bd-b7e3-00af89595877 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:44.075640 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-1623c50e-8682-4be4-9d1b-5d550dc4fb09 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:44.085443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e155dc9-e9d4-41bd-b7e3-00af89595877 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:44.088155 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 294/584] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:44.095031 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623c50e-8682-4be4-9d1b-5d550dc4fb09 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:44.103771 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f16c4e-447d-43b5-adf3-6816d5815c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:44.104578 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f16c4e-447d-43b5-adf3-6816d5815c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.105016 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f16c4e-447d-43b5-adf3-6816d5815c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.105406 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f16c4e-447d-43b5-adf3-6816d5815c22 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.105809 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623c50e-8682-4be4-9d1b-5d550dc4fb09 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:44.110604 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4da81c-2f3a-4e6f-b6d9-9b035fabfdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:44.111257 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4da81c-2f3a-4e6f-b6d9-9b035fabfdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.111587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4da81c-2f3a-4e6f-b6d9-9b035fabfdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.111865 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4da81c-2f3a-4e6f-b6d9-9b035fabfdd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.112590 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4da81c-2f3a-4e6f-b6d9-9b035fabfdd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:44.113013 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4da81c-2f3a-4e6f-b6d9-9b035fabfdd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:44.114664 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4da81c-2f3a-4e6f-b6d9-9b035fabfdd5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:44.122743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f16c4e-447d-43b5-adf3-6816d5815c22 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:44.126745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f16c4e-447d-43b5-adf3-6816d5815c22 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:44.147847 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 295/585] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:44.149437 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4da81c-2f3a-4e6f-b6d9-9b035fabfdd5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:44.150476 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 291/586] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:44 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:44:44.155481 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f16c4e-447d-43b5-adf3-6816d5815c22 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:44.166938 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4da81c-2f3a-4e6f-b6d9-9b035fabfdd5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:44.169752 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f16c4e-447d-43b5-adf3-6816d5815c22 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:44.177186 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa13c7-769a-451c-88f5-f243426efc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:44.178410 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa13c7-769a-451c-88f5-f243426efc67 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.178698 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa13c7-769a-451c-88f5-f243426efc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.178977 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa13c7-769a-451c-88f5-f243426efc67 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.179635 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763145e-d531-472e-ba8e-f9f46b751a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:44.180483 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763145e-d531-472e-ba8e-f9f46b751a59 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.180768 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763145e-d531-472e-ba8e-f9f46b751a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.181110 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763145e-d531-472e-ba8e-f9f46b751a59 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.181875 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa13c7-769a-451c-88f5-f243426efc67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:44.184240 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa13c7-769a-451c-88f5-f243426efc67 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:44.198422 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763145e-d531-472e-ba8e-f9f46b751a59 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:44.201263 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763145e-d531-472e-ba8e-f9f46b751a59 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:44.228872 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 296/587] 10.222.0.96 () {60 vars in 1153 bytes} [Fri Jan 28 01:44:44 2022] POST /identity/v3/users => generated 254 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:44:44.231127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-a763145e-d531-472e-ba8e-f9f46b751a59 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:44.232851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 292/588] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:44.239217 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa13c7-769a-451c-88f5-f243426efc67 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:44.250842 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa13c7-769a-451c-88f5-f243426efc67 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:44.262057 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ef74a-6b7b-4e4f-a1d8-a66a31c69a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:44.262920 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ef74a-6b7b-4e4f-a1d8-a66a31c69a14 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.263315 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ef74a-6b7b-4e4f-a1d8-a66a31c69a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.263693 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ef74a-6b7b-4e4f-a1d8-a66a31c69a14 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.264565 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ef74a-6b7b-4e4f-a1d8-a66a31c69a14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:44.265058 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ef74a-6b7b-4e4f-a1d8-a66a31c69a14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:44.266838 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ef74a-6b7b-4e4f-a1d8-a66a31c69a14 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:44.286767 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 297/589] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:44.293579 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763145e-d531-472e-ba8e-f9f46b751a59 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:44.304464 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763145e-d531-472e-ba8e-f9f46b751a59 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:44.317818 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493a9af-f3d1-4788-a337-de2ea20adb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:44.318732 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493a9af-f3d1-4788-a337-de2ea20adb7c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.319123 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493a9af-f3d1-4788-a337-de2ea20adb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.319504 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493a9af-f3d1-4788-a337-de2ea20adb7c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.328476 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493a9af-f3d1-4788-a337-de2ea20adb7c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:44.330717 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493a9af-f3d1-4788-a337-de2ea20adb7c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:44.349579 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-5493a9af-f3d1-4788-a337-de2ea20adb7c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:44.351425 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 293/590] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:44.358248 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ef74a-6b7b-4e4f-a1d8-a66a31c69a14 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:44.375142 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ef74a-6b7b-4e4f-a1d8-a66a31c69a14 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:44.387310 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c79a1a-1cff-4f82-b974-97e17917ead3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:44.388144 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c79a1a-1cff-4f82-b974-97e17917ead3 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.388535 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c79a1a-1cff-4f82-b974-97e17917ead3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.388965 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c79a1a-1cff-4f82-b974-97e17917ead3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.389870 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c79a1a-1cff-4f82-b974-97e17917ead3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:44.390289 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c79a1a-1cff-4f82-b974-97e17917ead3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:44.392387 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c79a1a-1cff-4f82-b974-97e17917ead3 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:44.417175 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 298/591] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:44.423649 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493a9af-f3d1-4788-a337-de2ea20adb7c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:44.440277 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493a9af-f3d1-4788-a337-de2ea20adb7c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:44.450877 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad499be-f17b-48aa-aacc-904d97c04027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:44.451855 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad499be-f17b-48aa-aacc-904d97c04027 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.452330 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad499be-f17b-48aa-aacc-904d97c04027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.452745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad499be-f17b-48aa-aacc-904d97c04027 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.453807 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad499be-f17b-48aa-aacc-904d97c04027 admin admin] RBAC: Adding query filter params (role.id=253c0a1dc8d6421298a7987caaa55676, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=cc85f5db9c3c47fca68ebab33b0bb73c) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:44.454267 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad499be-f17b-48aa-aacc-904d97c04027 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:44.456393 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad499be-f17b-48aa-aacc-904d97c04027 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:44.467185 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 294/592] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:44 2022] GET /identity/v3/role_assignments?user.id=cc85f5db9c3c47fca68ebab33b0bb73c&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:44.785179 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8d222-0e81-410c-8c48-177f07b10559 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.785718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8d222-0e81-410c-8c48-177f07b10559 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.785718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8d222-0e81-410c-8c48-177f07b10559 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.787738 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 299/593] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:44.796978 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449360c3-e76c-409e-a18b-0ab76deec066 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.797470 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449360c3-e76c-409e-a18b-0ab76deec066 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.797565 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449360c3-e76c-409e-a18b-0ab76deec066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.807978 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74171279-56dd-4297-a5d8-5ad9924a6f9a None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.808290 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74171279-56dd-4297-a5d8-5ad9924a6f9a None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.808531 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74171279-56dd-4297-a5d8-5ad9924a6f9a None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.810710 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 300/594] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:44:44.820399 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f55d5a-9348-4ecd-b726-9c78c3ef7a7d None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.821065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f55d5a-9348-4ecd-b726-9c78c3ef7a7d None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.821311 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-449360c3-e76c-409e-a18b-0ab76deec066 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:44.821834 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f55d5a-9348-4ecd-b726-9c78c3ef7a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.822504 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-449360c3-e76c-409e-a18b-0ab76deec066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:44.831884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 295/595] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:44 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:44.849461 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-03f55d5a-9348-4ecd-b726-9c78c3ef7a7d None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:44.850691 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-03f55d5a-9348-4ecd-b726-9c78c3ef7a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:44.857514 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449360c3-e76c-409e-a18b-0ab76deec066 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:44.860057 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 301/596] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:44 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:44.872490 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449360c3-e76c-409e-a18b-0ab76deec066 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:44.880959 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7630936-2ef1-4eeb-ae27-c9ca4b89ea83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:44.882080 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7630936-2ef1-4eeb-ae27-c9ca4b89ea83 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.882571 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7630936-2ef1-4eeb-ae27-c9ca4b89ea83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.883282 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7630936-2ef1-4eeb-ae27-c9ca4b89ea83 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.884289 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7630936-2ef1-4eeb-ae27-c9ca4b89ea83 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:44.884397 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f55d5a-9348-4ecd-b726-9c78c3ef7a7d None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:44.885683 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING py.warnings [None req-a7630936-2ef1-4eeb-ae27-c9ca4b89ea83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:44.885683 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: warnings.warn(msg) Jan 28 01:44:44.885683 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: Jan 28 01:44:44.887060 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7630936-2ef1-4eeb-ae27-c9ca4b89ea83 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:44.894754 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f55d5a-9348-4ecd-b726-9c78c3ef7a7d None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:44.899611 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c022835-ba4b-41fc-a8db-ffb877174f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:44.900687 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c022835-ba4b-41fc-a8db-ffb877174f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.901183 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c022835-ba4b-41fc-a8db-ffb877174f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.901629 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c022835-ba4b-41fc-a8db-ffb877174f94 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.902710 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c022835-ba4b-41fc-a8db-ffb877174f94 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:44.903921 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-2c022835-ba4b-41fc-a8db-ffb877174f94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:44.903921 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:44:44.903921 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:44:44.905152 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c022835-ba4b-41fc-a8db-ffb877174f94 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:44.906782 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-a7630936-2ef1-4eeb-ae27-c9ca4b89ea83 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 28 01:44:44.908312 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 296/597] 10.222.0.96 () {56 vars in 1150 bytes} [Fri Jan 28 01:44:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:44.909700 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf5375-5de0-41b3-ae63-eef80d270a36 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.909987 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf5375-5de0-41b3-ae63-eef80d270a36 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.910257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf5375-5de0-41b3-ae63-eef80d270a36 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.912215 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 297/598] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:44.920269 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf5375-5de0-41b3-ae63-eef80d270a36 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:44.920821 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-2c022835-ba4b-41fc-a8db-ffb877174f94 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 28 01:44:44.922528 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 302/599] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:44 2022] GET /identity/v3/services/network => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:44.923876 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fc0b2-26fb-4265-8fdd-3ac6eb51eb60 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.924304 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fc0b2-26fb-4265-8fdd-3ac6eb51eb60 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.924720 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fc0b2-26fb-4265-8fdd-3ac6eb51eb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.938549 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf5375-5de0-41b3-ae63-eef80d270a36 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:44.943258 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b7f12-8b24-47bc-b12d-8393f6535e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:44.944056 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b7f12-8b24-47bc-b12d-8393f6535e7b admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.944444 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b7f12-8b24-47bc-b12d-8393f6535e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.944842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b7f12-8b24-47bc-b12d-8393f6535e7b admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.946201 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b7f12-8b24-47bc-b12d-8393f6535e7b admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:44.946611 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b7f12-8b24-47bc-b12d-8393f6535e7b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:44.947723 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING py.warnings [None req-2e5b7f12-8b24-47bc-b12d-8393f6535e7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:44.947723 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: warnings.warn(msg) Jan 28 01:44:44.947723 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: Jan 28 01:44:44.948836 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b7f12-8b24-47bc-b12d-8393f6535e7b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:44.952475 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-a87fc0b2-26fb-4265-8fdd-3ac6eb51eb60 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:44.953951 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a87fc0b2-26fb-4265-8fdd-3ac6eb51eb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:44.954277 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 298/600] 10.222.0.96 () {56 vars in 1145 bytes} [Fri Jan 28 01:44:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:44.955294 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b7f12-8b24-47bc-b12d-8393f6535e7b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:44.964102 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 303/601] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:44 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:44.965251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fc0b2-26fb-4265-8fdd-3ac6eb51eb60 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:44.971199 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b7f12-8b24-47bc-b12d-8393f6535e7b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:44.975730 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fc0b2-26fb-4265-8fdd-3ac6eb51eb60 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:44.981186 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d19d9-79fd-469a-ba54-ddd73c54804f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:44.982622 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d19d9-79fd-469a-ba54-ddd73c54804f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.983056 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d19d9-79fd-469a-ba54-ddd73c54804f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.983989 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d19d9-79fd-469a-ba54-ddd73c54804f admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.985235 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d19d9-79fd-469a-ba54-ddd73c54804f admin admin] RBAC: Adding query filter params (name=network) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:44.985861 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d19d9-79fd-469a-ba54-ddd73c54804f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:44.988513 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb44c5-6abf-4ecb-ba7b-094bd74c516d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:44.989829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb44c5-6abf-4ecb-ba7b-094bd74c516d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:44.990488 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d19d9-79fd-469a-ba54-ddd73c54804f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:44.990943 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb44c5-6abf-4ecb-ba7b-094bd74c516d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:44.991430 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb44c5-6abf-4ecb-ba7b-094bd74c516d admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:44.993620 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb44c5-6abf-4ecb-ba7b-094bd74c516d admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:44.995111 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb44c5-6abf-4ecb-ba7b-094bd74c516d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:44.996306 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-decb44c5-6abf-4ecb-ba7b-094bd74c516d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:44.996306 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:44:44.996306 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:44:44.997228 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb44c5-6abf-4ecb-ba7b-094bd74c516d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:45.001147 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 299/602] 10.222.0.96 () {56 vars in 1133 bytes} [Fri Jan 28 01:44:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:45.002185 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d19d9-79fd-469a-ba54-ddd73c54804f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:45.003440 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 304/603] 10.222.0.96 () {56 vars in 1145 bytes} [Fri Jan 28 01:44:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:45.007340 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb44c5-6abf-4ecb-ba7b-094bd74c516d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:45.013667 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d19d9-79fd-469a-ba54-ddd73c54804f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:45.025509 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0c894-295b-4cf9-b935-8cac5f223ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:45.028272 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0c894-295b-4cf9-b935-8cac5f223ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:45.028733 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0c894-295b-4cf9-b935-8cac5f223ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:45.029214 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0c894-295b-4cf9-b935-8cac5f223ae2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:45.030229 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb44c5-6abf-4ecb-ba7b-094bd74c516d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:45.040348 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c5775-405f-4449-9b8d-5fa8a5a00a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:45.043971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c5775-405f-4449-9b8d-5fa8a5a00a1e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:45.044618 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c5775-405f-4449-9b8d-5fa8a5a00a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:45.045059 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c5775-405f-4449-9b8d-5fa8a5a00a1e admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:45.046012 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c5775-405f-4449-9b8d-5fa8a5a00a1e admin admin] RBAC: Adding query filter params (type=network) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:45.046823 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c5775-405f-4449-9b8d-5fa8a5a00a1e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:45.049085 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c5775-405f-4449-9b8d-5fa8a5a00a1e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:45.059074 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0c894-295b-4cf9-b935-8cac5f223ae2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:45.065523 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 305/604] 10.222.0.96 () {56 vars in 1133 bytes} [Fri Jan 28 01:44:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:45.069032 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-80a0c894-295b-4cf9-b935-8cac5f223ae2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:44:45.071636 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 300/605] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:45.078887 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c5775-405f-4449-9b8d-5fa8a5a00a1e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:45.090107 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c5775-405f-4449-9b8d-5fa8a5a00a1e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:45.095356 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d7ffc-687c-4dd9-bce9-f510c8d0f614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:45.096382 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d7ffc-687c-4dd9-bce9-f510c8d0f614 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:45.096825 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d7ffc-687c-4dd9-bce9-f510c8d0f614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:45.097270 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d7ffc-687c-4dd9-bce9-f510c8d0f614 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:45.098251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d7ffc-687c-4dd9-bce9-f510c8d0f614 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:45.098710 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d7ffc-687c-4dd9-bce9-f510c8d0f614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:45.100660 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d7ffc-687c-4dd9-bce9-f510c8d0f614 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:45.111057 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 306/606] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:44:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:45.118370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0c894-295b-4cf9-b935-8cac5f223ae2 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:45.129515 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0c894-295b-4cf9-b935-8cac5f223ae2 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:45.135782 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff2cc7-52aa-499c-9946-440a4a9ea700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:45.136944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff2cc7-52aa-499c-9946-440a4a9ea700 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:45.137441 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff2cc7-52aa-499c-9946-440a4a9ea700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:45.137889 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff2cc7-52aa-499c-9946-440a4a9ea700 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:45.151064 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff2cc7-52aa-499c-9946-440a4a9ea700 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:45.153498 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff2cc7-52aa-499c-9946-440a4a9ea700 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:45.180369 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-1eff2cc7-52aa-499c-9946-440a4a9ea700 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:45.181955 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 301/607] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:45.188609 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d7ffc-687c-4dd9-bce9-f510c8d0f614 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:45.201459 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d7ffc-687c-4dd9-bce9-f510c8d0f614 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:45.206528 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c7f64-f9f3-4198-86d9-756be98a9893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:45.207420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c7f64-f9f3-4198-86d9-756be98a9893 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:45.207870 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c7f64-f9f3-4198-86d9-756be98a9893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:45.208312 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c7f64-f9f3-4198-86d9-756be98a9893 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:45.209255 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c7f64-f9f3-4198-86d9-756be98a9893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:45.209762 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c7f64-f9f3-4198-86d9-756be98a9893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:45.211736 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c7f64-f9f3-4198-86d9-756be98a9893 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:45.226049 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 307/608] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:45.234002 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff2cc7-52aa-499c-9946-440a4a9ea700 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:45.248660 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff2cc7-52aa-499c-9946-440a4a9ea700 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:45.253699 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f620d3-ba30-4872-9f9a-4f2ec41c0a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:45.254776 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f620d3-ba30-4872-9f9a-4f2ec41c0a92 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:45.255248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f620d3-ba30-4872-9f9a-4f2ec41c0a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:45.255689 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f620d3-ba30-4872-9f9a-4f2ec41c0a92 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:45.266612 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f620d3-ba30-4872-9f9a-4f2ec41c0a92 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:45.268892 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f620d3-ba30-4872-9f9a-4f2ec41c0a92 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:45.284572 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-96f620d3-ba30-4872-9f9a-4f2ec41c0a92 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:44:45.286310 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 302/609] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:45.293316 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c7f64-f9f3-4198-86d9-756be98a9893 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:45.307156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c7f64-f9f3-4198-86d9-756be98a9893 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:45.312043 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12746a01-2f94-4adc-9461-a338bfc9b12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:45.312905 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12746a01-2f94-4adc-9461-a338bfc9b12b admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:45.313352 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12746a01-2f94-4adc-9461-a338bfc9b12b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:45.313784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12746a01-2f94-4adc-9461-a338bfc9b12b admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:45.314806 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12746a01-2f94-4adc-9461-a338bfc9b12b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:45.315255 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12746a01-2f94-4adc-9461-a338bfc9b12b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:45.317377 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12746a01-2f94-4adc-9461-a338bfc9b12b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:45.338213 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 308/610] 10.222.0.96 () {56 vars in 1156 bytes} [Fri Jan 28 01:44:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:45.344474 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f620d3-ba30-4872-9f9a-4f2ec41c0a92 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:45.359943 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f620d3-ba30-4872-9f9a-4f2ec41c0a92 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:45.368732 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6688b4-82a7-442c-b947-c8fd2944937e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:45.369626 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6688b4-82a7-442c-b947-c8fd2944937e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:45.370100 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6688b4-82a7-442c-b947-c8fd2944937e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:45.370549 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6688b4-82a7-442c-b947-c8fd2944937e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:45.385240 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6688b4-82a7-442c-b947-c8fd2944937e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:45.387349 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6688b4-82a7-442c-b947-c8fd2944937e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:45.402125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 303/611] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:45 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:45.407965 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12746a01-2f94-4adc-9461-a338bfc9b12b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:45.418693 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12746a01-2f94-4adc-9461-a338bfc9b12b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:45.434041 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d07b7b-9671-474d-a17d-f3747b7fd28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:45.434842 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d07b7b-9671-474d-a17d-f3747b7fd28e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:45.435122 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d07b7b-9671-474d-a17d-f3747b7fd28e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:45.435393 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d07b7b-9671-474d-a17d-f3747b7fd28e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:45.452627 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d07b7b-9671-474d-a17d-f3747b7fd28e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:45.454804 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d07b7b-9671-474d-a17d-f3747b7fd28e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:45.474408 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-c1d07b7b-9671-474d-a17d-f3747b7fd28e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:45.476158 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 309/612] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:45.482629 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6688b4-82a7-442c-b947-c8fd2944937e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:45.491750 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6688b4-82a7-442c-b947-c8fd2944937e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:45.510537 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6dccc-4915-4a34-9c4d-b938d02e216b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:45.511225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6dccc-4915-4a34-9c4d-b938d02e216b admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:45.511520 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6dccc-4915-4a34-9c4d-b938d02e216b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:45.511783 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6dccc-4915-4a34-9c4d-b938d02e216b admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:45.512510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6dccc-4915-4a34-9c4d-b938d02e216b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:45.512830 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6dccc-4915-4a34-9c4d-b938d02e216b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:45.514421 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6dccc-4915-4a34-9c4d-b938d02e216b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:45.529066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 304/613] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:45.535087 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d07b7b-9671-474d-a17d-f3747b7fd28e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:45.558148 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d07b7b-9671-474d-a17d-f3747b7fd28e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:45.574322 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af53c33-985b-45cc-b90b-6f6d3ad378cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:45.575113 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af53c33-985b-45cc-b90b-6f6d3ad378cf admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:45.575390 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af53c33-985b-45cc-b90b-6f6d3ad378cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:45.575665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af53c33-985b-45cc-b90b-6f6d3ad378cf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:45.589939 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af53c33-985b-45cc-b90b-6f6d3ad378cf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:45.591892 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af53c33-985b-45cc-b90b-6f6d3ad378cf admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:45.612395 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-9af53c33-985b-45cc-b90b-6f6d3ad378cf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:45.613950 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 310/614] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:45.621268 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6dccc-4915-4a34-9c4d-b938d02e216b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:45.634928 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6dccc-4915-4a34-9c4d-b938d02e216b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:45.651185 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c5de3-90c1-46c4-9543-ba8411dbed28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:45.652182 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c5de3-90c1-46c4-9543-ba8411dbed28 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:45.652462 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c5de3-90c1-46c4-9543-ba8411dbed28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:45.652733 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c5de3-90c1-46c4-9543-ba8411dbed28 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:45.653543 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c5de3-90c1-46c4-9543-ba8411dbed28 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:45.653848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c5de3-90c1-46c4-9543-ba8411dbed28 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:45.655678 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c5de3-90c1-46c4-9543-ba8411dbed28 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:45.674535 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 305/615] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:45.682154 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af53c33-985b-45cc-b90b-6f6d3ad378cf admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:45.697990 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af53c33-985b-45cc-b90b-6f6d3ad378cf admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:45.705527 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d728f-fef1-4d66-86e9-c1bef3d1c9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:45.706224 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d728f-fef1-4d66-86e9-c1bef3d1c9df admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:45.706502 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d728f-fef1-4d66-86e9-c1bef3d1c9df admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:45.706771 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d728f-fef1-4d66-86e9-c1bef3d1c9df admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:45.707647 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d728f-fef1-4d66-86e9-c1bef3d1c9df admin admin] RBAC: Adding query filter params (role.id=4d7fce301eec49a7a54390167747fe24, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=83a2c3b2815f46b0ac27944f004c4821) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:45.707949 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d728f-fef1-4d66-86e9-c1bef3d1c9df admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:45.709842 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d728f-fef1-4d66-86e9-c1bef3d1c9df admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:45.721774 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 311/616] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:45 2022] GET /identity/v3/role_assignments?user.id=83a2c3b2815f46b0ac27944f004c4821&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=4d7fce301eec49a7a54390167747fe24 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:46.908844 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0c3d5-609c-4b55-864d-a9aba0664a06 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:46.910411 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0c3d5-609c-4b55-864d-a9aba0664a06 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:46.911171 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0c3d5-609c-4b55-864d-a9aba0664a06 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:46.917301 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 306/617] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:46.922333 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466af428-dd16-4e62-8a51-f3d0dad8c19e None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:46.923222 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466af428-dd16-4e62-8a51-f3d0dad8c19e None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:46.923669 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466af428-dd16-4e62-8a51-f3d0dad8c19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:46.941793 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-466af428-dd16-4e62-8a51-f3d0dad8c19e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:46.943257 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-466af428-dd16-4e62-8a51-f3d0dad8c19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:46.951898 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 312/618] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:46 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:46.976176 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0c3d5-609c-4b55-864d-a9aba0664a06 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:46.988926 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0c3d5-609c-4b55-864d-a9aba0664a06 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:46.993778 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a015766-a794-464c-bdf6-a5da7222d9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:46.994811 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a015766-a794-464c-bdf6-a5da7222d9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:46.995293 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a015766-a794-464c-bdf6-a5da7222d9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:46.995790 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a015766-a794-464c-bdf6-a5da7222d9e2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.007134 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a015766-a794-464c-bdf6-a5da7222d9e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:47.015105 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-8a015766-a794-464c-bdf6-a5da7222d9e2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:44:47.016839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 307/619] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:47.023354 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466af428-dd16-4e62-8a51-f3d0dad8c19e None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:47.033583 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466af428-dd16-4e62-8a51-f3d0dad8c19e None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:47.038375 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ac5ee-ad2f-489d-9b81-e220152c0952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:47.039360 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac5ee-ad2f-489d-9b81-e220152c0952 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.039815 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac5ee-ad2f-489d-9b81-e220152c0952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.040283 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac5ee-ad2f-489d-9b81-e220152c0952 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.041236 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ac5ee-ad2f-489d-9b81-e220152c0952 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:47.041807 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ac5ee-ad2f-489d-9b81-e220152c0952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:47.043583 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ac5ee-ad2f-489d-9b81-e220152c0952 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:47.053090 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 313/620] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:47.059553 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a015766-a794-464c-bdf6-a5da7222d9e2 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:47.071183 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a015766-a794-464c-bdf6-a5da7222d9e2 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:47.075973 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2629817-dbca-4403-97fb-9b9583b7d721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:47.076998 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2629817-dbca-4403-97fb-9b9583b7d721 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.077453 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2629817-dbca-4403-97fb-9b9583b7d721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.077898 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2629817-dbca-4403-97fb-9b9583b7d721 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.089404 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2629817-dbca-4403-97fb-9b9583b7d721 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:47.091452 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2629817-dbca-4403-97fb-9b9583b7d721 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:47.108529 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-b2629817-dbca-4403-97fb-9b9583b7d721 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:47.110316 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 308/621] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:47.116567 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ac5ee-ad2f-489d-9b81-e220152c0952 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:47.126550 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ac5ee-ad2f-489d-9b81-e220152c0952 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:47.131431 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07692dfa-502f-42a8-b103-a1936c5c38d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:47.132404 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07692dfa-502f-42a8-b103-a1936c5c38d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.133459 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07692dfa-502f-42a8-b103-a1936c5c38d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.133924 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07692dfa-502f-42a8-b103-a1936c5c38d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.134840 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07692dfa-502f-42a8-b103-a1936c5c38d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:47.135318 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07692dfa-502f-42a8-b103-a1936c5c38d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:47.137159 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07692dfa-502f-42a8-b103-a1936c5c38d5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:47.150875 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 314/622] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:47.157104 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2629817-dbca-4403-97fb-9b9583b7d721 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:47.170135 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2629817-dbca-4403-97fb-9b9583b7d721 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:47.176594 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0717d-85c4-449e-883a-bdb3a78be7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:47.177437 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0717d-85c4-449e-883a-bdb3a78be7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.177721 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0717d-85c4-449e-883a-bdb3a78be7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.177989 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0717d-85c4-449e-883a-bdb3a78be7e2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.193997 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0717d-85c4-449e-883a-bdb3a78be7e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:47.196727 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0717d-85c4-449e-883a-bdb3a78be7e2 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:47.217119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-9ff0717d-85c4-449e-883a-bdb3a78be7e2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:44:47.218344 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 309/623] 10.222.0.96 () {56 vars in 1114 bytes} [Fri Jan 28 01:44:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:47.225251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07692dfa-502f-42a8-b103-a1936c5c38d5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:47.249790 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07692dfa-502f-42a8-b103-a1936c5c38d5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:47.257121 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bed3b0-da5a-4310-aae8-a3f43af7895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:47.258786 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bed3b0-da5a-4310-aae8-a3f43af7895d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.259287 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bed3b0-da5a-4310-aae8-a3f43af7895d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.259762 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bed3b0-da5a-4310-aae8-a3f43af7895d admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.261343 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bed3b0-da5a-4310-aae8-a3f43af7895d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:47.261883 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bed3b0-da5a-4310-aae8-a3f43af7895d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:47.265381 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bed3b0-da5a-4310-aae8-a3f43af7895d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:47.300220 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 315/624] 10.222.0.96 () {56 vars in 1154 bytes} [Fri Jan 28 01:44:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:47.306770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0717d-85c4-449e-883a-bdb3a78be7e2 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:47.323237 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0717d-85c4-449e-883a-bdb3a78be7e2 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:47.334095 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab018e-2784-4ad0-836a-0309b0a80b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:47.334900 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab018e-2784-4ad0-836a-0309b0a80b5d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.335175 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab018e-2784-4ad0-836a-0309b0a80b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.335441 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab018e-2784-4ad0-836a-0309b0a80b5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.356033 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab018e-2784-4ad0-836a-0309b0a80b5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:47.357902 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab018e-2784-4ad0-836a-0309b0a80b5d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:47.383081 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-38ab018e-2784-4ad0-836a-0309b0a80b5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:47.388914 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 310/625] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:47.391106 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bed3b0-da5a-4310-aae8-a3f43af7895d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:47.392695 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e28ac-2b62-4cc3-b612-d880c65d0bf6 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.393228 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e28ac-2b62-4cc3-b612-d880c65d0bf6 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.393717 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e28ac-2b62-4cc3-b612-d880c65d0bf6 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.395955 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 311/626] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:44:47.404559 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f15351-bf75-4265-ad58-46b913233ef0 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.405212 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f15351-bf75-4265-ad58-46b913233ef0 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.405689 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f15351-bf75-4265-ad58-46b913233ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.413878 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bed3b0-da5a-4310-aae8-a3f43af7895d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:47.425799 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-f5f15351-bf75-4265-ad58-46b913233ef0 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:47.427375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-f5f15351-bf75-4265-ad58-46b913233ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:47.428682 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ec79c-6d1b-449e-aa9c-3838c04b1c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:47.429393 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ec79c-6d1b-449e-aa9c-3838c04b1c5d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.429769 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ec79c-6d1b-449e-aa9c-3838c04b1c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.430048 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ec79c-6d1b-449e-aa9c-3838c04b1c5d admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.430830 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ec79c-6d1b-449e-aa9c-3838c04b1c5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:47.431194 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ec79c-6d1b-449e-aa9c-3838c04b1c5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:47.432931 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ec79c-6d1b-449e-aa9c-3838c04b1c5d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:47.437384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 312/627] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:47 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:47.462520 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 316/628] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:47.463894 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f15351-bf75-4265-ad58-46b913233ef0 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:47.468290 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ec79c-6d1b-449e-aa9c-3838c04b1c5d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:47.474463 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f15351-bf75-4265-ad58-46b913233ef0 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:47.480147 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb7060-79e8-44b8-b91e-af51fb46c643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:47.481432 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb7060-79e8-44b8-b91e-af51fb46c643 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.481923 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb7060-79e8-44b8-b91e-af51fb46c643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.482424 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb7060-79e8-44b8-b91e-af51fb46c643 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.483478 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ec79c-6d1b-449e-aa9c-3838c04b1c5d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:47.495350 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb7060-79e8-44b8-b91e-af51fb46c643 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:47.495535 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea4a0f-2db4-4bc2-afb3-a5342667ba8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:47.496214 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea4a0f-2db4-4bc2-afb3-a5342667ba8a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.496499 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea4a0f-2db4-4bc2-afb3-a5342667ba8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.496773 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea4a0f-2db4-4bc2-afb3-a5342667ba8a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.503548 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-26eb7060-79e8-44b8-b91e-af51fb46c643 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:44:47.505339 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 313/629] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:47.511075 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea4a0f-2db4-4bc2-afb3-a5342667ba8a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:47.512245 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb7060-79e8-44b8-b91e-af51fb46c643 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:47.513297 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea4a0f-2db4-4bc2-afb3-a5342667ba8a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:47.533110 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-83ea4a0f-2db4-4bc2-afb3-a5342667ba8a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:47.535226 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb7060-79e8-44b8-b91e-af51fb46c643 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:47.540678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 317/630] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:47.542387 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea4a0f-2db4-4bc2-afb3-a5342667ba8a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:47.555770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fafe0f-8060-455c-a684-6e7f5dd0b653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:47.555770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fafe0f-8060-455c-a684-6e7f5dd0b653 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.555770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fafe0f-8060-455c-a684-6e7f5dd0b653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.555770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fafe0f-8060-455c-a684-6e7f5dd0b653 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.556120 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fafe0f-8060-455c-a684-6e7f5dd0b653 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:47.556120 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fafe0f-8060-455c-a684-6e7f5dd0b653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:47.556520 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fafe0f-8060-455c-a684-6e7f5dd0b653 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:47.561738 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea4a0f-2db4-4bc2-afb3-a5342667ba8a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:47.573646 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 314/631] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:44:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:47.579906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fafe0f-8060-455c-a684-6e7f5dd0b653 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:47.585513 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dfc71-0901-474a-ad5e-4e4a596be89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:47.586881 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dfc71-0901-474a-ad5e-4e4a596be89c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.587157 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dfc71-0901-474a-ad5e-4e4a596be89c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.587611 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dfc71-0901-474a-ad5e-4e4a596be89c admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.588402 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dfc71-0901-474a-ad5e-4e4a596be89c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:47.588707 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dfc71-0901-474a-ad5e-4e4a596be89c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:47.590608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dfc71-0901-474a-ad5e-4e4a596be89c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:47.599021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fafe0f-8060-455c-a684-6e7f5dd0b653 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:47.605018 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c532372-cbcc-4a05-b6dc-a12091831404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:47.606106 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c532372-cbcc-4a05-b6dc-a12091831404 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.606610 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c532372-cbcc-4a05-b6dc-a12091831404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.607081 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c532372-cbcc-4a05-b6dc-a12091831404 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.612120 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 318/632] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:47.614300 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f3ff-20f3-48b2-8e2c-4a78edec0ee0 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.614639 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f3ff-20f3-48b2-8e2c-4a78edec0ee0 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.614914 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f3ff-20f3-48b2-8e2c-4a78edec0ee0 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.616989 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 319/633] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:47.619403 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652f3ff-20f3-48b2-8e2c-4a78edec0ee0 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:47.625708 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c532372-cbcc-4a05-b6dc-a12091831404 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:47.628155 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c532372-cbcc-4a05-b6dc-a12091831404 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:47.637259 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652f3ff-20f3-48b2-8e2c-4a78edec0ee0 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:47.642476 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92380280-0bde-4a80-b63d-459572396824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:47.643662 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92380280-0bde-4a80-b63d-459572396824 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.644123 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92380280-0bde-4a80-b63d-459572396824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.644555 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92380280-0bde-4a80-b63d-459572396824 admin admin] PATH_INFO: `/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/cc85f5db9c3c47fca68ebab33b0bb73c/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.646931 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92380280-0bde-4a80-b63d-459572396824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356ecb479ba24136a7c38cb5a58a0a18, user_id=cc85f5db9c3c47fca68ebab33b0bb73c, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:47.649529 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-4c532372-cbcc-4a05-b6dc-a12091831404 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:47.650857 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92380280-0bde-4a80-b63d-459572396824 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:47.651227 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 315/634] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:47.652805 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84af67-0ef1-41f4-9242-79c193b69297 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.657602 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84af67-0ef1-41f4-9242-79c193b69297 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.658790 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84af67-0ef1-41f4-9242-79c193b69297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.670113 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 320/635] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:44:47 2022] PUT /identity/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/cc85f5db9c3c47fca68ebab33b0bb73c/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:44:47.671343 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92380280-0bde-4a80-b63d-459572396824 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:47.688711 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-cd84af67-0ef1-41f4-9242-79c193b69297 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:47.690962 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-cd84af67-0ef1-41f4-9242-79c193b69297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:47.764364 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 316/636] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:47 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:47.797455 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92380280-0bde-4a80-b63d-459572396824 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:47.802349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8e8e5-d4c3-42fc-98d6-f2b6f70a1779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:47.803180 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8e8e5-d4c3-42fc-98d6-f2b6f70a1779 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.803562 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8e8e5-d4c3-42fc-98d6-f2b6f70a1779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.803961 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8e8e5-d4c3-42fc-98d6-f2b6f70a1779 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.805532 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8e8e5-d4c3-42fc-98d6-f2b6f70a1779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:47.806091 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8e8e5-d4c3-42fc-98d6-f2b6f70a1779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:47.809019 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84af67-0ef1-41f4-9242-79c193b69297 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:47.816994 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8e8e5-d4c3-42fc-98d6-f2b6f70a1779 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:47.819036 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84af67-0ef1-41f4-9242-79c193b69297 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:47.823937 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5577310-e571-47d3-90e3-3bed7d4926dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:47.824773 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5577310-e571-47d3-90e3-3bed7d4926dc admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.825205 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5577310-e571-47d3-90e3-3bed7d4926dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.825594 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5577310-e571-47d3-90e3-3bed7d4926dc admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.827099 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5577310-e571-47d3-90e3-3bed7d4926dc admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:47.828242 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING py.warnings [None req-a5577310-e571-47d3-90e3-3bed7d4926dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:47.828242 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: warnings.warn(msg) Jan 28 01:44:47.828242 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: Jan 28 01:44:47.829371 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5577310-e571-47d3-90e3-3bed7d4926dc admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:47.840410 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 321/637] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:47.847122 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8e8e5-d4c3-42fc-98d6-f2b6f70a1779 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:47.865172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 317/638] 10.222.0.96 () {60 vars in 1162 bytes} [Fri Jan 28 01:44:47 2022] POST /identity/v3/services => generated 251 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:44:47.870142 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8e8e5-d4c3-42fc-98d6-f2b6f70a1779 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:47.886937 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d971859-7f6b-4ff3-8841-2543f6cb00b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:47.887953 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d971859-7f6b-4ff3-8841-2543f6cb00b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.888385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d971859-7f6b-4ff3-8841-2543f6cb00b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.888764 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d971859-7f6b-4ff3-8841-2543f6cb00b3 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.898238 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d971859-7f6b-4ff3-8841-2543f6cb00b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:47.900863 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d971859-7f6b-4ff3-8841-2543f6cb00b3 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:47.919089 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-2d971859-7f6b-4ff3-8841-2543f6cb00b3 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:44:47.922815 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 322/639] 10.222.0.96 () {56 vars in 1138 bytes} [Fri Jan 28 01:44:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:47.927621 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5577310-e571-47d3-90e3-3bed7d4926dc admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:47.940608 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5577310-e571-47d3-90e3-3bed7d4926dc admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:47.946376 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a934f-01dd-4387-b5d8-c9afc5a318a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:47.947211 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a934f-01dd-4387-b5d8-c9afc5a318a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.947497 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a934f-01dd-4387-b5d8-c9afc5a318a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.947779 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a934f-01dd-4387-b5d8-c9afc5a318a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:47.948748 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a934f-01dd-4387-b5d8-c9afc5a318a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:47.949105 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a934f-01dd-4387-b5d8-c9afc5a318a9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:47.951179 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a934f-01dd-4387-b5d8-c9afc5a318a9 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:47.974893 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 318/640] 10.222.0.96 () {56 vars in 1170 bytes} [Fri Jan 28 01:44:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:47.981990 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d971859-7f6b-4ff3-8841-2543f6cb00b3 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:47.993735 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d971859-7f6b-4ff3-8841-2543f6cb00b3 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:47.998659 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ade8f0-4303-4daf-b58b-076dbc2efa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:47.999324 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ade8f0-4303-4daf-b58b-076dbc2efa5c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:47.999594 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ade8f0-4303-4daf-b58b-076dbc2efa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:47.999864 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ade8f0-4303-4daf-b58b-076dbc2efa5c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:48.009529 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ade8f0-4303-4daf-b58b-076dbc2efa5c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:48.011299 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ade8f0-4303-4daf-b58b-076dbc2efa5c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:48.021799 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 323/641] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:47 2022] GET /identity/v3/auth/tokens => generated 1171 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:48.028711 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a934f-01dd-4387-b5d8-c9afc5a318a9 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:48.039162 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a934f-01dd-4387-b5d8-c9afc5a318a9 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:48.043963 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e0b5a-2ea5-4778-89e9-47bed981a6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:48.044766 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e0b5a-2ea5-4778-89e9-47bed981a6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:48.045074 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e0b5a-2ea5-4778-89e9-47bed981a6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:48.045401 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e0b5a-2ea5-4778-89e9-47bed981a6e1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:48.058299 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e0b5a-2ea5-4778-89e9-47bed981a6e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:48.060224 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e0b5a-2ea5-4778-89e9-47bed981a6e1 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:48.074947 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac3477-71d5-4861-a428-e3402dd4a188 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:48.075225 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac3477-71d5-4861-a428-e3402dd4a188 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:48.075499 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac3477-71d5-4861-a428-e3402dd4a188 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:48.077594 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 324/642] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:44:48.082394 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-1b4e0b5a-2ea5-4778-89e9-47bed981a6e1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:48.084099 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 319/643] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:48.089876 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef9548-688e-4de5-ab6a-e650ea6691a0 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:48.090307 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef9548-688e-4de5-ab6a-e650ea6691a0 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:48.090695 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef9548-688e-4de5-ab6a-e650ea6691a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:48.108125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e0b5a-2ea5-4778-89e9-47bed981a6e1 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:48.115900 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-4cef9548-688e-4de5-ab6a-e650ea6691a0 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:48.117870 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-4cef9548-688e-4de5-ab6a-e650ea6691a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:48.123417 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e0b5a-2ea5-4778-89e9-47bed981a6e1 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:48.127700 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 325/644] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:48 2022] POST /identity/v3/auth/tokens => generated 1171 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:48.133380 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e43c31-0fcb-4d38-99bb-f88009f0db6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:48.134068 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e43c31-0fcb-4d38-99bb-f88009f0db6c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:48.134353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e43c31-0fcb-4d38-99bb-f88009f0db6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:48.134676 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e43c31-0fcb-4d38-99bb-f88009f0db6c admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:48.135408 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e43c31-0fcb-4d38-99bb-f88009f0db6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:48.135763 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e43c31-0fcb-4d38-99bb-f88009f0db6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:48.137435 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e43c31-0fcb-4d38-99bb-f88009f0db6c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:48.150993 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 320/645] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:48.156906 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef9548-688e-4de5-ab6a-e650ea6691a0 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:48.159736 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e43c31-0fcb-4d38-99bb-f88009f0db6c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:48.168758 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef9548-688e-4de5-ab6a-e650ea6691a0 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:48.171014 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e43c31-0fcb-4d38-99bb-f88009f0db6c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:48.174779 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fd22e-e68c-41df-afec-3eb56010bdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:48.175625 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8fc31-96df-40fa-800a-868c031a50a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:48.176014 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fd22e-e68c-41df-afec-3eb56010bdee admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:48.176443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8fc31-96df-40fa-800a-868c031a50a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:48.176682 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fd22e-e68c-41df-afec-3eb56010bdee admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:48.176906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8fc31-96df-40fa-800a-868c031a50a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:48.177247 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8fc31-96df-40fa-800a-868c031a50a8 admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:48.177522 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fd22e-e68c-41df-afec-3eb56010bdee admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:48.178158 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8fc31-96df-40fa-800a-868c031a50a8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:48.180883 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8fc31-96df-40fa-800a-868c031a50a8 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:48.186428 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fd22e-e68c-41df-afec-3eb56010bdee admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:48.188685 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fd22e-e68c-41df-afec-3eb56010bdee admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:48.202690 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 321/646] 10.222.0.96 () {60 vars in 1162 bytes} [Fri Jan 28 01:44:48 2022] POST /identity/v3/services => generated 240 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:44:48.207895 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-276fd22e-e68c-41df-afec-3eb56010bdee admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:48.209587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 326/647] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:48.221925 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8fc31-96df-40fa-800a-868c031a50a8 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:48.258816 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8fc31-96df-40fa-800a-868c031a50a8 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:48.264303 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e4c86-643d-4f35-8a3b-63c77173c3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:48.265474 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e4c86-643d-4f35-8a3b-63c77173c3bb admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:48.265997 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e4c86-643d-4f35-8a3b-63c77173c3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:48.266520 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e4c86-643d-4f35-8a3b-63c77173c3bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:48.267570 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e4c86-643d-4f35-8a3b-63c77173c3bb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:48.268224 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e4c86-643d-4f35-8a3b-63c77173c3bb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:48.270522 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e4c86-643d-4f35-8a3b-63c77173c3bb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:48.288000 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 322/648] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:48.295090 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fd22e-e68c-41df-afec-3eb56010bdee admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:48.318584 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fd22e-e68c-41df-afec-3eb56010bdee admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:48.327075 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327df70-2aec-4e35-b92a-a5c42a1aaeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:48.327737 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327df70-2aec-4e35-b92a-a5c42a1aaeaa admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:48.328012 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327df70-2aec-4e35-b92a-a5c42a1aaeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:48.328276 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327df70-2aec-4e35-b92a-a5c42a1aaeaa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:48.329132 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327df70-2aec-4e35-b92a-a5c42a1aaeaa admin admin] RBAC: Adding query filter params (role.id=4d7fce301eec49a7a54390167747fe24, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=591d508a3867412fac76d00134e58864) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:48.329462 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327df70-2aec-4e35-b92a-a5c42a1aaeaa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:48.331305 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327df70-2aec-4e35-b92a-a5c42a1aaeaa admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:48.341358 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 327/649] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:48 2022] GET /identity/v3/role_assignments?user.id=591d508a3867412fac76d00134e58864&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=4d7fce301eec49a7a54390167747fe24 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:49.154480 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4a302-9950-43b9-8ac7-5d778a5154e9 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:49.155577 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4a302-9950-43b9-8ac7-5d778a5154e9 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:49.156085 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4a302-9950-43b9-8ac7-5d778a5154e9 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:49.158488 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 323/650] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:49.167402 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004bce3-1e84-47cd-86cb-ce312bc87eef None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:49.168327 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004bce3-1e84-47cd-86cb-ce312bc87eef None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:49.168849 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004bce3-1e84-47cd-86cb-ce312bc87eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:49.192256 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-8004bce3-1e84-47cd-86cb-ce312bc87eef None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:49.193846 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-8004bce3-1e84-47cd-86cb-ce312bc87eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:49.207601 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 328/651] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:49 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:49.246483 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4a302-9950-43b9-8ac7-5d778a5154e9 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:49.262377 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4a302-9950-43b9-8ac7-5d778a5154e9 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:49.270923 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08569e5b-5189-4600-8706-dcf2db55bf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:49.272181 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08569e5b-5189-4600-8706-dcf2db55bf79 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:49.272680 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08569e5b-5189-4600-8706-dcf2db55bf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:49.273186 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08569e5b-5189-4600-8706-dcf2db55bf79 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:49.293427 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08569e5b-5189-4600-8706-dcf2db55bf79 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:49.300558 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-08569e5b-5189-4600-8706-dcf2db55bf79 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:44:49.302107 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 324/652] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:49.309343 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004bce3-1e84-47cd-86cb-ce312bc87eef None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:49.318952 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004bce3-1e84-47cd-86cb-ce312bc87eef None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:49.329101 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46052903-219c-4db5-aa4d-5768bd2961df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:49.330145 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46052903-219c-4db5-aa4d-5768bd2961df admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:49.330648 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46052903-219c-4db5-aa4d-5768bd2961df admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:49.331126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46052903-219c-4db5-aa4d-5768bd2961df admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:49.332079 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46052903-219c-4db5-aa4d-5768bd2961df admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:49.332631 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46052903-219c-4db5-aa4d-5768bd2961df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:49.334504 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46052903-219c-4db5-aa4d-5768bd2961df admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:49.348683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 329/653] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:49.355201 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08569e5b-5189-4600-8706-dcf2db55bf79 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:49.370376 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08569e5b-5189-4600-8706-dcf2db55bf79 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:49.380696 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23106355-5021-44cf-b653-ff8b65b8a11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:49.381900 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23106355-5021-44cf-b653-ff8b65b8a11d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:49.382395 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23106355-5021-44cf-b653-ff8b65b8a11d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:49.383406 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23106355-5021-44cf-b653-ff8b65b8a11d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:49.400618 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23106355-5021-44cf-b653-ff8b65b8a11d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:49.403102 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23106355-5021-44cf-b653-ff8b65b8a11d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:49.426569 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-23106355-5021-44cf-b653-ff8b65b8a11d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:49.428437 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 325/654] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:49.438149 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46052903-219c-4db5-aa4d-5768bd2961df admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:49.450713 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46052903-219c-4db5-aa4d-5768bd2961df admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:49.456611 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa2659-cd5f-4d71-a9b9-2998a01cf40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:49.457675 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa2659-cd5f-4d71-a9b9-2998a01cf40d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:49.458165 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa2659-cd5f-4d71-a9b9-2998a01cf40d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:49.458644 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa2659-cd5f-4d71-a9b9-2998a01cf40d admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:49.459591 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa2659-cd5f-4d71-a9b9-2998a01cf40d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:49.460134 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa2659-cd5f-4d71-a9b9-2998a01cf40d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:49.463345 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa2659-cd5f-4d71-a9b9-2998a01cf40d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:49.482217 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 330/655] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:49.488352 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23106355-5021-44cf-b653-ff8b65b8a11d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:49.506099 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23106355-5021-44cf-b653-ff8b65b8a11d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:49.513235 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fd6b7-f055-4ed3-b059-48531b28f785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:49.514392 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fd6b7-f055-4ed3-b059-48531b28f785 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:49.514977 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fd6b7-f055-4ed3-b059-48531b28f785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:49.515475 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fd6b7-f055-4ed3-b059-48531b28f785 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:49.529577 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fd6b7-f055-4ed3-b059-48531b28f785 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:49.531964 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fd6b7-f055-4ed3-b059-48531b28f785 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:49.551803 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-400fd6b7-f055-4ed3-b059-48531b28f785 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:44:49.553337 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 326/656] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:49.562799 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa2659-cd5f-4d71-a9b9-2998a01cf40d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:49.579069 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa2659-cd5f-4d71-a9b9-2998a01cf40d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:49.597710 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e38f6-a755-466e-afe2-e3391dd03e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:49.598416 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e38f6-a755-466e-afe2-e3391dd03e11 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:49.598695 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e38f6-a755-466e-afe2-e3391dd03e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:49.598971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e38f6-a755-466e-afe2-e3391dd03e11 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:49.599822 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e38f6-a755-466e-afe2-e3391dd03e11 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:49.600128 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e38f6-a755-466e-afe2-e3391dd03e11 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:49.602433 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e38f6-a755-466e-afe2-e3391dd03e11 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:49.627672 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 331/657] 10.222.0.96 () {56 vars in 1156 bytes} [Fri Jan 28 01:44:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:49.634938 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fd6b7-f055-4ed3-b059-48531b28f785 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:49.651108 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fd6b7-f055-4ed3-b059-48531b28f785 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:49.659971 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8aae81-bfff-42a0-ba0d-10e5a10ccff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:49.661092 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8aae81-bfff-42a0-ba0d-10e5a10ccff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:49.661585 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8aae81-bfff-42a0-ba0d-10e5a10ccff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:49.662078 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8aae81-bfff-42a0-ba0d-10e5a10ccff6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:49.676915 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8aae81-bfff-42a0-ba0d-10e5a10ccff6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:49.678608 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8aae81-bfff-42a0-ba0d-10e5a10ccff6 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:49.689054 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 327/658] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:49 2022] GET /identity/v3/auth/tokens => generated 1270 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:49.694953 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e38f6-a755-466e-afe2-e3391dd03e11 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:49.705599 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e38f6-a755-466e-afe2-e3391dd03e11 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:49.716947 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c77a5-db3e-42fc-bb94-75e05ac3db81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:49.717771 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c77a5-db3e-42fc-bb94-75e05ac3db81 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:49.718053 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c77a5-db3e-42fc-bb94-75e05ac3db81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:49.718325 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c77a5-db3e-42fc-bb94-75e05ac3db81 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:49.730752 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c77a5-db3e-42fc-bb94-75e05ac3db81 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:49.732597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c77a5-db3e-42fc-bb94-75e05ac3db81 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:49.759670 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-d40c77a5-db3e-42fc-bb94-75e05ac3db81 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:49.761266 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 332/659] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:49.767104 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8aae81-bfff-42a0-ba0d-10e5a10ccff6 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:49.776838 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8aae81-bfff-42a0-ba0d-10e5a10ccff6 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:49.784968 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7e38c-b891-4442-be46-d2415c55b2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:49.785639 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7e38c-b891-4442-be46-d2415c55b2ed admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:49.785918 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7e38c-b891-4442-be46-d2415c55b2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:49.786190 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7e38c-b891-4442-be46-d2415c55b2ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:49.786909 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7e38c-b891-4442-be46-d2415c55b2ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:49.787211 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7e38c-b891-4442-be46-d2415c55b2ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:49.788811 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7e38c-b891-4442-be46-d2415c55b2ed admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:49.808622 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 328/660] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:49.813399 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c77a5-db3e-42fc-bb94-75e05ac3db81 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:49.825865 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c77a5-db3e-42fc-bb94-75e05ac3db81 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:49.832280 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc18f7-de5a-4595-a3ae-f1861e7b79ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:49.833107 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc18f7-de5a-4595-a3ae-f1861e7b79ae admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:49.833385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc18f7-de5a-4595-a3ae-f1861e7b79ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:49.833657 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc18f7-de5a-4595-a3ae-f1861e7b79ae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:49.842818 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc18f7-de5a-4595-a3ae-f1861e7b79ae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:49.844765 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc18f7-de5a-4595-a3ae-f1861e7b79ae admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:49.859112 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-e4fc18f7-de5a-4595-a3ae-f1861e7b79ae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:49.860665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 333/661] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:49.866644 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7e38c-b891-4442-be46-d2415c55b2ed admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:49.876648 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7e38c-b891-4442-be46-d2415c55b2ed admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:49.881239 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb5481-65f3-4214-b329-ed111269d33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:49.881896 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb5481-65f3-4214-b329-ed111269d33e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:49.882173 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb5481-65f3-4214-b329-ed111269d33e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:49.882443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb5481-65f3-4214-b329-ed111269d33e admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:49.883753 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb5481-65f3-4214-b329-ed111269d33e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:49.884156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb5481-65f3-4214-b329-ed111269d33e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:49.886036 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb5481-65f3-4214-b329-ed111269d33e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:49.899787 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 329/662] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:49.905789 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc18f7-de5a-4595-a3ae-f1861e7b79ae admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:49.919140 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc18f7-de5a-4595-a3ae-f1861e7b79ae admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:49.931007 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e038a44-cd6d-48f5-9dae-a63de30a5791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:49.932042 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e038a44-cd6d-48f5-9dae-a63de30a5791 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:49.932532 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e038a44-cd6d-48f5-9dae-a63de30a5791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:49.933043 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e038a44-cd6d-48f5-9dae-a63de30a5791 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:49.934569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e038a44-cd6d-48f5-9dae-a63de30a5791 admin admin] RBAC: Adding query filter params (role.id=253c0a1dc8d6421298a7987caaa55676, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=83a2c3b2815f46b0ac27944f004c4821) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:49.935109 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e038a44-cd6d-48f5-9dae-a63de30a5791 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:49.937469 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e038a44-cd6d-48f5-9dae-a63de30a5791 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:49.943983 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 334/663] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:49 2022] GET /identity/v3/role_assignments?user.id=83a2c3b2815f46b0ac27944f004c4821&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:50.712822 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a68ee-e1e3-4fda-9f88-acd4579caad1 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:50.712822 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a68ee-e1e3-4fda-9f88-acd4579caad1 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:50.712822 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a68ee-e1e3-4fda-9f88-acd4579caad1 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:50.715249 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 330/664] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:50.722105 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890426a-13d5-446a-948a-176dce4ae113 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:50.722696 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890426a-13d5-446a-948a-176dce4ae113 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:50.722696 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890426a-13d5-446a-948a-176dce4ae113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:50.749869 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-d890426a-13d5-446a-948a-176dce4ae113 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:50.751092 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-d890426a-13d5-446a-948a-176dce4ae113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:50.759547 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 335/665] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:50 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:50.806283 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a68ee-e1e3-4fda-9f88-acd4579caad1 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:50.829515 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a68ee-e1e3-4fda-9f88-acd4579caad1 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:50.834688 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade35f0-f2db-43f4-9b76-3b6916c777ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:50.835763 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade35f0-f2db-43f4-9b76-3b6916c777ea admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:50.836256 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade35f0-f2db-43f4-9b76-3b6916c777ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:50.836738 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade35f0-f2db-43f4-9b76-3b6916c777ea admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:50.854028 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade35f0-f2db-43f4-9b76-3b6916c777ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:50.865318 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-bade35f0-f2db-43f4-9b76-3b6916c777ea admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:44:50.867207 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 331/666] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:50.873746 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade35f0-f2db-43f4-9b76-3b6916c777ea admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:50.874055 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6f39d-bba8-4219-9be7-6d3a2be74c8a None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:50.874323 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6f39d-bba8-4219-9be7-6d3a2be74c8a None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:50.874541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6f39d-bba8-4219-9be7-6d3a2be74c8a None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:50.876776 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 336/667] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:50.884673 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cebdb8-5e41-4d78-808b-fdc2c753e364 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:50.885064 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cebdb8-5e41-4d78-808b-fdc2c753e364 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:50.885237 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cebdb8-5e41-4d78-808b-fdc2c753e364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:50.888825 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade35f0-f2db-43f4-9b76-3b6916c777ea admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:50.899537 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611efaf0-aa16-48de-b778-1c4e7b58ac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:50.900220 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611efaf0-aa16-48de-b778-1c4e7b58ac9c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:50.900497 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611efaf0-aa16-48de-b778-1c4e7b58ac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:50.900767 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611efaf0-aa16-48de-b778-1c4e7b58ac9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:50.901542 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611efaf0-aa16-48de-b778-1c4e7b58ac9c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:50.901846 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611efaf0-aa16-48de-b778-1c4e7b58ac9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:50.903702 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611efaf0-aa16-48de-b778-1c4e7b58ac9c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:50.918456 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-a4cebdb8-5e41-4d78-808b-fdc2c753e364 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:50.919676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a4cebdb8-5e41-4d78-808b-fdc2c753e364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:50.926861 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 332/668] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:50.932236 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611efaf0-aa16-48de-b778-1c4e7b58ac9c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:50.934643 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 337/669] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:50 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:50.951196 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611efaf0-aa16-48de-b778-1c4e7b58ac9c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:50.958137 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cebdb8-5e41-4d78-808b-fdc2c753e364 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:50.961628 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6ab13-b99a-40ac-acb1-9ed1aad0431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:50.962630 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6ab13-b99a-40ac-acb1-9ed1aad0431f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:50.963172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6ab13-b99a-40ac-acb1-9ed1aad0431f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:50.963450 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6ab13-b99a-40ac-acb1-9ed1aad0431f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:50.968052 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cebdb8-5e41-4d78-808b-fdc2c753e364 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:50.973297 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e3aaf-27e7-4221-8cc0-4136f209dc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:50.974120 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e3aaf-27e7-4221-8cc0-4136f209dc9f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:50.974396 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e3aaf-27e7-4221-8cc0-4136f209dc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:50.974666 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e3aaf-27e7-4221-8cc0-4136f209dc9f admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:50.975326 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e3aaf-27e7-4221-8cc0-4136f209dc9f admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:50.977347 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e3aaf-27e7-4221-8cc0-4136f209dc9f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:50.980853 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6ab13-b99a-40ac-acb1-9ed1aad0431f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:50.983150 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6ab13-b99a-40ac-acb1-9ed1aad0431f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:50.989579 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-322e3aaf-27e7-4221-8cc0-4136f209dc9f admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 28 01:44:50.990963 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 338/670] 10.222.0.96 () {56 vars in 1150 bytes} [Fri Jan 28 01:44:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:50.998195 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed1e16-996c-40b8-ae99-078faa2ef1a0 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:50.998482 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed1e16-996c-40b8-ae99-078faa2ef1a0 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:50.998767 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed1e16-996c-40b8-ae99-078faa2ef1a0 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.000883 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 339/671] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:51.001107 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-66d6ab13-b99a-40ac-acb1-9ed1aad0431f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:51.001917 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed1e16-996c-40b8-ae99-078faa2ef1a0 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.002706 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 333/672] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:51.009544 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6ab13-b99a-40ac-acb1-9ed1aad0431f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.019742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6ab13-b99a-40ac-acb1-9ed1aad0431f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.020676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed1e16-996c-40b8-ae99-078faa2ef1a0 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.025189 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e70b6a-79eb-42b6-b7f5-37a8efb0854f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.026052 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e70b6a-79eb-42b6-b7f5-37a8efb0854f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.026483 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e70b6a-79eb-42b6-b7f5-37a8efb0854f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.026596 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e0858-d14a-42cd-8958-107f3a620d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.027264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e70b6a-79eb-42b6-b7f5-37a8efb0854f admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.027754 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e0858-d14a-42cd-8958-107f3a620d5c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.028126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e0858-d14a-42cd-8958-107f3a620d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.028478 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e70b6a-79eb-42b6-b7f5-37a8efb0854f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:51.028599 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e0858-d14a-42cd-8958-107f3a620d5c admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.029061 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e70b6a-79eb-42b6-b7f5-37a8efb0854f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.029540 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e0858-d14a-42cd-8958-107f3a620d5c admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:51.029978 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e0858-d14a-42cd-8958-107f3a620d5c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.031136 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e70b6a-79eb-42b6-b7f5-37a8efb0854f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.031816 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e0858-d14a-42cd-8958-107f3a620d5c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.037925 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 340/673] 10.222.0.96 () {56 vars in 1145 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:51.039191 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2622d-bb10-48dd-afde-4452ee63a000 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.041110 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2622d-bb10-48dd-afde-4452ee63a000 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.041534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2622d-bb10-48dd-afde-4452ee63a000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.051732 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 334/674] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:51.052764 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e70b6a-79eb-42b6-b7f5-37a8efb0854f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.065050 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-53e2622d-bb10-48dd-afde-4452ee63a000 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:51.066586 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-53e2622d-bb10-48dd-afde-4452ee63a000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:51.068298 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e70b6a-79eb-42b6-b7f5-37a8efb0854f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.073943 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099a4ad-d4f5-4d2b-8abb-fa6cafb48354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.074676 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099a4ad-d4f5-4d2b-8abb-fa6cafb48354 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.075027 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099a4ad-d4f5-4d2b-8abb-fa6cafb48354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.075403 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099a4ad-d4f5-4d2b-8abb-fa6cafb48354 admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.076127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099a4ad-d4f5-4d2b-8abb-fa6cafb48354 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:51.076521 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099a4ad-d4f5-4d2b-8abb-fa6cafb48354 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.077465 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 341/675] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:51 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:51.078302 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099a4ad-d4f5-4d2b-8abb-fa6cafb48354 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.078758 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2622d-bb10-48dd-afde-4452ee63a000 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.089073 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 335/676] 10.222.0.96 () {56 vars in 1145 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:51.089242 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2622d-bb10-48dd-afde-4452ee63a000 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.095209 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099a4ad-d4f5-4d2b-8abb-fa6cafb48354 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.105716 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099a4ad-d4f5-4d2b-8abb-fa6cafb48354 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.107504 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237e48e-b946-4e63-8268-9368db4fb5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.108567 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237e48e-b946-4e63-8268-9368db4fb5ae admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.108893 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237e48e-b946-4e63-8268-9368db4fb5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.109167 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237e48e-b946-4e63-8268-9368db4fb5ae admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.110579 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d558a4-3905-412a-8aeb-66b06881ee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.111287 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d558a4-3905-412a-8aeb-66b06881ee7e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.111635 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d558a4-3905-412a-8aeb-66b06881ee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.111972 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d558a4-3905-412a-8aeb-66b06881ee7e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.112837 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d558a4-3905-412a-8aeb-66b06881ee7e admin admin] RBAC: Adding query filter params (interface=public, service_id=17441443cb124d268b92a93ab32adc26, region_id=RegionOne) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:51.113244 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d558a4-3905-412a-8aeb-66b06881ee7e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.114305 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING py.warnings [None req-37d558a4-3905-412a-8aeb-66b06881ee7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:51.114305 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: warnings.warn(msg) Jan 28 01:44:51.114305 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: Jan 28 01:44:51.115267 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d558a4-3905-412a-8aeb-66b06881ee7e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.118079 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237e48e-b946-4e63-8268-9368db4fb5ae admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.120175 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237e48e-b946-4e63-8268-9368db4fb5ae admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.124466 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 336/677] 10.222.0.96 () {56 vars in 1272 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/endpoints?service_id=17441443cb124d268b92a93ab32adc26&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:51.125452 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d558a4-3905-412a-8aeb-66b06881ee7e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.135521 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d558a4-3905-412a-8aeb-66b06881ee7e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.140207 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22de6e-3cbe-4f89-a9a7-465bda3f1191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.140937 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-a237e48e-b946-4e63-8268-9368db4fb5ae admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:44:51.141102 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22de6e-3cbe-4f89-a9a7-465bda3f1191 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.141497 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22de6e-3cbe-4f89-a9a7-465bda3f1191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.141836 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22de6e-3cbe-4f89-a9a7-465bda3f1191 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.142145 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 342/678] 10.222.0.96 () {56 vars in 1114 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:51.142599 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22de6e-3cbe-4f89-a9a7-465bda3f1191 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.142972 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237e48e-b946-4e63-8268-9368db4fb5ae admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.144380 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22de6e-3cbe-4f89-a9a7-465bda3f1191 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.153473 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237e48e-b946-4e63-8268-9368db4fb5ae admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.156207 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-7e22de6e-3cbe-4f89-a9a7-465bda3f1191 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 28 01:44:51.157472 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 337/679] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/services/network => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:51.158206 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855da4e5-9c59-4e85-b47f-59e616a86fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.158385 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22de6e-3cbe-4f89-a9a7-465bda3f1191 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.158850 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855da4e5-9c59-4e85-b47f-59e616a86fdc admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.159201 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855da4e5-9c59-4e85-b47f-59e616a86fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.159464 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855da4e5-9c59-4e85-b47f-59e616a86fdc admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.160141 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855da4e5-9c59-4e85-b47f-59e616a86fdc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.161752 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855da4e5-9c59-4e85-b47f-59e616a86fdc admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.168161 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 343/680] 10.222.0.96 () {56 vars in 1108 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/services => generated 772 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:51.168740 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22de6e-3cbe-4f89-a9a7-465bda3f1191 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.169052 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855da4e5-9c59-4e85-b47f-59e616a86fdc admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.181784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855da4e5-9c59-4e85-b47f-59e616a86fdc admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.184308 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d9a63-1c07-4ff8-95cf-89874d8a5cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.185025 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d9a63-1c07-4ff8-95cf-89874d8a5cbe admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.185305 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d9a63-1c07-4ff8-95cf-89874d8a5cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.185576 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d9a63-1c07-4ff8-95cf-89874d8a5cbe admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.186440 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d9a63-1c07-4ff8-95cf-89874d8a5cbe admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:51.186635 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab1952-3dc7-402d-88fb-9bc629dcb401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.186809 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d9a63-1c07-4ff8-95cf-89874d8a5cbe admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.187215 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab1952-3dc7-402d-88fb-9bc629dcb401 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.187494 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab1952-3dc7-402d-88fb-9bc629dcb401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.187764 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab1952-3dc7-402d-88fb-9bc629dcb401 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.188471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab1952-3dc7-402d-88fb-9bc629dcb401 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:51.188648 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d9a63-1c07-4ff8-95cf-89874d8a5cbe admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.188881 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab1952-3dc7-402d-88fb-9bc629dcb401 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.190417 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab1952-3dc7-402d-88fb-9bc629dcb401 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.196523 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 344/681] 10.222.0.96 () {56 vars in 1133 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:51.202933 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab1952-3dc7-402d-88fb-9bc629dcb401 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.221038 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab1952-3dc7-402d-88fb-9bc629dcb401 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.226864 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 338/682] 10.222.0.96 () {56 vars in 1154 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:51.229687 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79191b-e263-488a-b647-b5d26f29e4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.230353 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79191b-e263-488a-b647-b5d26f29e4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.230630 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79191b-e263-488a-b647-b5d26f29e4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.230901 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79191b-e263-488a-b647-b5d26f29e4d1 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.231602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79191b-e263-488a-b647-b5d26f29e4d1 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:51.231902 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79191b-e263-488a-b647-b5d26f29e4d1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.234231 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79191b-e263-488a-b647-b5d26f29e4d1 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.234467 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d9a63-1c07-4ff8-95cf-89874d8a5cbe admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.244704 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 345/683] 10.222.0.96 () {56 vars in 1133 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:51.253739 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79191b-e263-488a-b647-b5d26f29e4d1 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.255464 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d9a63-1c07-4ff8-95cf-89874d8a5cbe admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.261887 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dfd6e-e88b-4a5d-a119-32289d38101b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.263214 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dfd6e-e88b-4a5d-a119-32289d38101b admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.263837 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dfd6e-e88b-4a5d-a119-32289d38101b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.264475 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dfd6e-e88b-4a5d-a119-32289d38101b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.274603 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dfd6e-e88b-4a5d-a119-32289d38101b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.275877 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79191b-e263-488a-b647-b5d26f29e4d1 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.277442 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dfd6e-e88b-4a5d-a119-32289d38101b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.288375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 339/684] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/auth/tokens => generated 1270 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:51.294863 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ba779-04a9-476a-956f-59bf5da919d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.294863 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ba779-04a9-476a-956f-59bf5da919d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.295121 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ba779-04a9-476a-956f-59bf5da919d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.295428 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ba779-04a9-476a-956f-59bf5da919d1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.296229 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ba779-04a9-476a-956f-59bf5da919d1 admin admin] RBAC: Adding query filter params (interface=public, service_id=05455dc9540c42ada44954dc9df6d540, region_id=RegionOne) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:51.296541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ba779-04a9-476a-956f-59bf5da919d1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.297096 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dfd6e-e88b-4a5d-a119-32289d38101b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.297686 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-9c2ba779-04a9-476a-956f-59bf5da919d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:51.297686 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:44:51.297686 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:44:51.298649 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ba779-04a9-476a-956f-59bf5da919d1 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.314438 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 346/685] 10.222.0.96 () {56 vars in 1272 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/endpoints?service_id=05455dc9540c42ada44954dc9df6d540&interface=public®ion_id=RegionOne => generated 194 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:51.314923 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dfd6e-e88b-4a5d-a119-32289d38101b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.320249 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ffc7b-7a04-4253-b2b4-622858c1df71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.321336 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ba779-04a9-476a-956f-59bf5da919d1 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.328683 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ffc7b-7a04-4253-b2b4-622858c1df71 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.330356 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ffc7b-7a04-4253-b2b4-622858c1df71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.330643 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ffc7b-7a04-4253-b2b4-622858c1df71 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.335261 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ba779-04a9-476a-956f-59bf5da919d1 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.346045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662100c-d7cd-4158-b0ff-e72a7bf00ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.347547 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662100c-d7cd-4158-b0ff-e72a7bf00ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.347927 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662100c-d7cd-4158-b0ff-e72a7bf00ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.348209 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662100c-d7cd-4158-b0ff-e72a7bf00ba2 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.348931 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662100c-d7cd-4158-b0ff-e72a7bf00ba2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.353922 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662100c-d7cd-4158-b0ff-e72a7bf00ba2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.356140 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ffc7b-7a04-4253-b2b4-622858c1df71 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.358040 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ffc7b-7a04-4253-b2b4-622858c1df71 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.365540 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 347/686] 10.222.0.96 () {56 vars in 1108 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/services => generated 772 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:51.380971 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-1f8ffc7b-7a04-4253-b2b4-622858c1df71 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:51.382541 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 340/687] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:51.390031 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662100c-d7cd-4158-b0ff-e72a7bf00ba2 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.404499 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662100c-d7cd-4158-b0ff-e72a7bf00ba2 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.415178 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe1fe0-a779-4326-8d2b-8ec5601969d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.416293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe1fe0-a779-4326-8d2b-8ec5601969d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.416720 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe1fe0-a779-4326-8d2b-8ec5601969d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.417195 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe1fe0-a779-4326-8d2b-8ec5601969d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.418109 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe1fe0-a779-4326-8d2b-8ec5601969d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:51.418562 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe1fe0-a779-4326-8d2b-8ec5601969d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.420419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe1fe0-a779-4326-8d2b-8ec5601969d4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.425740 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88052382-74cb-403f-b1fa-5d5361e7aae0 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.426263 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88052382-74cb-403f-b1fa-5d5361e7aae0 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.426745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88052382-74cb-403f-b1fa-5d5361e7aae0 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.429265 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 341/688] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:51.437405 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 348/689] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:51.438891 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46356a4-55c3-4f63-9db1-34caa7e62682 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.439386 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46356a4-55c3-4f63-9db1-34caa7e62682 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.439827 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46356a4-55c3-4f63-9db1-34caa7e62682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.449394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe1fe0-a779-4326-8d2b-8ec5601969d4 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.461069 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe1fe0-a779-4326-8d2b-8ec5601969d4 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.463962 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-b46356a4-55c3-4f63-9db1-34caa7e62682 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:51.467593 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b46356a4-55c3-4f63-9db1-34caa7e62682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:51.470800 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aee730-8941-422d-b4a5-02e3a1f2e460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.471629 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aee730-8941-422d-b4a5-02e3a1f2e460 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.471908 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aee730-8941-422d-b4a5-02e3a1f2e460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.472957 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aee730-8941-422d-b4a5-02e3a1f2e460 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.485650 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 342/690] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:51 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:51.491393 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aee730-8941-422d-b4a5-02e3a1f2e460 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.494908 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aee730-8941-422d-b4a5-02e3a1f2e460 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.510673 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-c0aee730-8941-422d-b4a5-02e3a1f2e460 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:51.512249 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 349/691] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:51.518995 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46356a4-55c3-4f63-9db1-34caa7e62682 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.532094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aee730-8941-422d-b4a5-02e3a1f2e460 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.549626 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46356a4-55c3-4f63-9db1-34caa7e62682 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.553895 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aee730-8941-422d-b4a5-02e3a1f2e460 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.559700 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e24c3d-badc-4494-9fc5-434ac90c3f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.560656 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e24c3d-badc-4494-9fc5-434ac90c3f8f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.562411 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e24c3d-badc-4494-9fc5-434ac90c3f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.562411 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e24c3d-badc-4494-9fc5-434ac90c3f8f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.569442 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdcd09-5501-4236-8f56-9d6a7c2a3da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.570110 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdcd09-5501-4236-8f56-9d6a7c2a3da7 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.570975 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdcd09-5501-4236-8f56-9d6a7c2a3da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.571376 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdcd09-5501-4236-8f56-9d6a7c2a3da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.572174 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdcd09-5501-4236-8f56-9d6a7c2a3da7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:51.572482 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdcd09-5501-4236-8f56-9d6a7c2a3da7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.575170 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdcd09-5501-4236-8f56-9d6a7c2a3da7 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.583937 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e24c3d-badc-4494-9fc5-434ac90c3f8f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:51.590914 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 343/692] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:51.598222 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-d9e24c3d-badc-4494-9fc5-434ac90c3f8f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:44:51.599909 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdcd09-5501-4236-8f56-9d6a7c2a3da7 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.600451 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 350/693] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:51.607008 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e24c3d-badc-4494-9fc5-434ac90c3f8f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.614377 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdcd09-5501-4236-8f56-9d6a7c2a3da7 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.617845 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e24c3d-badc-4494-9fc5-434ac90c3f8f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.619914 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bbfcc-51d4-469c-afa6-3cfe5eae47e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.620051 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bbfcc-51d4-469c-afa6-3cfe5eae47e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.621136 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bbfcc-51d4-469c-afa6-3cfe5eae47e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.622045 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bbfcc-51d4-469c-afa6-3cfe5eae47e8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.623424 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bbfcc-51d4-469c-afa6-3cfe5eae47e8 admin admin] RBAC: Adding query filter params (role.id=253c0a1dc8d6421298a7987caaa55676, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=cc85f5db9c3c47fca68ebab33b0bb73c) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:51.623740 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bbfcc-51d4-469c-afa6-3cfe5eae47e8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.625727 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bbfcc-51d4-469c-afa6-3cfe5eae47e8 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.627175 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c916b-d221-4454-b0ee-4ad385efef95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.628055 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c916b-d221-4454-b0ee-4ad385efef95 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.628491 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c916b-d221-4454-b0ee-4ad385efef95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.628986 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c916b-d221-4454-b0ee-4ad385efef95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.629929 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c916b-d221-4454-b0ee-4ad385efef95 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:51.630425 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c916b-d221-4454-b0ee-4ad385efef95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.632236 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c916b-d221-4454-b0ee-4ad385efef95 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.637918 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 344/694] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/role_assignments?user.id=cc85f5db9c3c47fca68ebab33b0bb73c&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:51.644309 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 351/695] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:51.651805 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bbfcc-51d4-469c-afa6-3cfe5eae47e8 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.663565 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bbfcc-51d4-469c-afa6-3cfe5eae47e8 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.668817 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddc59f-588d-4767-850d-8f0c4bd51f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.669925 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddc59f-588d-4767-850d-8f0c4bd51f69 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.670407 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddc59f-588d-4767-850d-8f0c4bd51f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.670866 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddc59f-588d-4767-850d-8f0c4bd51f69 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.685444 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ddc59f-588d-4767-850d-8f0c4bd51f69 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.687534 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ddc59f-588d-4767-850d-8f0c4bd51f69 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.705976 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-80ddc59f-588d-4767-850d-8f0c4bd51f69 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:51.707850 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 345/696] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:51.718235 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c916b-d221-4454-b0ee-4ad385efef95 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.729889 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c916b-d221-4454-b0ee-4ad385efef95 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.738568 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d96979-6c8b-4e79-9402-8d8cdacb2ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.739516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d96979-6c8b-4e79-9402-8d8cdacb2ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.739940 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d96979-6c8b-4e79-9402-8d8cdacb2ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.740412 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d96979-6c8b-4e79-9402-8d8cdacb2ad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.741318 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d96979-6c8b-4e79-9402-8d8cdacb2ad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:51.741829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d96979-6c8b-4e79-9402-8d8cdacb2ad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.744391 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d96979-6c8b-4e79-9402-8d8cdacb2ad8 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.760836 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 352/697] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:51.766732 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddc59f-588d-4767-850d-8f0c4bd51f69 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.779332 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddc59f-588d-4767-850d-8f0c4bd51f69 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.785128 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8d982-43a3-4b75-8db8-c37af17b8f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.786156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8d982-43a3-4b75-8db8-c37af17b8f47 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.786580 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8d982-43a3-4b75-8db8-c37af17b8f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.787113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8d982-43a3-4b75-8db8-c37af17b8f47 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.797939 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8d982-43a3-4b75-8db8-c37af17b8f47 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.800188 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8d982-43a3-4b75-8db8-c37af17b8f47 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.816769 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-94d8d982-43a3-4b75-8db8-c37af17b8f47 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:44:51.818312 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 346/698] 10.222.0.96 () {56 vars in 1138 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:51.826604 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d96979-6c8b-4e79-9402-8d8cdacb2ad8 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.838274 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d96979-6c8b-4e79-9402-8d8cdacb2ad8 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.844767 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00eea5-9b85-4893-ac31-1fc8439224e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.845735 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00eea5-9b85-4893-ac31-1fc8439224e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.846157 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00eea5-9b85-4893-ac31-1fc8439224e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.846598 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00eea5-9b85-4893-ac31-1fc8439224e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.847660 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00eea5-9b85-4893-ac31-1fc8439224e6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:51.848156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00eea5-9b85-4893-ac31-1fc8439224e6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.850222 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00eea5-9b85-4893-ac31-1fc8439224e6 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.876845 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 353/699] 10.222.0.96 () {56 vars in 1170 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:51.882674 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8d982-43a3-4b75-8db8-c37af17b8f47 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.898119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8d982-43a3-4b75-8db8-c37af17b8f47 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.907375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed582ad-d49c-4079-a138-936d21f9a7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.908391 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed582ad-d49c-4079-a138-936d21f9a7cb admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.908824 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed582ad-d49c-4079-a138-936d21f9a7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.909258 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed582ad-d49c-4079-a138-936d21f9a7cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.925550 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed582ad-d49c-4079-a138-936d21f9a7cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.927615 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed582ad-d49c-4079-a138-936d21f9a7cb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:51.951697 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-5ed582ad-d49c-4079-a138-936d21f9a7cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:51.953197 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 347/700] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:51.959513 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00eea5-9b85-4893-ac31-1fc8439224e6 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:51.974329 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00eea5-9b85-4893-ac31-1fc8439224e6 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:51.982507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beab5cc-5c79-467b-8963-c11ab34a08c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:51.983401 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beab5cc-5c79-467b-8963-c11ab34a08c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:51.983875 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beab5cc-5c79-467b-8963-c11ab34a08c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:51.984301 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beab5cc-5c79-467b-8963-c11ab34a08c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:51.985199 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beab5cc-5c79-467b-8963-c11ab34a08c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:51.985643 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beab5cc-5c79-467b-8963-c11ab34a08c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:51.987378 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beab5cc-5c79-467b-8963-c11ab34a08c8 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:52.008450 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 354/701] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:52.015200 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed582ad-d49c-4079-a138-936d21f9a7cb admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:52.030535 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed582ad-d49c-4079-a138-936d21f9a7cb admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:52.038789 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab7534-2d51-4844-9fc2-aede8e759282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:52.040659 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab7534-2d51-4844-9fc2-aede8e759282 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:52.041104 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab7534-2d51-4844-9fc2-aede8e759282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:52.041542 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab7534-2d51-4844-9fc2-aede8e759282 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:52.054174 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab7534-2d51-4844-9fc2-aede8e759282 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:52.056747 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab7534-2d51-4844-9fc2-aede8e759282 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:52.076589 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-1fab7534-2d51-4844-9fc2-aede8e759282 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:52.078114 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 348/702] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:52.084565 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beab5cc-5c79-467b-8963-c11ab34a08c8 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:52.098133 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beab5cc-5c79-467b-8963-c11ab34a08c8 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:52.104944 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c274e-25e8-45ad-b19b-fd832d14e869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:52.105832 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c274e-25e8-45ad-b19b-fd832d14e869 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:52.106256 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c274e-25e8-45ad-b19b-fd832d14e869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:52.106711 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c274e-25e8-45ad-b19b-fd832d14e869 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:52.107635 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c274e-25e8-45ad-b19b-fd832d14e869 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:52.108084 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c274e-25e8-45ad-b19b-fd832d14e869 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:52.110095 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c274e-25e8-45ad-b19b-fd832d14e869 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:52.124979 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 355/703] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:52.131342 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab7534-2d51-4844-9fc2-aede8e759282 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:52.142476 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab7534-2d51-4844-9fc2-aede8e759282 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:52.147365 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffb464-3366-4185-ba12-fe5f9c9f11ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:52.149285 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffb464-3366-4185-ba12-fe5f9c9f11ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:52.149741 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffb464-3366-4185-ba12-fe5f9c9f11ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:52.150171 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffb464-3366-4185-ba12-fe5f9c9f11ea admin admin] PATH_INFO: `/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/591d508a3867412fac76d00134e58864/roles/4d7fce301eec49a7a54390167747fe24` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:52.167250 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ffb464-3366-4185-ba12-fe5f9c9f11ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=356ecb479ba24136a7c38cb5a58a0a18, user_id=591d508a3867412fac76d00134e58864, role_id=4d7fce301eec49a7a54390167747fe24)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:52.170134 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ffb464-3366-4185-ba12-fe5f9c9f11ea admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:52.193398 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 349/704] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:44:52 2022] PUT /identity/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/591d508a3867412fac76d00134e58864/roles/4d7fce301eec49a7a54390167747fe24 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:44:52.790207 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da0d2d-65ae-4646-8966-c7841ff898b8 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:52.790726 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da0d2d-65ae-4646-8966-c7841ff898b8 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:52.790826 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da0d2d-65ae-4646-8966-c7841ff898b8 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:52.792914 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 356/705] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:52.801218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45966725-cc6c-47d2-bef5-318bcca38ffa None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:52.801695 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45966725-cc6c-47d2-bef5-318bcca38ffa None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:52.801695 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45966725-cc6c-47d2-bef5-318bcca38ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:52.833225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-45966725-cc6c-47d2-bef5-318bcca38ffa None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:52.834437 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-45966725-cc6c-47d2-bef5-318bcca38ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:52.928716 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 350/706] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:52 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:52.953319 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da0d2d-65ae-4646-8966-c7841ff898b8 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:52.973366 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da0d2d-65ae-4646-8966-c7841ff898b8 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:52.981891 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8faf83-8a71-4774-8ead-c710bddb803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:52.982754 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8faf83-8a71-4774-8ead-c710bddb803e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:52.983030 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8faf83-8a71-4774-8ead-c710bddb803e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:52.983295 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8faf83-8a71-4774-8ead-c710bddb803e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:53.003851 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8faf83-8a71-4774-8ead-c710bddb803e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:53.011267 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-0b8faf83-8a71-4774-8ead-c710bddb803e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:44:53.012865 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 357/707] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:53.019406 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45966725-cc6c-47d2-bef5-318bcca38ffa None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:53.034300 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45966725-cc6c-47d2-bef5-318bcca38ffa None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:53.051203 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbea09b-1180-4e52-b37f-df7fe6ecb355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:53.051947 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbea09b-1180-4e52-b37f-df7fe6ecb355 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:53.052184 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbea09b-1180-4e52-b37f-df7fe6ecb355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:53.052444 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbea09b-1180-4e52-b37f-df7fe6ecb355 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:53.053227 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbea09b-1180-4e52-b37f-df7fe6ecb355 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:53.053533 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbea09b-1180-4e52-b37f-df7fe6ecb355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:53.055598 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbea09b-1180-4e52-b37f-df7fe6ecb355 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:53.075469 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 351/708] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:53.081805 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8faf83-8a71-4774-8ead-c710bddb803e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:53.095761 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8faf83-8a71-4774-8ead-c710bddb803e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:53.105268 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321efe55-b8e6-4b2c-9e03-e9cf50ffb7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:53.106329 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321efe55-b8e6-4b2c-9e03-e9cf50ffb7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:53.106824 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321efe55-b8e6-4b2c-9e03-e9cf50ffb7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:53.107236 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321efe55-b8e6-4b2c-9e03-e9cf50ffb7e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:53.123942 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321efe55-b8e6-4b2c-9e03-e9cf50ffb7e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:53.126083 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321efe55-b8e6-4b2c-9e03-e9cf50ffb7e7 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:53.146940 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-321efe55-b8e6-4b2c-9e03-e9cf50ffb7e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:53.149348 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 358/709] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:53.156110 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbea09b-1180-4e52-b37f-df7fe6ecb355 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:53.180223 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbea09b-1180-4e52-b37f-df7fe6ecb355 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:53.191628 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99e06f-a40a-4ab5-8fb6-923d50cdf653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:53.193041 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99e06f-a40a-4ab5-8fb6-923d50cdf653 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:53.193707 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99e06f-a40a-4ab5-8fb6-923d50cdf653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:53.194360 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99e06f-a40a-4ab5-8fb6-923d50cdf653 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:53.196414 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99e06f-a40a-4ab5-8fb6-923d50cdf653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:53.197170 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99e06f-a40a-4ab5-8fb6-923d50cdf653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:53.200407 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99e06f-a40a-4ab5-8fb6-923d50cdf653 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:53.228889 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 352/710] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:53.235295 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321efe55-b8e6-4b2c-9e03-e9cf50ffb7e7 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:53.250160 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321efe55-b8e6-4b2c-9e03-e9cf50ffb7e7 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:53.258655 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e442502-415c-4c35-acfd-5fbde831a45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:53.259697 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e442502-415c-4c35-acfd-5fbde831a45b admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:53.260244 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e442502-415c-4c35-acfd-5fbde831a45b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:53.260669 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e442502-415c-4c35-acfd-5fbde831a45b admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:53.274685 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e442502-415c-4c35-acfd-5fbde831a45b admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:53.281215 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e442502-415c-4c35-acfd-5fbde831a45b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:53.296421 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-4e442502-415c-4c35-acfd-5fbde831a45b admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:44:53.303183 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 359/711] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:53.304250 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99e06f-a40a-4ab5-8fb6-923d50cdf653 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:53.327145 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99e06f-a40a-4ab5-8fb6-923d50cdf653 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:53.332024 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f2e3e-a428-465d-bed1-2b4edd770ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:53.332835 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f2e3e-a428-465d-bed1-2b4edd770ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:53.333233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f2e3e-a428-465d-bed1-2b4edd770ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:53.333618 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f2e3e-a428-465d-bed1-2b4edd770ff2 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:53.334569 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f2e3e-a428-465d-bed1-2b4edd770ff2 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:53.334990 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f2e3e-a428-465d-bed1-2b4edd770ff2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:53.337529 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f2e3e-a428-465d-bed1-2b4edd770ff2 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:53.375261 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 353/712] 10.222.0.96 () {56 vars in 1156 bytes} [Fri Jan 28 01:44:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:53.381879 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e442502-415c-4c35-acfd-5fbde831a45b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:53.397833 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e442502-415c-4c35-acfd-5fbde831a45b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:53.408871 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d07fd9-12c9-41c4-98b9-f1655071f369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:53.409848 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d07fd9-12c9-41c4-98b9-f1655071f369 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:53.410294 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d07fd9-12c9-41c4-98b9-f1655071f369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:53.410703 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d07fd9-12c9-41c4-98b9-f1655071f369 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:53.433809 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d07fd9-12c9-41c4-98b9-f1655071f369 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:53.435902 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d07fd9-12c9-41c4-98b9-f1655071f369 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:53.456226 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-24d07fd9-12c9-41c4-98b9-f1655071f369 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:53.458077 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 360/713] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:53.464606 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f2e3e-a428-465d-bed1-2b4edd770ff2 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:53.482420 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f2e3e-a428-465d-bed1-2b4edd770ff2 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:53.494026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04b361-6252-4f8d-87fb-a86668d91998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:53.494866 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04b361-6252-4f8d-87fb-a86668d91998 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:53.495254 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04b361-6252-4f8d-87fb-a86668d91998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:53.495634 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04b361-6252-4f8d-87fb-a86668d91998 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:53.496474 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04b361-6252-4f8d-87fb-a86668d91998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:53.496946 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04b361-6252-4f8d-87fb-a86668d91998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:53.498739 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04b361-6252-4f8d-87fb-a86668d91998 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:53.522371 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 354/714] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:53.535080 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d07fd9-12c9-41c4-98b9-f1655071f369 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:53.561570 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d07fd9-12c9-41c4-98b9-f1655071f369 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:53.566921 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13db9f2-80a3-4aef-aabe-64bf3784cbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:53.567967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13db9f2-80a3-4aef-aabe-64bf3784cbce admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:53.568394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13db9f2-80a3-4aef-aabe-64bf3784cbce admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:53.568837 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13db9f2-80a3-4aef-aabe-64bf3784cbce admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:53.586507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13db9f2-80a3-4aef-aabe-64bf3784cbce admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:53.588499 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13db9f2-80a3-4aef-aabe-64bf3784cbce admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:53.603880 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-d13db9f2-80a3-4aef-aabe-64bf3784cbce admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:53.605523 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 361/715] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:53.611740 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04b361-6252-4f8d-87fb-a86668d91998 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:53.631618 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04b361-6252-4f8d-87fb-a86668d91998 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:53.646273 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40177312-7a72-4822-8030-bfcc5ec3decb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:53.646956 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40177312-7a72-4822-8030-bfcc5ec3decb admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:53.647235 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40177312-7a72-4822-8030-bfcc5ec3decb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:53.647506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40177312-7a72-4822-8030-bfcc5ec3decb admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:53.648994 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40177312-7a72-4822-8030-bfcc5ec3decb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:53.649380 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40177312-7a72-4822-8030-bfcc5ec3decb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:53.651608 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40177312-7a72-4822-8030-bfcc5ec3decb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:53.670704 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 355/716] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:53.677203 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13db9f2-80a3-4aef-aabe-64bf3784cbce admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:53.687745 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13db9f2-80a3-4aef-aabe-64bf3784cbce admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:53.699436 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c933a31-e975-4b34-bdaf-976b660d0d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:53.700592 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c933a31-e975-4b34-bdaf-976b660d0d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:53.701053 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c933a31-e975-4b34-bdaf-976b660d0d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:53.701436 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c933a31-e975-4b34-bdaf-976b660d0d47 admin admin] PATH_INFO: `/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/83a2c3b2815f46b0ac27944f004c4821/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:53.706242 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c933a31-e975-4b34-bdaf-976b660d0d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356ecb479ba24136a7c38cb5a58a0a18, user_id=83a2c3b2815f46b0ac27944f004c4821, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:53.709228 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c933a31-e975-4b34-bdaf-976b660d0d47 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:53.737816 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 362/717] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:44:53 2022] PUT /identity/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/83a2c3b2815f46b0ac27944f004c4821/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:44:54.180699 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dad1bd-ba01-4b3a-b88b-e9e9e2338230 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:54.181249 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dad1bd-ba01-4b3a-b88b-e9e9e2338230 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:54.181249 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dad1bd-ba01-4b3a-b88b-e9e9e2338230 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:54.183098 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 356/718] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:54.197243 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e58ff-f459-474a-86a1-f3af9a8d92c5 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:54.197780 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e58ff-f459-474a-86a1-f3af9a8d92c5 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:54.197780 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e58ff-f459-474a-86a1-f3af9a8d92c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:54.221825 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-456e58ff-f459-474a-86a1-f3af9a8d92c5 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:54.223052 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-456e58ff-f459-474a-86a1-f3af9a8d92c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:54.298457 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 363/719] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:54 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:54.351508 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dad1bd-ba01-4b3a-b88b-e9e9e2338230 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:54.371249 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dad1bd-ba01-4b3a-b88b-e9e9e2338230 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:54.378404 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cba3bd-7a41-46d9-a3a3-621925a31e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:54.379222 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cba3bd-7a41-46d9-a3a3-621925a31e04 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:54.379504 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cba3bd-7a41-46d9-a3a3-621925a31e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:54.379777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cba3bd-7a41-46d9-a3a3-621925a31e04 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:54.380433 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cba3bd-7a41-46d9-a3a3-621925a31e04 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:54.382059 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cba3bd-7a41-46d9-a3a3-621925a31e04 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:54.399993 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-f2cba3bd-7a41-46d9-a3a3-621925a31e04 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 28 01:44:54.401287 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 357/720] 10.222.0.96 () {56 vars in 1150 bytes} [Fri Jan 28 01:44:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:54.408377 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e58ff-f459-474a-86a1-f3af9a8d92c5 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:54.422199 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e58ff-f459-474a-86a1-f3af9a8d92c5 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:54.429326 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b450fe-be5b-4aef-bea3-233dd9552ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:54.430578 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b450fe-be5b-4aef-bea3-233dd9552ddf admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:54.430913 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b450fe-be5b-4aef-bea3-233dd9552ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:54.431130 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b450fe-be5b-4aef-bea3-233dd9552ddf admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:54.431860 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b450fe-be5b-4aef-bea3-233dd9552ddf admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:54.432168 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b450fe-be5b-4aef-bea3-233dd9552ddf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:54.433852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b450fe-be5b-4aef-bea3-233dd9552ddf admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:54.445420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 364/721] 10.222.0.96 () {56 vars in 1145 bytes} [Fri Jan 28 01:44:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:54.451445 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cba3bd-7a41-46d9-a3a3-621925a31e04 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:54.466150 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cba3bd-7a41-46d9-a3a3-621925a31e04 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:54.477741 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54932835-7646-4d1d-9e63-36bd18d58c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:54.478421 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932835-7646-4d1d-9e63-36bd18d58c97 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:54.478779 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932835-7646-4d1d-9e63-36bd18d58c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:54.479057 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932835-7646-4d1d-9e63-36bd18d58c97 admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:54.479778 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54932835-7646-4d1d-9e63-36bd18d58c97 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:54.480104 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54932835-7646-4d1d-9e63-36bd18d58c97 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:54.481730 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54932835-7646-4d1d-9e63-36bd18d58c97 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:54.493752 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 358/722] 10.222.0.96 () {56 vars in 1145 bytes} [Fri Jan 28 01:44:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:54.500020 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b450fe-be5b-4aef-bea3-233dd9552ddf admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:54.514761 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b450fe-be5b-4aef-bea3-233dd9552ddf admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:54.515588 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cacc5-501e-4ddd-af01-fff4c2132789 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:54.515887 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cacc5-501e-4ddd-af01-fff4c2132789 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:54.516169 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cacc5-501e-4ddd-af01-fff4c2132789 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:54.518241 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 359/723] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:54.525456 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202ada6-f712-4ea0-9426-07d3fd5d9397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:54.526122 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202ada6-f712-4ea0-9426-07d3fd5d9397 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:54.526328 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f4fe1-f8d8-407a-be8f-e7075edc312b None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:54.526438 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202ada6-f712-4ea0-9426-07d3fd5d9397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:54.526665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202ada6-f712-4ea0-9426-07d3fd5d9397 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:54.526939 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f4fe1-f8d8-407a-be8f-e7075edc312b None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:54.527587 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f4fe1-f8d8-407a-be8f-e7075edc312b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:54.527702 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202ada6-f712-4ea0-9426-07d3fd5d9397 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:54.528673 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-e202ada6-f712-4ea0-9426-07d3fd5d9397 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:54.528673 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:44:54.528673 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:44:54.529592 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202ada6-f712-4ea0-9426-07d3fd5d9397 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:54.557243 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-e02f4fe1-f8d8-407a-be8f-e7075edc312b None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:54.558544 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-e02f4fe1-f8d8-407a-be8f-e7075edc312b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:54.567295 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 365/724] 10.222.0.96 () {60 vars in 1165 bytes} [Fri Jan 28 01:44:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:44:54.585858 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 360/725] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:54 2022] POST /identity/v3/auth/tokens => generated 1456 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:54.611010 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202ada6-f712-4ea0-9426-07d3fd5d9397 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:54.624083 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202ada6-f712-4ea0-9426-07d3fd5d9397 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:54.630658 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef4788-29b0-4f16-b0a0-190aa1d4eaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:54.631698 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef4788-29b0-4f16-b0a0-190aa1d4eaf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:54.632100 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef4788-29b0-4f16-b0a0-190aa1d4eaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:54.632516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef4788-29b0-4f16-b0a0-190aa1d4eaf5 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:54.634130 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef4788-29b0-4f16-b0a0-190aa1d4eaf5 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:54.636009 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef4788-29b0-4f16-b0a0-190aa1d4eaf5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:54.652419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-f3ef4788-29b0-4f16-b0a0-190aa1d4eaf5 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 28 01:44:54.653853 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 366/726] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:54 2022] GET /identity/v3/services/network => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:54.661736 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f4fe1-f8d8-407a-be8f-e7075edc312b None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:54.678407 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f4fe1-f8d8-407a-be8f-e7075edc312b None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:54.688073 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9755bf-5b6a-4cf8-a8af-94b8ed19bb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:54.688783 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9755bf-5b6a-4cf8-a8af-94b8ed19bb05 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:54.689200 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9755bf-5b6a-4cf8-a8af-94b8ed19bb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:54.689549 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9755bf-5b6a-4cf8-a8af-94b8ed19bb05 admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:54.690358 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9755bf-5b6a-4cf8-a8af-94b8ed19bb05 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:54.690744 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9755bf-5b6a-4cf8-a8af-94b8ed19bb05 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:54.692484 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9755bf-5b6a-4cf8-a8af-94b8ed19bb05 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:54.701581 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 361/727] 10.222.0.96 () {56 vars in 1133 bytes} [Fri Jan 28 01:44:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:54.708086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef4788-29b0-4f16-b0a0-190aa1d4eaf5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:54.720270 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef4788-29b0-4f16-b0a0-190aa1d4eaf5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:54.729628 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ca513-232b-4b28-9395-7bb954f2b3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:54.730479 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ca513-232b-4b28-9395-7bb954f2b3de admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:54.730835 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ca513-232b-4b28-9395-7bb954f2b3de admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:54.731182 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ca513-232b-4b28-9395-7bb954f2b3de admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:54.732012 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ca513-232b-4b28-9395-7bb954f2b3de admin admin] RBAC: Adding query filter params (type=network) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:54.732395 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ca513-232b-4b28-9395-7bb954f2b3de admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:54.734272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ca513-232b-4b28-9395-7bb954f2b3de admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:54.740648 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 367/728] 10.222.0.96 () {56 vars in 1133 bytes} [Fri Jan 28 01:44:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:54.747966 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9755bf-5b6a-4cf8-a8af-94b8ed19bb05 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:54.759736 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9755bf-5b6a-4cf8-a8af-94b8ed19bb05 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:54.773718 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fea572-f88e-48c5-a8ae-a39cfae126e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:54.774694 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fea572-f88e-48c5-a8ae-a39cfae126e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:54.775127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fea572-f88e-48c5-a8ae-a39cfae126e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:54.775555 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fea572-f88e-48c5-a8ae-a39cfae126e6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:54.776483 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fea572-f88e-48c5-a8ae-a39cfae126e6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:54.777991 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING py.warnings [None req-35fea572-f88e-48c5-a8ae-a39cfae126e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:54.777991 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: warnings.warn(msg) Jan 28 01:44:54.777991 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: Jan 28 01:44:54.779209 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fea572-f88e-48c5-a8ae-a39cfae126e6 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:54.818428 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 362/729] 10.222.0.96 () {60 vars in 1165 bytes} [Fri Jan 28 01:44:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:44:54.819572 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f2c84-2940-410e-9655-abce564e227b None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:54.819572 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f2c84-2940-410e-9655-abce564e227b None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:54.819572 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f2c84-2940-410e-9655-abce564e227b None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:54.822620 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 368/730] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:44:54.830429 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfe635-8d1e-4554-9858-9b31d3c62a6d None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:54.830733 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfe635-8d1e-4554-9858-9b31d3c62a6d None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:54.830992 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfe635-8d1e-4554-9858-9b31d3c62a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:54.856259 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-f5bfe635-8d1e-4554-9858-9b31d3c62a6d None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:54.857994 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-f5bfe635-8d1e-4554-9858-9b31d3c62a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:54.877544 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 363/731] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:54 2022] POST /identity/v3/auth/tokens => generated 1605 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:54.905756 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f2c84-2940-410e-9655-abce564e227b None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:54.922117 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f2c84-2940-410e-9655-abce564e227b None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:54.927204 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2365ff-1e40-48c7-a89e-d2d9543a6f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:54.928079 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2365ff-1e40-48c7-a89e-d2d9543a6f84 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:54.928363 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2365ff-1e40-48c7-a89e-d2d9543a6f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:54.928741 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2365ff-1e40-48c7-a89e-d2d9543a6f84 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:54.941759 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2365ff-1e40-48c7-a89e-d2d9543a6f84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:54.949257 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-2d2365ff-1e40-48c7-a89e-d2d9543a6f84 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:44:54.950721 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 369/732] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:44:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:54.957288 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfe635-8d1e-4554-9858-9b31d3c62a6d None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:54.967976 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfe635-8d1e-4554-9858-9b31d3c62a6d None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:54.973027 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19d4d8-fce3-469d-829a-4f42b41a8c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:54.973728 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19d4d8-fce3-469d-829a-4f42b41a8c8b admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:54.974011 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19d4d8-fce3-469d-829a-4f42b41a8c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:54.974290 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19d4d8-fce3-469d-829a-4f42b41a8c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:54.975076 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19d4d8-fce3-469d-829a-4f42b41a8c8b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:54.975383 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19d4d8-fce3-469d-829a-4f42b41a8c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:54.977770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19d4d8-fce3-469d-829a-4f42b41a8c8b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:54.984777 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032613e-5929-4a18-a2a1-5905ac230e07 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:54.984777 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032613e-5929-4a18-a2a1-5905ac230e07 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:54.985585 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032613e-5929-4a18-a2a1-5905ac230e07 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:54.987425 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 370/733] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:44:55.000780 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed57658-57e4-4fce-ab57-cd62be7b2c54 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:55.000780 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed57658-57e4-4fce-ab57-cd62be7b2c54 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:55.000780 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed57658-57e4-4fce-ab57-cd62be7b2c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:55.001545 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 364/734] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:44:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:55.004203 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19d4d8-fce3-469d-829a-4f42b41a8c8b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:55.017156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19d4d8-fce3-469d-829a-4f42b41a8c8b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:55.022476 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-7ed57658-57e4-4fce-ab57-cd62be7b2c54 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:55.024853 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-7ed57658-57e4-4fce-ab57-cd62be7b2c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:55.026397 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15098aaa-4bde-413b-8a1f-73c18ae9a232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:55.027419 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15098aaa-4bde-413b-8a1f-73c18ae9a232 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:55.027695 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15098aaa-4bde-413b-8a1f-73c18ae9a232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:55.027964 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15098aaa-4bde-413b-8a1f-73c18ae9a232 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:55.035710 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 371/735] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:54 2022] POST /identity/v3/auth/tokens => generated 1605 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:55.051046 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15098aaa-4bde-413b-8a1f-73c18ae9a232 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:55.052948 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15098aaa-4bde-413b-8a1f-73c18ae9a232 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:55.065609 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed57658-57e4-4fce-ab57-cd62be7b2c54 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:55.071050 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-15098aaa-4bde-413b-8a1f-73c18ae9a232 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:55.072433 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 365/736] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:44:55.076301 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed57658-57e4-4fce-ab57-cd62be7b2c54 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:55.078555 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15098aaa-4bde-413b-8a1f-73c18ae9a232 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:55.082002 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad3365-21ae-4dc5-9d44-d5b816443793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:55.083107 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad3365-21ae-4dc5-9d44-d5b816443793 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:55.083819 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad3365-21ae-4dc5-9d44-d5b816443793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:55.084422 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad3365-21ae-4dc5-9d44-d5b816443793 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:55.085349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad3365-21ae-4dc5-9d44-d5b816443793 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:55.088634 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad3365-21ae-4dc5-9d44-d5b816443793 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:55.090073 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15098aaa-4bde-413b-8a1f-73c18ae9a232 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:55.095620 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dec3aa-8199-46fd-82e3-0c23f8cf4475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:55.096357 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dec3aa-8199-46fd-82e3-0c23f8cf4475 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:55.096712 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dec3aa-8199-46fd-82e3-0c23f8cf4475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:55.097151 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dec3aa-8199-46fd-82e3-0c23f8cf4475 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:55.097943 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dec3aa-8199-46fd-82e3-0c23f8cf4475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:55.098355 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dec3aa-8199-46fd-82e3-0c23f8cf4475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:55.099998 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dec3aa-8199-46fd-82e3-0c23f8cf4475 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:55.104135 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-c5ad3365-21ae-4dc5-9d44-d5b816443793 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 28 01:44:55.106818 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 372/737] 10.222.0.96 () {56 vars in 1153 bytes} [Fri Jan 28 01:44:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:55.116157 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad3365-21ae-4dc5-9d44-d5b816443793 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:55.119042 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 366/738] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:44:55.128841 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dec3aa-8199-46fd-82e3-0c23f8cf4475 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:55.131086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad3365-21ae-4dc5-9d44-d5b816443793 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:55.139066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dec3aa-8199-46fd-82e3-0c23f8cf4475 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:55.140882 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f870e8-d292-4114-99ca-f49f01916fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:55.141547 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f870e8-d292-4114-99ca-f49f01916fbc admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:55.141823 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f870e8-d292-4114-99ca-f49f01916fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:55.142091 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f870e8-d292-4114-99ca-f49f01916fbc admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:55.142784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f870e8-d292-4114-99ca-f49f01916fbc admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:55.143089 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f870e8-d292-4114-99ca-f49f01916fbc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:55.144664 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f870e8-d292-4114-99ca-f49f01916fbc admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:55.153311 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 373/739] 10.222.0.96 () {56 vars in 1147 bytes} [Fri Jan 28 01:44:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:55.154575 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84706e31-f725-4957-9db2-afdbf6914ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:55.155681 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84706e31-f725-4957-9db2-afdbf6914ebb admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:55.156219 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84706e31-f725-4957-9db2-afdbf6914ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:55.156726 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84706e31-f725-4957-9db2-afdbf6914ebb admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:55.159301 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f870e8-d292-4114-99ca-f49f01916fbc admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:55.167919 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84706e31-f725-4957-9db2-afdbf6914ebb admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:55.169748 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f870e8-d292-4114-99ca-f49f01916fbc admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:55.170827 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84706e31-f725-4957-9db2-afdbf6914ebb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:55.174415 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8d554-4574-4c7e-b561-99889da09f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:55.175065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8d554-4574-4c7e-b561-99889da09f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:55.175340 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8d554-4574-4c7e-b561-99889da09f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:55.175605 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8d554-4574-4c7e-b561-99889da09f22 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:55.176297 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8d554-4574-4c7e-b561-99889da09f22 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:55.176596 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8d554-4574-4c7e-b561-99889da09f22 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:55.178202 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8d554-4574-4c7e-b561-99889da09f22 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:55.187447 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 374/740] 10.222.0.96 () {56 vars in 1147 bytes} [Fri Jan 28 01:44:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:55.191535 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-84706e31-f725-4957-9db2-afdbf6914ebb admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:44:55.193192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 367/741] 10.222.0.96 () {56 vars in 1138 bytes} [Fri Jan 28 01:44:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:55.200296 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8d554-4574-4c7e-b561-99889da09f22 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:55.215251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8d554-4574-4c7e-b561-99889da09f22 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:55.220351 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932d660-4e16-4c41-a2e4-8846d3f2f6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:55.221337 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932d660-4e16-4c41-a2e4-8846d3f2f6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:55.221764 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932d660-4e16-4c41-a2e4-8846d3f2f6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:55.222207 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932d660-4e16-4c41-a2e4-8846d3f2f6b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:55.223216 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932d660-4e16-4c41-a2e4-8846d3f2f6b8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:55.223671 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932d660-4e16-4c41-a2e4-8846d3f2f6b8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:55.225751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932d660-4e16-4c41-a2e4-8846d3f2f6b8 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:55.251939 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 375/742] 10.222.0.96 () {56 vars in 1170 bytes} [Fri Jan 28 01:44:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:55.253639 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84706e31-f725-4957-9db2-afdbf6914ebb admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:55.264259 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84706e31-f725-4957-9db2-afdbf6914ebb admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:55.269272 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62074230-93c1-4345-8632-9ffc908a53d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:55.270150 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62074230-93c1-4345-8632-9ffc908a53d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:55.270577 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62074230-93c1-4345-8632-9ffc908a53d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:55.270989 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62074230-93c1-4345-8632-9ffc908a53d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:55.282020 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62074230-93c1-4345-8632-9ffc908a53d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:55.284094 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62074230-93c1-4345-8632-9ffc908a53d7 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:55.301049 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 368/743] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:55 2022] GET /identity/v3/auth/tokens => generated 1605 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:55.302705 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932d660-4e16-4c41-a2e4-8846d3f2f6b8 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:55.316528 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932d660-4e16-4c41-a2e4-8846d3f2f6b8 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:55.326541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb9ca8-d331-48c0-8b16-b0b523421fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:55.327803 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb9ca8-d331-48c0-8b16-b0b523421fce admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:55.328352 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb9ca8-d331-48c0-8b16-b0b523421fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:55.328870 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb9ca8-d331-48c0-8b16-b0b523421fce admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:55.345057 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb9ca8-d331-48c0-8b16-b0b523421fce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:55.346948 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb9ca8-d331-48c0-8b16-b0b523421fce admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:55.367755 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-8afb9ca8-d331-48c0-8b16-b0b523421fce admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:55.369335 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 376/744] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:55.375685 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62074230-93c1-4345-8632-9ffc908a53d7 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:55.385903 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62074230-93c1-4345-8632-9ffc908a53d7 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:55.390746 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdc780-1f17-451c-9590-2c0cee4f86da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:55.391403 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdc780-1f17-451c-9590-2c0cee4f86da admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:55.391687 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdc780-1f17-451c-9590-2c0cee4f86da admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:55.391960 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdc780-1f17-451c-9590-2c0cee4f86da admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:55.392684 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdc780-1f17-451c-9590-2c0cee4f86da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:55.393025 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdc780-1f17-451c-9590-2c0cee4f86da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:55.394609 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdc780-1f17-451c-9590-2c0cee4f86da admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:55.407855 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 369/745] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:55.414551 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb9ca8-d331-48c0-8b16-b0b523421fce admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:55.424706 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb9ca8-d331-48c0-8b16-b0b523421fce admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:55.430454 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f2225-f049-4b86-b962-e0733112484c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:55.431598 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f2225-f049-4b86-b962-e0733112484c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:55.432088 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f2225-f049-4b86-b962-e0733112484c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:55.432565 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f2225-f049-4b86-b962-e0733112484c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:55.440367 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f2225-f049-4b86-b962-e0733112484c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:55.442680 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f2225-f049-4b86-b962-e0733112484c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:55.456755 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-fe9f2225-f049-4b86-b962-e0733112484c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:55.462713 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 377/746] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:55.466580 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdc780-1f17-451c-9590-2c0cee4f86da admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:55.478396 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdc780-1f17-451c-9590-2c0cee4f86da admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:55.483460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ab212-625c-411e-a81d-4a7095d5d4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:55.484471 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ab212-625c-411e-a81d-4a7095d5d4cb admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:55.485035 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ab212-625c-411e-a81d-4a7095d5d4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:55.485526 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ab212-625c-411e-a81d-4a7095d5d4cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:55.486565 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ab212-625c-411e-a81d-4a7095d5d4cb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:55.487096 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ab212-625c-411e-a81d-4a7095d5d4cb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:55.489269 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ab212-625c-411e-a81d-4a7095d5d4cb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:55.506017 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 370/747] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:55.510119 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f2225-f049-4b86-b962-e0733112484c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:55.521141 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f2225-f049-4b86-b962-e0733112484c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:55.526732 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a245f0b-f277-4705-a53d-9eddb0df67e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:55.527924 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a245f0b-f277-4705-a53d-9eddb0df67e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:55.528460 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a245f0b-f277-4705-a53d-9eddb0df67e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:55.528956 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a245f0b-f277-4705-a53d-9eddb0df67e2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:55.530066 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a245f0b-f277-4705-a53d-9eddb0df67e2 admin admin] RBAC: Adding query filter params (role.id=4d7fce301eec49a7a54390167747fe24, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=591d508a3867412fac76d00134e58864) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:55.530588 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a245f0b-f277-4705-a53d-9eddb0df67e2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:55.532744 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a245f0b-f277-4705-a53d-9eddb0df67e2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:55.548967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 378/748] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:55 2022] GET /identity/v3/role_assignments?user.id=591d508a3867412fac76d00134e58864&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=4d7fce301eec49a7a54390167747fe24 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:56.500251 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44a75-2e1a-4944-a9e9-1028f607ae62 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:56.501070 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44a75-2e1a-4944-a9e9-1028f607ae62 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:56.501070 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44a75-2e1a-4944-a9e9-1028f607ae62 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:56.502938 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 371/749] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:56.511518 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3ae3c-4b4d-42dd-8d6a-bad004f2cad2 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:56.512021 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3ae3c-4b4d-42dd-8d6a-bad004f2cad2 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:56.512111 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3ae3c-4b4d-42dd-8d6a-bad004f2cad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:56.532646 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-c5f3ae3c-4b4d-42dd-8d6a-bad004f2cad2 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:56.533914 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c5f3ae3c-4b4d-42dd-8d6a-bad004f2cad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:56.542155 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 379/750] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:56 2022] POST /identity/v3/auth/tokens => generated 1605 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:56.567800 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd44a75-2e1a-4944-a9e9-1028f607ae62 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:56.580970 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd44a75-2e1a-4944-a9e9-1028f607ae62 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:56.585415 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d961233-c35a-4a8d-ab7b-a58ef88da96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:56.586452 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d961233-c35a-4a8d-ab7b-a58ef88da96a admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:56.586742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d961233-c35a-4a8d-ab7b-a58ef88da96a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:56.587013 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d961233-c35a-4a8d-ab7b-a58ef88da96a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:56.597640 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d961233-c35a-4a8d-ab7b-a58ef88da96a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:56.604973 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-4d961233-c35a-4a8d-ab7b-a58ef88da96a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:44:56.606463 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 372/751] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:56.613091 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3ae3c-4b4d-42dd-8d6a-bad004f2cad2 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:56.622871 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3ae3c-4b4d-42dd-8d6a-bad004f2cad2 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:56.627652 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcd774-224f-4130-8ad3-0b0092cc516c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:56.628326 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcd774-224f-4130-8ad3-0b0092cc516c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:56.628608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcd774-224f-4130-8ad3-0b0092cc516c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:56.628964 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcd774-224f-4130-8ad3-0b0092cc516c admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:56.629713 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcd774-224f-4130-8ad3-0b0092cc516c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:56.630024 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcd774-224f-4130-8ad3-0b0092cc516c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:56.631618 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcd774-224f-4130-8ad3-0b0092cc516c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:56.641799 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 380/752] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:44:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:56.648176 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d961233-c35a-4a8d-ab7b-a58ef88da96a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:56.660820 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d961233-c35a-4a8d-ab7b-a58ef88da96a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:56.665690 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eaf1dd-041a-4c9a-96ba-f51dd0d100d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:56.666556 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eaf1dd-041a-4c9a-96ba-f51dd0d100d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:56.666842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eaf1dd-041a-4c9a-96ba-f51dd0d100d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:56.667120 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eaf1dd-041a-4c9a-96ba-f51dd0d100d5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:56.681054 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eaf1dd-041a-4c9a-96ba-f51dd0d100d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:56.682923 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eaf1dd-041a-4c9a-96ba-f51dd0d100d5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:56.701661 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-31eaf1dd-041a-4c9a-96ba-f51dd0d100d5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:56.703265 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 373/753] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:56.709638 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcd774-224f-4130-8ad3-0b0092cc516c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:56.720149 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcd774-224f-4130-8ad3-0b0092cc516c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:56.724946 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a843deb-3474-4632-9938-3d0a8aad78cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:56.725650 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a843deb-3474-4632-9938-3d0a8aad78cb admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:56.725934 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a843deb-3474-4632-9938-3d0a8aad78cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:56.726212 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a843deb-3474-4632-9938-3d0a8aad78cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:56.727513 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a843deb-3474-4632-9938-3d0a8aad78cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:56.727825 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a843deb-3474-4632-9938-3d0a8aad78cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:56.729499 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a843deb-3474-4632-9938-3d0a8aad78cb admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:56.742688 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 381/754] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:56.748999 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eaf1dd-041a-4c9a-96ba-f51dd0d100d5 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:56.759459 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eaf1dd-041a-4c9a-96ba-f51dd0d100d5 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:56.764029 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7b260-1540-4d8d-b894-b86636f6b5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:56.764906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7b260-1540-4d8d-b894-b86636f6b5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:56.765192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7b260-1540-4d8d-b894-b86636f6b5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:56.765521 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7b260-1540-4d8d-b894-b86636f6b5e0 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:56.774195 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7b260-1540-4d8d-b894-b86636f6b5e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:56.776313 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7b260-1540-4d8d-b894-b86636f6b5e0 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:56.790829 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-55c7b260-1540-4d8d-b894-b86636f6b5e0 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:44:56.792301 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 374/755] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:44:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:56.798615 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a843deb-3474-4632-9938-3d0a8aad78cb admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:56.809338 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a843deb-3474-4632-9938-3d0a8aad78cb admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:56.814076 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aceea-f254-4df2-a033-52432e78424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:56.814802 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aceea-f254-4df2-a033-52432e78424c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:56.815131 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aceea-f254-4df2-a033-52432e78424c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:56.815410 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aceea-f254-4df2-a033-52432e78424c admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:56.816244 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1aceea-f254-4df2-a033-52432e78424c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:56.816550 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1aceea-f254-4df2-a033-52432e78424c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:56.818461 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1aceea-f254-4df2-a033-52432e78424c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:56.839166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 382/756] 10.222.0.96 () {56 vars in 1156 bytes} [Fri Jan 28 01:44:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:56.845383 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7b260-1540-4d8d-b894-b86636f6b5e0 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:56.856394 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7b260-1540-4d8d-b894-b86636f6b5e0 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:56.861245 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71f529-56a5-460a-ade6-9d8418b99314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:56.861898 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71f529-56a5-460a-ade6-9d8418b99314 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:56.862177 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71f529-56a5-460a-ade6-9d8418b99314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:56.862505 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71f529-56a5-460a-ade6-9d8418b99314 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:56.872162 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71f529-56a5-460a-ade6-9d8418b99314 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:56.873960 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71f529-56a5-460a-ade6-9d8418b99314 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:56.883932 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 375/757] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:56 2022] GET /identity/v3/auth/tokens => generated 1605 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:56.890310 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aceea-f254-4df2-a033-52432e78424c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:56.902404 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aceea-f254-4df2-a033-52432e78424c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:56.907307 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20027ca4-3463-4009-aca5-635fbb8eece3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:56.908365 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20027ca4-3463-4009-aca5-635fbb8eece3 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:56.908861 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20027ca4-3463-4009-aca5-635fbb8eece3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:56.909317 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20027ca4-3463-4009-aca5-635fbb8eece3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:56.920970 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20027ca4-3463-4009-aca5-635fbb8eece3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:56.923294 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20027ca4-3463-4009-aca5-635fbb8eece3 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:56.941236 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-20027ca4-3463-4009-aca5-635fbb8eece3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:56.943012 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 383/758] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:56.950108 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71f529-56a5-460a-ade6-9d8418b99314 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:56.959615 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71f529-56a5-460a-ade6-9d8418b99314 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:56.965152 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97528337-d989-44dd-a50f-08fe28c83c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:56.966053 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97528337-d989-44dd-a50f-08fe28c83c48 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:56.966534 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97528337-d989-44dd-a50f-08fe28c83c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:56.966986 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97528337-d989-44dd-a50f-08fe28c83c48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:56.967901 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97528337-d989-44dd-a50f-08fe28c83c48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:56.968407 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97528337-d989-44dd-a50f-08fe28c83c48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:56.970275 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97528337-d989-44dd-a50f-08fe28c83c48 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:56.983745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 376/759] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:56.990271 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20027ca4-3463-4009-aca5-635fbb8eece3 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:57.001151 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20027ca4-3463-4009-aca5-635fbb8eece3 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:57.006163 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8792fa-e246-4871-b6c0-c8921f450d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:57.007182 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8792fa-e246-4871-b6c0-c8921f450d69 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:57.008318 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8792fa-e246-4871-b6c0-c8921f450d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:57.008957 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8792fa-e246-4871-b6c0-c8921f450d69 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:57.018344 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8792fa-e246-4871-b6c0-c8921f450d69 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:57.020615 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8792fa-e246-4871-b6c0-c8921f450d69 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:57.041134 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-af8792fa-e246-4871-b6c0-c8921f450d69 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:57.042998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 384/760] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:57.049648 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97528337-d989-44dd-a50f-08fe28c83c48 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:57.060745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97528337-d989-44dd-a50f-08fe28c83c48 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:57.065794 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bf7c6-f430-480a-b7d7-c5b5199206c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:57.066746 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bf7c6-f430-480a-b7d7-c5b5199206c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:57.067200 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bf7c6-f430-480a-b7d7-c5b5199206c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:57.067659 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bf7c6-f430-480a-b7d7-c5b5199206c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:57.068645 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bf7c6-f430-480a-b7d7-c5b5199206c4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:57.069194 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bf7c6-f430-480a-b7d7-c5b5199206c4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:57.071903 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bf7c6-f430-480a-b7d7-c5b5199206c4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:57.089128 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 377/761] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:57.092135 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8792fa-e246-4871-b6c0-c8921f450d69 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:57.102959 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8792fa-e246-4871-b6c0-c8921f450d69 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:57.107721 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6167f3-1e82-4d67-9328-b5666af36064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:57.108576 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6167f3-1e82-4d67-9328-b5666af36064 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:57.109094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6167f3-1e82-4d67-9328-b5666af36064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:57.109533 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6167f3-1e82-4d67-9328-b5666af36064 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:57.110605 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6167f3-1e82-4d67-9328-b5666af36064 admin admin] RBAC: Adding query filter params (role.id=253c0a1dc8d6421298a7987caaa55676, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=83a2c3b2815f46b0ac27944f004c4821) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:57.111082 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6167f3-1e82-4d67-9328-b5666af36064 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:57.113205 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6167f3-1e82-4d67-9328-b5666af36064 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:57.120636 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 385/762] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:57 2022] GET /identity/v3/role_assignments?user.id=83a2c3b2815f46b0ac27944f004c4821&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:57.247286 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41390db3-61e4-42cc-872f-747080e9c2a0 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:57.247890 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41390db3-61e4-42cc-872f-747080e9c2a0 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:57.248336 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41390db3-61e4-42cc-872f-747080e9c2a0 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:57.250570 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 378/763] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:57.261612 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d54f5e-69bf-48c6-a537-d9f86402a533 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:57.262256 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d54f5e-69bf-48c6-a537-d9f86402a533 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:57.262739 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d54f5e-69bf-48c6-a537-d9f86402a533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:57.282723 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-15d54f5e-69bf-48c6-a537-d9f86402a533 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:57.284244 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-15d54f5e-69bf-48c6-a537-d9f86402a533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:57.293235 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 386/764] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:57 2022] POST /identity/v3/auth/tokens => generated 1605 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:57.317732 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41390db3-61e4-42cc-872f-747080e9c2a0 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:57.331623 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41390db3-61e4-42cc-872f-747080e9c2a0 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:57.337426 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79752d72-7d21-4f08-a24a-d75a85785456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:57.338630 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79752d72-7d21-4f08-a24a-d75a85785456 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:57.339164 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79752d72-7d21-4f08-a24a-d75a85785456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:57.339668 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79752d72-7d21-4f08-a24a-d75a85785456 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:57.340588 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79752d72-7d21-4f08-a24a-d75a85785456 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:57.342418 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79752d72-7d21-4f08-a24a-d75a85785456 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:57.355160 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-79752d72-7d21-4f08-a24a-d75a85785456 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 28 01:44:57.356997 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 379/765] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:44:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:57.364195 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d54f5e-69bf-48c6-a537-d9f86402a533 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:57.373796 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d54f5e-69bf-48c6-a537-d9f86402a533 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:57.378889 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2806bb9-fc7b-4b22-9cb9-df9b88664176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:57.379917 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2806bb9-fc7b-4b22-9cb9-df9b88664176 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:57.380395 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2806bb9-fc7b-4b22-9cb9-df9b88664176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:57.380972 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2806bb9-fc7b-4b22-9cb9-df9b88664176 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:57.381935 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2806bb9-fc7b-4b22-9cb9-df9b88664176 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:57.382445 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2806bb9-fc7b-4b22-9cb9-df9b88664176 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:57.384992 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2806bb9-fc7b-4b22-9cb9-df9b88664176 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:57.390611 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 387/766] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:44:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:57.397218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79752d72-7d21-4f08-a24a-d75a85785456 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:57.408578 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79752d72-7d21-4f08-a24a-d75a85785456 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:57.413590 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08972d-2376-41ca-b448-09456f41b26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:57.414858 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08972d-2376-41ca-b448-09456f41b26e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:57.415138 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08972d-2376-41ca-b448-09456f41b26e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:57.415410 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08972d-2376-41ca-b448-09456f41b26e admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:57.416127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08972d-2376-41ca-b448-09456f41b26e admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:57.416432 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08972d-2376-41ca-b448-09456f41b26e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:57.418144 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08972d-2376-41ca-b448-09456f41b26e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:57.423842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 380/767] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:44:57 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:57.486089 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa305ff1-6044-4af5-8c00-430c2fa75568 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:57.486442 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa305ff1-6044-4af5-8c00-430c2fa75568 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:57.486639 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa305ff1-6044-4af5-8c00-430c2fa75568 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:57.488720 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 388/768] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:57.497786 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ef3b2-8b1d-4103-90ac-cd3131d330c3 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:57.498085 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ef3b2-8b1d-4103-90ac-cd3131d330c3 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:57.498358 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ef3b2-8b1d-4103-90ac-cd3131d330c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:57.517284 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-ec4ef3b2-8b1d-4103-90ac-cd3131d330c3 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:57.518509 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ec4ef3b2-8b1d-4103-90ac-cd3131d330c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:57.527393 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 381/769] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:57 2022] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:57.569914 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa305ff1-6044-4af5-8c00-430c2fa75568 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:57.583747 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa305ff1-6044-4af5-8c00-430c2fa75568 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:57.589830 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb605a-67b4-4ef0-9969-39dfe5c0632a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:57.590559 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb605a-67b4-4ef0-9969-39dfe5c0632a admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:57.590838 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb605a-67b4-4ef0-9969-39dfe5c0632a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:57.591163 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb605a-67b4-4ef0-9969-39dfe5c0632a admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:57.591896 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb605a-67b4-4ef0-9969-39dfe5c0632a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:57.593016 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-a1bb605a-67b4-4ef0-9969-39dfe5c0632a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:44:57.593016 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:44:57.593016 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:44:57.593958 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb605a-67b4-4ef0-9969-39dfe5c0632a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:57.612437 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 389/770] 10.222.0.96 () {60 vars in 1162 bytes} [Fri Jan 28 01:44:57 2022] POST /identity/v3/services => generated 269 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:44:57.915771 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607053d-6020-4755-bb97-89c46be59bf1 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:57.916109 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607053d-6020-4755-bb97-89c46be59bf1 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:57.916284 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607053d-6020-4755-bb97-89c46be59bf1 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:57.918328 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 382/771] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:57.926136 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185d823-e18a-4587-9215-58ac11298f22 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:57.926427 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185d823-e18a-4587-9215-58ac11298f22 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:57.926704 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185d823-e18a-4587-9215-58ac11298f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:57.944533 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-8185d823-e18a-4587-9215-58ac11298f22 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:57.945797 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-8185d823-e18a-4587-9215-58ac11298f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:57.963578 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 390/772] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:57 2022] POST /identity/v3/auth/tokens => generated 1715 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:57.989080 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607053d-6020-4755-bb97-89c46be59bf1 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:58.001912 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607053d-6020-4755-bb97-89c46be59bf1 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:58.006300 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d0ec7-b79e-41bf-be38-1411e65386c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:58.007146 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d0ec7-b79e-41bf-be38-1411e65386c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:58.007429 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d0ec7-b79e-41bf-be38-1411e65386c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:58.008302 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d0ec7-b79e-41bf-be38-1411e65386c2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:58.018987 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d0ec7-b79e-41bf-be38-1411e65386c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:44:58.027675 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-b78d0ec7-b79e-41bf-be38-1411e65386c2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:44:58.032903 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 383/773] 10.222.0.96 () {56 vars in 1141 bytes} [Fri Jan 28 01:44:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:58.035713 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185d823-e18a-4587-9215-58ac11298f22 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:58.045394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185d823-e18a-4587-9215-58ac11298f22 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:58.049902 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b42bb9-39ee-46c8-9d4b-456dfad1818c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:58.050553 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b42bb9-39ee-46c8-9d4b-456dfad1818c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:58.050832 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b42bb9-39ee-46c8-9d4b-456dfad1818c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:58.051118 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b42bb9-39ee-46c8-9d4b-456dfad1818c admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:58.051889 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b42bb9-39ee-46c8-9d4b-456dfad1818c admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:58.052193 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b42bb9-39ee-46c8-9d4b-456dfad1818c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:58.053854 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b42bb9-39ee-46c8-9d4b-456dfad1818c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:58.067608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 391/774] 10.222.0.96 () {56 vars in 1136 bytes} [Fri Jan 28 01:44:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:58.069045 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d0ec7-b79e-41bf-be38-1411e65386c2 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:58.079094 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d0ec7-b79e-41bf-be38-1411e65386c2 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:58.083819 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c0225-7212-4d0e-a931-6df0ec2de60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:58.084656 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c0225-7212-4d0e-a931-6df0ec2de60b admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:58.084978 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c0225-7212-4d0e-a931-6df0ec2de60b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:58.085309 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c0225-7212-4d0e-a931-6df0ec2de60b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:58.097151 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c0225-7212-4d0e-a931-6df0ec2de60b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:58.099013 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c0225-7212-4d0e-a931-6df0ec2de60b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:58.116167 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-3f2c0225-7212-4d0e-a931-6df0ec2de60b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:58.123088 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 384/775] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:58.124429 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b42bb9-39ee-46c8-9d4b-456dfad1818c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:58.135086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b42bb9-39ee-46c8-9d4b-456dfad1818c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:58.139758 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4b900-1a2f-47ce-9685-c3e64e934e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:58.140465 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4b900-1a2f-47ce-9685-c3e64e934e78 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:58.140745 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4b900-1a2f-47ce-9685-c3e64e934e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:58.141044 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4b900-1a2f-47ce-9685-c3e64e934e78 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:58.141822 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4b900-1a2f-47ce-9685-c3e64e934e78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:58.142125 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4b900-1a2f-47ce-9685-c3e64e934e78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:58.143768 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4b900-1a2f-47ce-9685-c3e64e934e78 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:58.162664 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 392/776] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:58.164082 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c0225-7212-4d0e-a931-6df0ec2de60b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:58.174403 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c0225-7212-4d0e-a931-6df0ec2de60b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:58.178989 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b1048-9771-4927-a395-4e80d48f60a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:58.179883 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b1048-9771-4927-a395-4e80d48f60a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:58.180161 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b1048-9771-4927-a395-4e80d48f60a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:58.180488 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b1048-9771-4927-a395-4e80d48f60a0 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:58.190547 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b1048-9771-4927-a395-4e80d48f60a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:58.192693 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b1048-9771-4927-a395-4e80d48f60a0 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:58.208539 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-7a1b1048-9771-4927-a395-4e80d48f60a0 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:44:58.210243 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 385/777] 10.222.0.96 () {56 vars in 1138 bytes} [Fri Jan 28 01:44:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:58.217120 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4b900-1a2f-47ce-9685-c3e64e934e78 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:58.228507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4b900-1a2f-47ce-9685-c3e64e934e78 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:58.233376 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd2e36-35dc-4ec5-8a1d-5f03a8ff06b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:58.234051 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd2e36-35dc-4ec5-8a1d-5f03a8ff06b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:58.234332 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd2e36-35dc-4ec5-8a1d-5f03a8ff06b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:58.234659 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd2e36-35dc-4ec5-8a1d-5f03a8ff06b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:58.235493 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd2e36-35dc-4ec5-8a1d-5f03a8ff06b3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:58.235852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd2e36-35dc-4ec5-8a1d-5f03a8ff06b3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:58.237792 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd2e36-35dc-4ec5-8a1d-5f03a8ff06b3 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:58.257542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 393/778] 10.222.0.96 () {56 vars in 1170 bytes} [Fri Jan 28 01:44:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:58.264010 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b1048-9771-4927-a395-4e80d48f60a0 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:58.274519 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b1048-9771-4927-a395-4e80d48f60a0 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:58.279468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d40522-ace0-4c16-a2f1-dfb0fca3ecc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:58.280172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d40522-ace0-4c16-a2f1-dfb0fca3ecc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:58.280456 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d40522-ace0-4c16-a2f1-dfb0fca3ecc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:58.280730 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d40522-ace0-4c16-a2f1-dfb0fca3ecc2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:58.290265 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d40522-ace0-4c16-a2f1-dfb0fca3ecc2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:58.292097 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d40522-ace0-4c16-a2f1-dfb0fca3ecc2 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:58.302460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 386/779] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:44:58 2022] GET /identity/v3/auth/tokens => generated 1715 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:44:58.308932 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd2e36-35dc-4ec5-8a1d-5f03a8ff06b3 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:58.320043 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd2e36-35dc-4ec5-8a1d-5f03a8ff06b3 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:58.325070 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8929a-ef1e-42a3-97b7-f3e88a364b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:58.325972 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8929a-ef1e-42a3-97b7-f3e88a364b23 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:58.326248 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8929a-ef1e-42a3-97b7-f3e88a364b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:58.326520 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8929a-ef1e-42a3-97b7-f3e88a364b23 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:58.337883 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8929a-ef1e-42a3-97b7-f3e88a364b23 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:58.339807 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8929a-ef1e-42a3-97b7-f3e88a364b23 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:58.358522 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-3bd8929a-ef1e-42a3-97b7-f3e88a364b23 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:44:58.360143 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 394/780] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:58.366356 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d40522-ace0-4c16-a2f1-dfb0fca3ecc2 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:58.376028 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d40522-ace0-4c16-a2f1-dfb0fca3ecc2 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:58.380587 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a96e57-011d-4a6b-969f-b6cc8cc035bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:58.381278 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a96e57-011d-4a6b-969f-b6cc8cc035bb admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:58.381559 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a96e57-011d-4a6b-969f-b6cc8cc035bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:58.381895 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a96e57-011d-4a6b-969f-b6cc8cc035bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:58.383225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a96e57-011d-4a6b-969f-b6cc8cc035bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:58.383559 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a96e57-011d-4a6b-969f-b6cc8cc035bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:58.385175 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a96e57-011d-4a6b-969f-b6cc8cc035bb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:58.398883 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 387/781] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:58.405688 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8929a-ef1e-42a3-97b7-f3e88a364b23 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:58.417314 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8929a-ef1e-42a3-97b7-f3e88a364b23 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:58.422210 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d431f47-dc59-4c8e-8d34-0401d21fef9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:58.423235 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d431f47-dc59-4c8e-8d34-0401d21fef9a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:58.423506 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d431f47-dc59-4c8e-8d34-0401d21fef9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:58.423827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d431f47-dc59-4c8e-8d34-0401d21fef9a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:58.432481 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d431f47-dc59-4c8e-8d34-0401d21fef9a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:58.434424 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d431f47-dc59-4c8e-8d34-0401d21fef9a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:58.448356 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-8d431f47-dc59-4c8e-8d34-0401d21fef9a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:44:58.449916 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 395/782] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:44:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:58.456318 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a96e57-011d-4a6b-969f-b6cc8cc035bb admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:58.467356 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a96e57-011d-4a6b-969f-b6cc8cc035bb admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:58.472099 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490cf28-a76f-45b3-9efb-233065f635ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:58.472843 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490cf28-a76f-45b3-9efb-233065f635ac admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:58.473154 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490cf28-a76f-45b3-9efb-233065f635ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:58.473479 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490cf28-a76f-45b3-9efb-233065f635ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:58.474289 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490cf28-a76f-45b3-9efb-233065f635ac admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:58.474666 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490cf28-a76f-45b3-9efb-233065f635ac admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:58.477168 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490cf28-a76f-45b3-9efb-233065f635ac admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:58.490874 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 388/783] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:44:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:58.498458 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d431f47-dc59-4c8e-8d34-0401d21fef9a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:58.510544 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d431f47-dc59-4c8e-8d34-0401d21fef9a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:58.515388 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568aa212-c2c6-4aa8-bd16-1ac86cfa7c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:58.516042 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568aa212-c2c6-4aa8-bd16-1ac86cfa7c61 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:58.516322 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568aa212-c2c6-4aa8-bd16-1ac86cfa7c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:58.516648 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568aa212-c2c6-4aa8-bd16-1ac86cfa7c61 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:58.517516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568aa212-c2c6-4aa8-bd16-1ac86cfa7c61 admin admin] RBAC: Adding query filter params (role.id=0acbfad7f9ea4a69860babec7e6a317c, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=591d508a3867412fac76d00134e58864) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:58.517880 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568aa212-c2c6-4aa8-bd16-1ac86cfa7c61 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:58.519803 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568aa212-c2c6-4aa8-bd16-1ac86cfa7c61 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:58.527281 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 396/784] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:44:58 2022] GET /identity/v3/role_assignments?user.id=591d508a3867412fac76d00134e58864&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=0acbfad7f9ea4a69860babec7e6a317c => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:59.456030 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fe6f2-da40-4db5-a669-bffe56f643ff None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:59.456681 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fe6f2-da40-4db5-a669-bffe56f643ff None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:59.456681 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fe6f2-da40-4db5-a669-bffe56f643ff None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:59.458764 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 389/785] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:59.466548 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10e72f-c4cc-4ae0-8045-c434354ae8d3 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:59.467137 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10e72f-c4cc-4ae0-8045-c434354ae8d3 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:59.467137 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10e72f-c4cc-4ae0-8045-c434354ae8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:59.487438 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-fb10e72f-c4cc-4ae0-8045-c434354ae8d3 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:59.488644 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-fb10e72f-c4cc-4ae0-8045-c434354ae8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:59.500909 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 397/786] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:59 2022] POST /identity/v3/auth/tokens => generated 1715 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:44:59.521790 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fe6f2-da40-4db5-a669-bffe56f643ff None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:59.534615 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fe6f2-da40-4db5-a669-bffe56f643ff None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:59.542103 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b5db6-2a5d-48ba-9b1c-051b40f1462d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:59.542922 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b5db6-2a5d-48ba-9b1c-051b40f1462d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:59.543205 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b5db6-2a5d-48ba-9b1c-051b40f1462d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:59.543475 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b5db6-2a5d-48ba-9b1c-051b40f1462d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:59.544130 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b5db6-2a5d-48ba-9b1c-051b40f1462d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:59.545765 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b5db6-2a5d-48ba-9b1c-051b40f1462d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:59.561510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-8f5b5db6-2a5d-48ba-9b1c-051b40f1462d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:44:59.568426 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 390/787] 10.222.0.96 () {56 vars in 1147 bytes} [Fri Jan 28 01:44:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:44:59.569832 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10e72f-c4cc-4ae0-8045-c434354ae8d3 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:59.580538 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10e72f-c4cc-4ae0-8045-c434354ae8d3 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:59.585201 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820eba05-6566-4c64-a985-b97e0e6366a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:59.585976 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820eba05-6566-4c64-a985-b97e0e6366a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:59.586257 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820eba05-6566-4c64-a985-b97e0e6366a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:59.586529 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820eba05-6566-4c64-a985-b97e0e6366a5 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:59.587248 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820eba05-6566-4c64-a985-b97e0e6366a5 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:59.587548 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820eba05-6566-4c64-a985-b97e0e6366a5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:59.589209 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820eba05-6566-4c64-a985-b97e0e6366a5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:59.599740 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 398/788] 10.222.0.96 () {56 vars in 1143 bytes} [Fri Jan 28 01:44:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:59.601176 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b5db6-2a5d-48ba-9b1c-051b40f1462d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:59.611813 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b5db6-2a5d-48ba-9b1c-051b40f1462d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:59.616508 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80802b9b-ba6d-477f-9ae8-d351c9cca5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:59.617828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80802b9b-ba6d-477f-9ae8-d351c9cca5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:59.618134 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80802b9b-ba6d-477f-9ae8-d351c9cca5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:59.618373 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80802b9b-ba6d-477f-9ae8-d351c9cca5b5 admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:59.619137 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80802b9b-ba6d-477f-9ae8-d351c9cca5b5 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:44:59.619444 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80802b9b-ba6d-477f-9ae8-d351c9cca5b5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:59.621050 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80802b9b-ba6d-477f-9ae8-d351c9cca5b5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:59.634022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 391/789] 10.222.0.96 () {56 vars in 1143 bytes} [Fri Jan 28 01:44:59 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:44:59.748583 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858be10-fa23-4a34-bc82-0cba204d0d2a None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:59.748946 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858be10-fa23-4a34-bc82-0cba204d0d2a None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:59.749148 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858be10-fa23-4a34-bc82-0cba204d0d2a None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:59.751096 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 399/790] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:59.759437 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a8722-089e-48a6-bf9f-13bdb39adb2e None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:59.759774 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a8722-089e-48a6-bf9f-13bdb39adb2e None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:59.759986 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a8722-089e-48a6-bf9f-13bdb39adb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:59.780983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-164a8722-089e-48a6-bf9f-13bdb39adb2e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:44:59.782270 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-164a8722-089e-48a6-bf9f-13bdb39adb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:44:59.791572 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 392/791] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:59 2022] POST /identity/v3/auth/tokens => generated 1715 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:44:59.816980 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858be10-fa23-4a34-bc82-0cba204d0d2a None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:44:59.829970 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858be10-fa23-4a34-bc82-0cba204d0d2a None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:44:59.835020 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d636f0-5bb7-45dd-a907-ca6fe0a2047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:44:59.835713 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d636f0-5bb7-45dd-a907-ca6fe0a2047b admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:59.836121 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d636f0-5bb7-45dd-a907-ca6fe0a2047b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:59.836397 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d636f0-5bb7-45dd-a907-ca6fe0a2047b admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:59.837151 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d636f0-5bb7-45dd-a907-ca6fe0a2047b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:44:59.838908 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d636f0-5bb7-45dd-a907-ca6fe0a2047b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:44:59.856055 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 400/792] 10.222.0.96 () {60 vars in 1162 bytes} [Fri Jan 28 01:44:59 2022] POST /identity/v3/services => generated 251 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:44:59.969106 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70b6fb-2717-4cb7-9b5e-67e98d13588a None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:59.969405 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70b6fb-2717-4cb7-9b5e-67e98d13588a None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:59.969650 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70b6fb-2717-4cb7-9b5e-67e98d13588a None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:44:59.971781 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 393/793] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:44:59.980535 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240760b0-f0b7-4787-86ec-82a72b400315 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:44:59.980849 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240760b0-f0b7-4787-86ec-82a72b400315 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:44:59.981133 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240760b0-f0b7-4787-86ec-82a72b400315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:00.004691 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-240760b0-f0b7-4787-86ec-82a72b400315 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:00.006160 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-240760b0-f0b7-4787-86ec-82a72b400315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:00.025721 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 401/794] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:44:59 2022] POST /identity/v3/auth/tokens => generated 1816 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:00.050445 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70b6fb-2717-4cb7-9b5e-67e98d13588a None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:00.066092 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70b6fb-2717-4cb7-9b5e-67e98d13588a None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:00.071151 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6f2f0-a22e-467d-a990-a8c0b2421965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:00.072232 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6f2f0-a22e-467d-a990-a8c0b2421965 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:00.072514 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6f2f0-a22e-467d-a990-a8c0b2421965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:00.072788 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6f2f0-a22e-467d-a990-a8c0b2421965 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:00.073476 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6f2f0-a22e-467d-a990-a8c0b2421965 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:00.075069 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6f2f0-a22e-467d-a990-a8c0b2421965 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:00.087456 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-dad6f2f0-a22e-467d-a990-a8c0b2421965 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 28 01:45:00.089022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 394/795] 10.222.0.96 () {56 vars in 1153 bytes} [Fri Jan 28 01:45:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:00.095574 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240760b0-f0b7-4787-86ec-82a72b400315 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:00.105361 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240760b0-f0b7-4787-86ec-82a72b400315 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:00.109935 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d42cea-5fe6-4651-9a3e-bcc8e261257c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:00.110596 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d42cea-5fe6-4651-9a3e-bcc8e261257c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:00.110872 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d42cea-5fe6-4651-9a3e-bcc8e261257c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:00.111142 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d42cea-5fe6-4651-9a3e-bcc8e261257c admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:00.111840 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d42cea-5fe6-4651-9a3e-bcc8e261257c admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:00.112140 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d42cea-5fe6-4651-9a3e-bcc8e261257c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:00.113755 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d42cea-5fe6-4651-9a3e-bcc8e261257c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:00.119734 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 402/796] 10.222.0.96 () {56 vars in 1147 bytes} [Fri Jan 28 01:45:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:00.125969 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6f2f0-a22e-467d-a990-a8c0b2421965 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:00.136601 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6f2f0-a22e-467d-a990-a8c0b2421965 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:00.141134 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906df0c0-b174-42f1-8985-62984926ceeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:00.141775 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906df0c0-b174-42f1-8985-62984926ceeb admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:00.142050 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906df0c0-b174-42f1-8985-62984926ceeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:00.142320 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906df0c0-b174-42f1-8985-62984926ceeb admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:00.143020 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906df0c0-b174-42f1-8985-62984926ceeb admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:00.143320 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906df0c0-b174-42f1-8985-62984926ceeb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:00.144908 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906df0c0-b174-42f1-8985-62984926ceeb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:00.150893 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 395/797] 10.222.0.96 () {56 vars in 1147 bytes} [Fri Jan 28 01:45:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:45:00.157880 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d42cea-5fe6-4651-9a3e-bcc8e261257c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:00.168544 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d42cea-5fe6-4651-9a3e-bcc8e261257c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:00.173192 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21028346-4b50-483f-9ac9-a596fe469c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:00.173844 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21028346-4b50-483f-9ac9-a596fe469c8b admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:00.174119 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21028346-4b50-483f-9ac9-a596fe469c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:00.174386 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21028346-4b50-483f-9ac9-a596fe469c8b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:00.175164 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21028346-4b50-483f-9ac9-a596fe469c8b admin admin] RBAC: Adding query filter params (interface=public, service_id=88a02304c931425e842e02612287ebc1, region_id=RegionOne) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:00.175466 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21028346-4b50-483f-9ac9-a596fe469c8b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:00.177216 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21028346-4b50-483f-9ac9-a596fe469c8b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:00.183248 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 403/798] 10.222.0.96 () {56 vars in 1272 bytes} [Fri Jan 28 01:45:00 2022] GET /identity/v3/endpoints?service_id=88a02304c931425e842e02612287ebc1&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:00.189344 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906df0c0-b174-42f1-8985-62984926ceeb admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:00.199595 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906df0c0-b174-42f1-8985-62984926ceeb admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:00.205821 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25702e-ba43-482d-a158-2febcdb304d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:00.206510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25702e-ba43-482d-a158-2febcdb304d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:00.206785 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25702e-ba43-482d-a158-2febcdb304d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:00.207054 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25702e-ba43-482d-a158-2febcdb304d7 admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:00.207738 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25702e-ba43-482d-a158-2febcdb304d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:00.209354 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25702e-ba43-482d-a158-2febcdb304d7 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:00.216884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 396/799] 10.222.0.96 () {56 vars in 1108 bytes} [Fri Jan 28 01:45:00 2022] GET /identity/v3/services => generated 1268 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:45:00.856405 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1e39d-a53f-4839-b7b2-7ec0c6aad7b9 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:00.856930 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1e39d-a53f-4839-b7b2-7ec0c6aad7b9 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:00.856930 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1e39d-a53f-4839-b7b2-7ec0c6aad7b9 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:00.858913 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 404/800] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:00.866669 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e4c55-f0e5-4946-8a7e-df992e4e9121 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:00.867260 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e4c55-f0e5-4946-8a7e-df992e4e9121 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:00.867260 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e4c55-f0e5-4946-8a7e-df992e4e9121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:00.887318 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-9b2e4c55-f0e5-4946-8a7e-df992e4e9121 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:00.888594 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-9b2e4c55-f0e5-4946-8a7e-df992e4e9121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:00.897170 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 397/801] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:00 2022] POST /identity/v3/auth/tokens => generated 1816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:45:00.922829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1e39d-a53f-4839-b7b2-7ec0c6aad7b9 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:00.935989 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1e39d-a53f-4839-b7b2-7ec0c6aad7b9 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:00.940575 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643dcc9-cafa-4726-b42f-f8632f9bfb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:00.941437 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643dcc9-cafa-4726-b42f-f8632f9bfb12 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:00.941719 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643dcc9-cafa-4726-b42f-f8632f9bfb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:00.941988 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643dcc9-cafa-4726-b42f-f8632f9bfb12 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:00.954641 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643dcc9-cafa-4726-b42f-f8632f9bfb12 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:45:00.962956 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-8643dcc9-cafa-4726-b42f-f8632f9bfb12 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:45:00.964544 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 405/802] 10.222.0.96 () {56 vars in 1141 bytes} [Fri Jan 28 01:45:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:00.971318 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e4c55-f0e5-4946-8a7e-df992e4e9121 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:00.981536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e4c55-f0e5-4946-8a7e-df992e4e9121 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:00.986351 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07840c5a-c2b6-4542-ba82-557d1d345f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:00.987039 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07840c5a-c2b6-4542-ba82-557d1d345f74 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:00.987320 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07840c5a-c2b6-4542-ba82-557d1d345f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:00.987596 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07840c5a-c2b6-4542-ba82-557d1d345f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:00.988353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07840c5a-c2b6-4542-ba82-557d1d345f74 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:00.988660 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07840c5a-c2b6-4542-ba82-557d1d345f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:00.990313 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07840c5a-c2b6-4542-ba82-557d1d345f74 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:01.000259 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 398/803] 10.222.0.96 () {56 vars in 1136 bytes} [Fri Jan 28 01:45:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:01.006770 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643dcc9-cafa-4726-b42f-f8632f9bfb12 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:01.018648 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643dcc9-cafa-4726-b42f-f8632f9bfb12 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:01.025731 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78441d26-fd4a-43aa-bc96-f24118fdaf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:01.026984 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78441d26-fd4a-43aa-bc96-f24118fdaf5d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:01.027775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78441d26-fd4a-43aa-bc96-f24118fdaf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:01.028162 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78441d26-fd4a-43aa-bc96-f24118fdaf5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:01.042335 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78441d26-fd4a-43aa-bc96-f24118fdaf5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:01.044228 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78441d26-fd4a-43aa-bc96-f24118fdaf5d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:01.061941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-78441d26-fd4a-43aa-bc96-f24118fdaf5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:45:01.063500 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 406/804] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:01.069833 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07840c5a-c2b6-4542-ba82-557d1d345f74 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:01.080134 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07840c5a-c2b6-4542-ba82-557d1d345f74 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:01.085045 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc3aca-5eb8-4c5b-bbe0-8a385aef3129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:01.086348 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc3aca-5eb8-4c5b-bbe0-8a385aef3129 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:01.086790 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc3aca-5eb8-4c5b-bbe0-8a385aef3129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:01.087074 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc3aca-5eb8-4c5b-bbe0-8a385aef3129 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:01.087809 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc3aca-5eb8-4c5b-bbe0-8a385aef3129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:01.088163 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc3aca-5eb8-4c5b-bbe0-8a385aef3129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:01.089838 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc3aca-5eb8-4c5b-bbe0-8a385aef3129 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:01.103905 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 399/805] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:01.110471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78441d26-fd4a-43aa-bc96-f24118fdaf5d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:01.120551 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78441d26-fd4a-43aa-bc96-f24118fdaf5d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:01.125643 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f182f-467b-47ee-bcc3-69881df4f51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:01.126510 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f182f-467b-47ee-bcc3-69881df4f51f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:01.126791 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f182f-467b-47ee-bcc3-69881df4f51f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:01.127063 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f182f-467b-47ee-bcc3-69881df4f51f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:01.135970 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f182f-467b-47ee-bcc3-69881df4f51f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:01.138185 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f182f-467b-47ee-bcc3-69881df4f51f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:01.155068 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-294f182f-467b-47ee-bcc3-69881df4f51f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:45:01.156631 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 407/806] 10.222.0.96 () {56 vars in 1138 bytes} [Fri Jan 28 01:45:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:01.163082 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc3aca-5eb8-4c5b-bbe0-8a385aef3129 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:01.174033 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc3aca-5eb8-4c5b-bbe0-8a385aef3129 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:01.178973 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82caa60d-8d07-40aa-bedb-0284cf22f4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:01.180247 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caa60d-8d07-40aa-bedb-0284cf22f4ee admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:01.180547 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caa60d-8d07-40aa-bedb-0284cf22f4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:01.180920 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caa60d-8d07-40aa-bedb-0284cf22f4ee admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:01.181764 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82caa60d-8d07-40aa-bedb-0284cf22f4ee admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:01.182125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82caa60d-8d07-40aa-bedb-0284cf22f4ee admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:01.184014 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82caa60d-8d07-40aa-bedb-0284cf22f4ee admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:01.203457 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 400/807] 10.222.0.96 () {56 vars in 1170 bytes} [Fri Jan 28 01:45:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:01.209898 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f182f-467b-47ee-bcc3-69881df4f51f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:01.220138 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f182f-467b-47ee-bcc3-69881df4f51f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:01.225172 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60b074-e4a1-46c9-ab3e-6c4a8f105c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:01.226013 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60b074-e4a1-46c9-ab3e-6c4a8f105c07 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:01.226807 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60b074-e4a1-46c9-ab3e-6c4a8f105c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:01.227129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60b074-e4a1-46c9-ab3e-6c4a8f105c07 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:01.238748 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60b074-e4a1-46c9-ab3e-6c4a8f105c07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:01.240601 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60b074-e4a1-46c9-ab3e-6c4a8f105c07 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:01.258913 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-0a60b074-e4a1-46c9-ab3e-6c4a8f105c07 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:45:01.260404 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 408/808] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:01.266836 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82caa60d-8d07-40aa-bedb-0284cf22f4ee admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:01.277666 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82caa60d-8d07-40aa-bedb-0284cf22f4ee admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:01.282235 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5841303-f274-4ca8-bef9-38202f821d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:01.282891 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5841303-f274-4ca8-bef9-38202f821d91 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:01.283223 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5841303-f274-4ca8-bef9-38202f821d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:01.283505 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5841303-f274-4ca8-bef9-38202f821d91 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:01.284223 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5841303-f274-4ca8-bef9-38202f821d91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:01.284579 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5841303-f274-4ca8-bef9-38202f821d91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:01.286305 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5841303-f274-4ca8-bef9-38202f821d91 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:01.299852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 401/809] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:01.306570 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60b074-e4a1-46c9-ab3e-6c4a8f105c07 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:01.316613 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60b074-e4a1-46c9-ab3e-6c4a8f105c07 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:01.321834 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277d50f-0d45-487e-8df5-f4e01ed00734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:01.322832 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277d50f-0d45-487e-8df5-f4e01ed00734 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:01.323120 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277d50f-0d45-487e-8df5-f4e01ed00734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:01.323395 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277d50f-0d45-487e-8df5-f4e01ed00734 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:01.331047 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277d50f-0d45-487e-8df5-f4e01ed00734 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:01.333118 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277d50f-0d45-487e-8df5-f4e01ed00734 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:01.346666 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-2277d50f-0d45-487e-8df5-f4e01ed00734 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:45:01.348215 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 409/810] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:45:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:01.355217 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5841303-f274-4ca8-bef9-38202f821d91 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:01.365747 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5841303-f274-4ca8-bef9-38202f821d91 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:01.371364 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e12683-51bf-41db-b66b-e773042fddf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:01.372315 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e12683-51bf-41db-b66b-e773042fddf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:01.372973 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e12683-51bf-41db-b66b-e773042fddf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:01.373465 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e12683-51bf-41db-b66b-e773042fddf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:01.374500 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e12683-51bf-41db-b66b-e773042fddf7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:01.375011 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e12683-51bf-41db-b66b-e773042fddf7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:01.377152 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e12683-51bf-41db-b66b-e773042fddf7 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:01.396228 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 402/811] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:45:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:01.397824 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277d50f-0d45-487e-8df5-f4e01ed00734 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:01.409709 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277d50f-0d45-487e-8df5-f4e01ed00734 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:01.415362 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11806c-7c6d-4803-82e6-3c29015678e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:01.416535 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11806c-7c6d-4803-82e6-3c29015678e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:01.417065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11806c-7c6d-4803-82e6-3c29015678e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:01.417591 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11806c-7c6d-4803-82e6-3c29015678e0 admin admin] PATH_INFO: `/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/591d508a3867412fac76d00134e58864/roles/0acbfad7f9ea4a69860babec7e6a317c` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:01.420156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11806c-7c6d-4803-82e6-3c29015678e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356ecb479ba24136a7c38cb5a58a0a18, user_id=591d508a3867412fac76d00134e58864, role_id=0acbfad7f9ea4a69860babec7e6a317c)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:01.423172 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11806c-7c6d-4803-82e6-3c29015678e0 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:01.448980 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 410/812] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:45:01 2022] PUT /identity/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/591d508a3867412fac76d00134e58864/roles/0acbfad7f9ea4a69860babec7e6a317c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:45:01.951960 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25af910-4df4-450e-8588-f0ab6ec5518c None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:01.952471 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25af910-4df4-450e-8588-f0ab6ec5518c None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:01.952546 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25af910-4df4-450e-8588-f0ab6ec5518c None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:01.954558 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 403/813] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:01.963366 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825af66-0dd0-4d33-9b8a-461d3546834c None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:01.963872 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825af66-0dd0-4d33-9b8a-461d3546834c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:01.963950 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825af66-0dd0-4d33-9b8a-461d3546834c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:01.982924 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-9825af66-0dd0-4d33-9b8a-461d3546834c None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:01.984509 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-9825af66-0dd0-4d33-9b8a-461d3546834c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:02.044526 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 411/814] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:01 2022] POST /identity/v3/auth/tokens => generated 1816 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:02.068960 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25af910-4df4-450e-8588-f0ab6ec5518c None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:02.082370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25af910-4df4-450e-8588-f0ab6ec5518c None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:02.087808 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86de45b-256b-4b6b-a30e-1733ecc13e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:02.088516 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86de45b-256b-4b6b-a30e-1733ecc13e00 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:02.088823 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86de45b-256b-4b6b-a30e-1733ecc13e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:02.089099 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86de45b-256b-4b6b-a30e-1733ecc13e00 admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:02.089833 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86de45b-256b-4b6b-a30e-1733ecc13e00 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:02.091400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86de45b-256b-4b6b-a30e-1733ecc13e00 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:02.110929 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 404/815] 10.222.0.96 () {60 vars in 1162 bytes} [Fri Jan 28 01:45:02 2022] POST /identity/v3/services => generated 241 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:45:02.213198 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090da66-58e7-49d5-9b12-dd965e162841 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:02.213389 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090da66-58e7-49d5-9b12-dd965e162841 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:02.213667 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090da66-58e7-49d5-9b12-dd965e162841 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:02.216064 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 412/816] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:02.224317 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6cf3-8f12-4e8e-b079-ad93dd5b76d4 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:02.224625 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6cf3-8f12-4e8e-b079-ad93dd5b76d4 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:02.224902 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6cf3-8f12-4e8e-b079-ad93dd5b76d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:02.244556 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-e9bc6cf3-8f12-4e8e-b079-ad93dd5b76d4 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:02.245885 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-e9bc6cf3-8f12-4e8e-b079-ad93dd5b76d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:02.265088 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 405/817] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:02 2022] POST /identity/v3/auth/tokens => generated 1918 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:02.290987 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090da66-58e7-49d5-9b12-dd965e162841 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:02.304020 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090da66-58e7-49d5-9b12-dd965e162841 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:02.309372 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd37113-10d9-4422-a9da-30f6aaeb71fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:02.310163 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd37113-10d9-4422-a9da-30f6aaeb71fd admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:02.310443 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd37113-10d9-4422-a9da-30f6aaeb71fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:02.310711 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd37113-10d9-4422-a9da-30f6aaeb71fd admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:02.311353 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd37113-10d9-4422-a9da-30f6aaeb71fd admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:02.312983 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd37113-10d9-4422-a9da-30f6aaeb71fd admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:02.325921 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-6dd37113-10d9-4422-a9da-30f6aaeb71fd admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 28 01:45:02.327559 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 413/818] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:45:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:02.334201 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc6cf3-8f12-4e8e-b079-ad93dd5b76d4 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:02.344165 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc6cf3-8f12-4e8e-b079-ad93dd5b76d4 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:02.348829 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee135f8-758d-46aa-b954-7294f0628517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:02.349492 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee135f8-758d-46aa-b954-7294f0628517 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:02.349774 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee135f8-758d-46aa-b954-7294f0628517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:02.350051 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee135f8-758d-46aa-b954-7294f0628517 admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:02.350759 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee135f8-758d-46aa-b954-7294f0628517 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:02.351062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee135f8-758d-46aa-b954-7294f0628517 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:02.352732 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee135f8-758d-46aa-b954-7294f0628517 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:02.361842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 406/819] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:45:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:02.368950 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd37113-10d9-4422-a9da-30f6aaeb71fd admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:02.379277 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd37113-10d9-4422-a9da-30f6aaeb71fd admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:02.384456 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f5be4-326e-4fac-a21d-980de56bb5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:02.385147 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f5be4-326e-4fac-a21d-980de56bb5db admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:02.385427 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f5be4-326e-4fac-a21d-980de56bb5db admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:02.385707 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f5be4-326e-4fac-a21d-980de56bb5db admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:02.386421 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f5be4-326e-4fac-a21d-980de56bb5db admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:02.386724 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f5be4-326e-4fac-a21d-980de56bb5db admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:02.388321 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f5be4-326e-4fac-a21d-980de56bb5db admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:02.394147 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 414/820] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:45:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:02.400600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee135f8-758d-46aa-b954-7294f0628517 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:02.410685 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee135f8-758d-46aa-b954-7294f0628517 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:02.415500 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd52cb-ffac-4cd2-8f31-d9699baf9983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:02.416152 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd52cb-ffac-4cd2-8f31-d9699baf9983 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:02.416439 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd52cb-ffac-4cd2-8f31-d9699baf9983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:02.416714 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd52cb-ffac-4cd2-8f31-d9699baf9983 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:02.417535 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd52cb-ffac-4cd2-8f31-d9699baf9983 admin admin] RBAC: Adding query filter params (interface=public, service_id=dba5bb3740474768b340dbf808c15dfe, region_id=RegionOne) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:02.417850 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd52cb-ffac-4cd2-8f31-d9699baf9983 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:02.419429 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd52cb-ffac-4cd2-8f31-d9699baf9983 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:02.425686 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 407/821] 10.222.0.96 () {56 vars in 1272 bytes} [Fri Jan 28 01:45:02 2022] GET /identity/v3/endpoints?service_id=dba5bb3740474768b340dbf808c15dfe&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:02.432691 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f5be4-326e-4fac-a21d-980de56bb5db admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:02.442759 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f5be4-326e-4fac-a21d-980de56bb5db admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:02.448302 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abf7e2-e016-4f9b-b0ce-234b68ff6bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:02.449001 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abf7e2-e016-4f9b-b0ce-234b68ff6bad admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:02.449280 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abf7e2-e016-4f9b-b0ce-234b68ff6bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:02.449551 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abf7e2-e016-4f9b-b0ce-234b68ff6bad admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:02.450238 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abf7e2-e016-4f9b-b0ce-234b68ff6bad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:02.451896 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abf7e2-e016-4f9b-b0ce-234b68ff6bad admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:02.458922 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 415/822] 10.222.0.96 () {56 vars in 1108 bytes} [Fri Jan 28 01:45:02 2022] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:45:02.552138 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ccdaf-6440-4f31-92c2-a3c6aecf9f7a None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:02.552728 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ccdaf-6440-4f31-92c2-a3c6aecf9f7a None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:02.553281 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ccdaf-6440-4f31-92c2-a3c6aecf9f7a None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:02.556353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 408/823] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:02.564644 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c30e7f-c780-4076-be1a-d0ec74cf6cf4 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:02.565300 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c30e7f-c780-4076-be1a-d0ec74cf6cf4 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:02.565820 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c30e7f-c780-4076-be1a-d0ec74cf6cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:02.585967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-e5c30e7f-c780-4076-be1a-d0ec74cf6cf4 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:02.587565 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-e5c30e7f-c780-4076-be1a-d0ec74cf6cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:02.596319 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 416/824] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:02 2022] POST /identity/v3/auth/tokens => generated 1918 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:02.621882 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ccdaf-6440-4f31-92c2-a3c6aecf9f7a None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:02.635934 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ccdaf-6440-4f31-92c2-a3c6aecf9f7a None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:02.640454 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d1c77-84c3-4fd8-a2c2-ccee033786b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:02.641358 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d1c77-84c3-4fd8-a2c2-ccee033786b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:02.641729 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d1c77-84c3-4fd8-a2c2-ccee033786b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:02.642076 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d1c77-84c3-4fd8-a2c2-ccee033786b3 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:02.642799 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d1c77-84c3-4fd8-a2c2-ccee033786b3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:02.644454 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d1c77-84c3-4fd8-a2c2-ccee033786b3 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:02.657696 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-961d1c77-84c3-4fd8-a2c2-ccee033786b3 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 28 01:45:02.659169 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 409/825] 10.222.0.96 () {56 vars in 1153 bytes} [Fri Jan 28 01:45:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:02.665779 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c30e7f-c780-4076-be1a-d0ec74cf6cf4 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:02.675021 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c30e7f-c780-4076-be1a-d0ec74cf6cf4 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:02.679663 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b08967-6dd8-4061-8f56-7754c119f217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:02.680326 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b08967-6dd8-4061-8f56-7754c119f217 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:02.680606 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b08967-6dd8-4061-8f56-7754c119f217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:02.680908 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b08967-6dd8-4061-8f56-7754c119f217 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:02.681619 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b08967-6dd8-4061-8f56-7754c119f217 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:02.681920 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b08967-6dd8-4061-8f56-7754c119f217 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:02.683510 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b08967-6dd8-4061-8f56-7754c119f217 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:02.688991 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 417/826] 10.222.0.96 () {56 vars in 1147 bytes} [Fri Jan 28 01:45:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:02.695934 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d1c77-84c3-4fd8-a2c2-ccee033786b3 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:02.705730 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d1c77-84c3-4fd8-a2c2-ccee033786b3 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:02.710687 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cc862-5b6c-4202-a70f-0362bf688cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:02.712048 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cc862-5b6c-4202-a70f-0362bf688cee admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:02.712381 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cc862-5b6c-4202-a70f-0362bf688cee admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:02.712668 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cc862-5b6c-4202-a70f-0362bf688cee admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:02.713449 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cc862-5b6c-4202-a70f-0362bf688cee admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:02.713759 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cc862-5b6c-4202-a70f-0362bf688cee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:02.715766 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995cc862-5b6c-4202-a70f-0362bf688cee admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:02.721943 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 410/827] 10.222.0.96 () {56 vars in 1147 bytes} [Fri Jan 28 01:45:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:02.730242 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b08967-6dd8-4061-8f56-7754c119f217 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:02.740542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b08967-6dd8-4061-8f56-7754c119f217 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:02.745620 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a0c24-913f-4fb0-870e-34fc0cd372a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:02.746272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a0c24-913f-4fb0-870e-34fc0cd372a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:02.746606 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a0c24-913f-4fb0-870e-34fc0cd372a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:02.746886 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a0c24-913f-4fb0-870e-34fc0cd372a2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:02.747684 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a0c24-913f-4fb0-870e-34fc0cd372a2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:02.749427 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a0c24-913f-4fb0-870e-34fc0cd372a2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:02.771108 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 418/828] 10.222.0.96 () {60 vars in 1165 bytes} [Fri Jan 28 01:45:02 2022] POST /identity/v3/endpoints => generated 347 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:45:03.752224 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1348f-6a62-4be4-b886-189d71d975e6 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:03.752990 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1348f-6a62-4be4-b886-189d71d975e6 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:03.752990 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1348f-6a62-4be4-b886-189d71d975e6 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:03.754845 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 411/829] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:03.763712 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5e6ab-a61c-4e45-b0f8-2558814f2dd0 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:03.764377 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5e6ab-a61c-4e45-b0f8-2558814f2dd0 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:03.764377 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5e6ab-a61c-4e45-b0f8-2558814f2dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:03.783520 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-91b5e6ab-a61c-4e45-b0f8-2558814f2dd0 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:03.784718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-91b5e6ab-a61c-4e45-b0f8-2558814f2dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:03.808995 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 419/830] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:03 2022] POST /identity/v3/auth/tokens => generated 2105 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:03.829456 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1348f-6a62-4be4-b886-189d71d975e6 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:03.841892 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1348f-6a62-4be4-b886-189d71d975e6 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:03.846320 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac0d98-d1fb-44c6-8810-dc563d09fe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:03.847118 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac0d98-d1fb-44c6-8810-dc563d09fe68 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:03.847395 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac0d98-d1fb-44c6-8810-dc563d09fe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:03.847668 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac0d98-d1fb-44c6-8810-dc563d09fe68 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:03.859397 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac0d98-d1fb-44c6-8810-dc563d09fe68 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:45:03.866597 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-3aac0d98-d1fb-44c6-8810-dc563d09fe68 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:45:03.872905 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 412/831] 10.222.0.96 () {56 vars in 1141 bytes} [Fri Jan 28 01:45:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:03.875308 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5e6ab-a61c-4e45-b0f8-2558814f2dd0 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:03.884920 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5e6ab-a61c-4e45-b0f8-2558814f2dd0 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:03.889559 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18971d13-e743-4e02-b4cf-7a7cdb1851af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:03.890222 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18971d13-e743-4e02-b4cf-7a7cdb1851af admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:03.890502 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18971d13-e743-4e02-b4cf-7a7cdb1851af admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:03.890772 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18971d13-e743-4e02-b4cf-7a7cdb1851af admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:03.891515 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18971d13-e743-4e02-b4cf-7a7cdb1851af admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:03.891818 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18971d13-e743-4e02-b4cf-7a7cdb1851af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:03.893450 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18971d13-e743-4e02-b4cf-7a7cdb1851af admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:03.907787 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 420/832] 10.222.0.96 () {56 vars in 1136 bytes} [Fri Jan 28 01:45:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:03.909161 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac0d98-d1fb-44c6-8810-dc563d09fe68 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:03.923866 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac0d98-d1fb-44c6-8810-dc563d09fe68 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:03.928186 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e81d6-0189-403d-b98c-08510cc6803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:03.929246 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e81d6-0189-403d-b98c-08510cc6803e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:03.930248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e81d6-0189-403d-b98c-08510cc6803e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:03.930720 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e81d6-0189-403d-b98c-08510cc6803e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:03.941934 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e81d6-0189-403d-b98c-08510cc6803e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:03.946055 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e81d6-0189-403d-b98c-08510cc6803e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:03.963356 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-3c9e81d6-0189-403d-b98c-08510cc6803e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:45:03.965142 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 413/833] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:03.971236 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18971d13-e743-4e02-b4cf-7a7cdb1851af admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:03.981069 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18971d13-e743-4e02-b4cf-7a7cdb1851af admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:03.985696 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ccd8f-8e50-4bb5-8989-662472815620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:03.986348 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ccd8f-8e50-4bb5-8989-662472815620 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:03.986628 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ccd8f-8e50-4bb5-8989-662472815620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:03.986900 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ccd8f-8e50-4bb5-8989-662472815620 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:03.987619 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ccd8f-8e50-4bb5-8989-662472815620 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:03.987923 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ccd8f-8e50-4bb5-8989-662472815620 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:03.989555 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ccd8f-8e50-4bb5-8989-662472815620 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:04.008293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 421/834] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:04.009795 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e81d6-0189-403d-b98c-08510cc6803e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:04.020059 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e81d6-0189-403d-b98c-08510cc6803e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:04.024949 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9239b-eaaa-4a4a-bdf0-dfc51ae79002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:04.025777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9239b-eaaa-4a4a-bdf0-dfc51ae79002 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.026058 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9239b-eaaa-4a4a-bdf0-dfc51ae79002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.026332 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9239b-eaaa-4a4a-bdf0-dfc51ae79002 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.034510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9239b-eaaa-4a4a-bdf0-dfc51ae79002 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:04.036504 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9239b-eaaa-4a4a-bdf0-dfc51ae79002 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:04.051346 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-23b9239b-eaaa-4a4a-bdf0-dfc51ae79002 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:45:04.057994 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 414/835] 10.222.0.96 () {56 vars in 1138 bytes} [Fri Jan 28 01:45:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:04.062365 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ccd8f-8e50-4bb5-8989-662472815620 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:04.073939 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ccd8f-8e50-4bb5-8989-662472815620 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:04.080170 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ba241-fa7e-4669-9c61-b88a4ec21d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:04.081217 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ba241-fa7e-4669-9c61-b88a4ec21d48 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.081665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ba241-fa7e-4669-9c61-b88a4ec21d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.082056 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ba241-fa7e-4669-9c61-b88a4ec21d48 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.082889 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ba241-fa7e-4669-9c61-b88a4ec21d48 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:04.083225 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ba241-fa7e-4669-9c61-b88a4ec21d48 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:04.085129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ba241-fa7e-4669-9c61-b88a4ec21d48 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:04.111292 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 422/836] 10.222.0.96 () {56 vars in 1170 bytes} [Fri Jan 28 01:45:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:04.117943 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9239b-eaaa-4a4a-bdf0-dfc51ae79002 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:04.127715 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9239b-eaaa-4a4a-bdf0-dfc51ae79002 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:04.132930 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159ffe1-f55f-4dbc-a348-1426109bd068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:04.133596 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159ffe1-f55f-4dbc-a348-1426109bd068 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.133875 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159ffe1-f55f-4dbc-a348-1426109bd068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.134199 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159ffe1-f55f-4dbc-a348-1426109bd068 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.142756 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159ffe1-f55f-4dbc-a348-1426109bd068 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:04.144540 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159ffe1-f55f-4dbc-a348-1426109bd068 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:04.159512 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 415/837] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:45:04 2022] GET /identity/v3/auth/tokens => generated 2105 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:45:04.160887 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ba241-fa7e-4669-9c61-b88a4ec21d48 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:04.171518 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ba241-fa7e-4669-9c61-b88a4ec21d48 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:04.176362 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370a260-352e-431c-bde4-1244fd453b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:04.177287 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370a260-352e-431c-bde4-1244fd453b8f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.177815 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370a260-352e-431c-bde4-1244fd453b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.178190 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370a260-352e-431c-bde4-1244fd453b8f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.189634 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370a260-352e-431c-bde4-1244fd453b8f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:04.191540 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370a260-352e-431c-bde4-1244fd453b8f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:04.208942 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-2370a260-352e-431c-bde4-1244fd453b8f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:45:04.210435 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 423/838] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:04.216780 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159ffe1-f55f-4dbc-a348-1426109bd068 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:04.225809 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159ffe1-f55f-4dbc-a348-1426109bd068 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:04.231178 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff9d63-99e7-472d-9540-817522b45855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:04.231827 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff9d63-99e7-472d-9540-817522b45855 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.232105 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff9d63-99e7-472d-9540-817522b45855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.232379 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff9d63-99e7-472d-9540-817522b45855 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.233159 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff9d63-99e7-472d-9540-817522b45855 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:04.233498 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff9d63-99e7-472d-9540-817522b45855 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:04.235112 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff9d63-99e7-472d-9540-817522b45855 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:04.252842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 416/839] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:04.254169 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370a260-352e-431c-bde4-1244fd453b8f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:04.266638 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370a260-352e-431c-bde4-1244fd453b8f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:04.271330 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332bbab-9fc0-4d04-a7d3-3c6ed0b87d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:04.272125 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332bbab-9fc0-4d04-a7d3-3c6ed0b87d7a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.272405 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332bbab-9fc0-4d04-a7d3-3c6ed0b87d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.272681 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332bbab-9fc0-4d04-a7d3-3c6ed0b87d7a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.280540 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332bbab-9fc0-4d04-a7d3-3c6ed0b87d7a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:04.282516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332bbab-9fc0-4d04-a7d3-3c6ed0b87d7a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:04.295994 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-4332bbab-9fc0-4d04-a7d3-3c6ed0b87d7a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:45:04.297520 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 424/840] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:45:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:04.303877 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff9d63-99e7-472d-9540-817522b45855 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:04.314544 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff9d63-99e7-472d-9540-817522b45855 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:04.319358 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b799842-0bea-4040-b6f8-64afa2d041e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:04.320276 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b799842-0bea-4040-b6f8-64afa2d041e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.320772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b799842-0bea-4040-b6f8-64afa2d041e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.321298 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b799842-0bea-4040-b6f8-64afa2d041e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.322310 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b799842-0bea-4040-b6f8-64afa2d041e5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:04.322839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b799842-0bea-4040-b6f8-64afa2d041e5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:04.324935 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b799842-0bea-4040-b6f8-64afa2d041e5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:04.343906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 417/841] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:45:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:04.345721 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332bbab-9fc0-4d04-a7d3-3c6ed0b87d7a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:04.358186 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332bbab-9fc0-4d04-a7d3-3c6ed0b87d7a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:04.363651 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3f37f-1960-408a-b714-bb77abe352da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:04.364717 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3f37f-1960-408a-b714-bb77abe352da admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.365299 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3f37f-1960-408a-b714-bb77abe352da admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.365788 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3f37f-1960-408a-b714-bb77abe352da admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.367855 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3f37f-1960-408a-b714-bb77abe352da admin admin] RBAC: Adding query filter params (role.id=0acbfad7f9ea4a69860babec7e6a317c, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=591d508a3867412fac76d00134e58864) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:04.368616 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3f37f-1960-408a-b714-bb77abe352da admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:04.370833 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3f37f-1960-408a-b714-bb77abe352da admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:04.384986 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 425/842] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:45:04 2022] GET /identity/v3/role_assignments?user.id=591d508a3867412fac76d00134e58864&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=0acbfad7f9ea4a69860babec7e6a317c => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:04.454823 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58d218-b331-4142-a081-4c4899080aaa None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.455141 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58d218-b331-4142-a081-4c4899080aaa None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.455381 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58d218-b331-4142-a081-4c4899080aaa None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.457507 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 418/843] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:04.466337 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0e04-8895-4909-a58e-e7788384f420 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.466664 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0e04-8895-4909-a58e-e7788384f420 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.466896 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0e04-8895-4909-a58e-e7788384f420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.486729 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-b31d0e04-8895-4909-a58e-e7788384f420 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:04.487957 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b31d0e04-8895-4909-a58e-e7788384f420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:04.496591 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 426/844] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:04 2022] POST /identity/v3/auth/tokens => generated 2105 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:04.521189 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58d218-b331-4142-a081-4c4899080aaa None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:04.536057 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58d218-b331-4142-a081-4c4899080aaa None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:04.541574 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad8f45-a6d7-4df9-a435-e1ec98d222fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:04.542454 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad8f45-a6d7-4df9-a435-e1ec98d222fd admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.542737 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad8f45-a6d7-4df9-a435-e1ec98d222fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.543064 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad8f45-a6d7-4df9-a435-e1ec98d222fd admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.543780 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad8f45-a6d7-4df9-a435-e1ec98d222fd admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:04.545504 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad8f45-a6d7-4df9-a435-e1ec98d222fd admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:04.559349 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-b5ad8f45-a6d7-4df9-a435-e1ec98d222fd admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:45:04.561233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 419/845] 10.222.0.96 () {56 vars in 1147 bytes} [Fri Jan 28 01:45:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:45:04.568363 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d0e04-8895-4909-a58e-e7788384f420 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:04.579216 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d0e04-8895-4909-a58e-e7788384f420 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:04.584128 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa6d0c-b7d7-461e-8c56-6fe6f86281dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:04.584786 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa6d0c-b7d7-461e-8c56-6fe6f86281dc admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.585091 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa6d0c-b7d7-461e-8c56-6fe6f86281dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.585365 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa6d0c-b7d7-461e-8c56-6fe6f86281dc admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.586670 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa6d0c-b7d7-461e-8c56-6fe6f86281dc admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:04.586981 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa6d0c-b7d7-461e-8c56-6fe6f86281dc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:04.588586 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa6d0c-b7d7-461e-8c56-6fe6f86281dc admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:04.594122 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 427/846] 10.222.0.96 () {56 vars in 1143 bytes} [Fri Jan 28 01:45:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:04.600662 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad8f45-a6d7-4df9-a435-e1ec98d222fd admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:04.611734 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad8f45-a6d7-4df9-a435-e1ec98d222fd admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:04.616354 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f3735-fd76-49d7-8750-6b2c6b86ec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:04.618878 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f3735-fd76-49d7-8750-6b2c6b86ec60 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.618878 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f3735-fd76-49d7-8750-6b2c6b86ec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.618878 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f3735-fd76-49d7-8750-6b2c6b86ec60 admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.618878 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f3735-fd76-49d7-8750-6b2c6b86ec60 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:04.619207 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f3735-fd76-49d7-8750-6b2c6b86ec60 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:04.621172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f3735-fd76-49d7-8750-6b2c6b86ec60 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:04.627049 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 420/847] 10.222.0.96 () {56 vars in 1143 bytes} [Fri Jan 28 01:45:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:04.634357 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa6d0c-b7d7-461e-8c56-6fe6f86281dc admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:04.644664 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa6d0c-b7d7-461e-8c56-6fe6f86281dc admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:04.650497 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8576b-ad07-42d0-8424-eee18f5891d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:04.651174 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8576b-ad07-42d0-8424-eee18f5891d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.651454 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8576b-ad07-42d0-8424-eee18f5891d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.651725 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8576b-ad07-42d0-8424-eee18f5891d9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.652776 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8576b-ad07-42d0-8424-eee18f5891d9 admin admin] RBAC: Adding query filter params (interface=public, service_id=698458cbad8141f6a9df153504ecd5fe, region_id=RegionOne) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:04.653145 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8576b-ad07-42d0-8424-eee18f5891d9 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:04.654758 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8576b-ad07-42d0-8424-eee18f5891d9 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:04.661091 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 428/848] 10.222.0.96 () {56 vars in 1272 bytes} [Fri Jan 28 01:45:04 2022] GET /identity/v3/endpoints?service_id=698458cbad8141f6a9df153504ecd5fe&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:04.668569 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f3735-fd76-49d7-8750-6b2c6b86ec60 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:04.678940 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f3735-fd76-49d7-8750-6b2c6b86ec60 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:04.684536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5862cfd-7c64-4fec-b3cf-cc0ca7c47caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:04.685245 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5862cfd-7c64-4fec-b3cf-cc0ca7c47caa admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.685584 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5862cfd-7c64-4fec-b3cf-cc0ca7c47caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.685858 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5862cfd-7c64-4fec-b3cf-cc0ca7c47caa admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.686549 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5862cfd-7c64-4fec-b3cf-cc0ca7c47caa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:04.688263 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5862cfd-7c64-4fec-b3cf-cc0ca7c47caa admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:04.701073 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 421/849] 10.222.0.96 () {56 vars in 1108 bytes} [Fri Jan 28 01:45:04 2022] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:45:04.813578 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f7f1b-87fb-41c5-a977-ae8ea5ec57fe None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.814135 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f7f1b-87fb-41c5-a977-ae8ea5ec57fe None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.814135 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f7f1b-87fb-41c5-a977-ae8ea5ec57fe None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.816355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 429/850] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:45:04.826280 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dffd81-d27d-42b6-834b-e5c9e79f24ae None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.826816 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dffd81-d27d-42b6-834b-e5c9e79f24ae None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.826816 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dffd81-d27d-42b6-834b-e5c9e79f24ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.849984 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-18dffd81-d27d-42b6-834b-e5c9e79f24ae None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:04.851927 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-18dffd81-d27d-42b6-834b-e5c9e79f24ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:04.861073 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 422/851] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:04 2022] POST /identity/v3/auth/tokens => generated 2105 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:04.887759 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f7f1b-87fb-41c5-a977-ae8ea5ec57fe None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:04.901833 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f7f1b-87fb-41c5-a977-ae8ea5ec57fe None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:04.906559 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b0b5e-df7b-40ae-820d-a7da617938f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:04.907348 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b0b5e-df7b-40ae-820d-a7da617938f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.907626 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b0b5e-df7b-40ae-820d-a7da617938f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.907892 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b0b5e-df7b-40ae-820d-a7da617938f3 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.908535 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b0b5e-df7b-40ae-820d-a7da617938f3 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:04.910147 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b0b5e-df7b-40ae-820d-a7da617938f3 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:04.922015 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-266b0b5e-df7b-40ae-820d-a7da617938f3 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 28 01:45:04.929045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 430/852] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:45:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:04.930965 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dffd81-d27d-42b6-834b-e5c9e79f24ae None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:04.940270 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dffd81-d27d-42b6-834b-e5c9e79f24ae None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:04.947153 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39117643-2217-4aec-87ea-39b308dd0104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:04.948308 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39117643-2217-4aec-87ea-39b308dd0104 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.948851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39117643-2217-4aec-87ea-39b308dd0104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.949326 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39117643-2217-4aec-87ea-39b308dd0104 admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.950223 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39117643-2217-4aec-87ea-39b308dd0104 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:04.950745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39117643-2217-4aec-87ea-39b308dd0104 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:04.952520 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39117643-2217-4aec-87ea-39b308dd0104 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:04.958200 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 423/853] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:45:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:04.966195 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b0b5e-df7b-40ae-820d-a7da617938f3 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:04.976657 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b0b5e-df7b-40ae-820d-a7da617938f3 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:04.981742 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc173e-fda4-42d9-bf68-904d698eae75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:04.982438 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc173e-fda4-42d9-bf68-904d698eae75 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:04.982718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc173e-fda4-42d9-bf68-904d698eae75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:04.983047 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc173e-fda4-42d9-bf68-904d698eae75 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:04.983745 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc173e-fda4-42d9-bf68-904d698eae75 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:04.984052 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc173e-fda4-42d9-bf68-904d698eae75 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:04.985833 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc173e-fda4-42d9-bf68-904d698eae75 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:04.997043 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 431/854] 10.222.0.96 () {56 vars in 1135 bytes} [Fri Jan 28 01:45:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:04.998364 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39117643-2217-4aec-87ea-39b308dd0104 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:05.011331 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39117643-2217-4aec-87ea-39b308dd0104 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:05.016373 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457ca88-ffa8-405c-9bb6-9cb105cc969b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:05.017301 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457ca88-ffa8-405c-9bb6-9cb105cc969b admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:05.017760 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457ca88-ffa8-405c-9bb6-9cb105cc969b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:05.018284 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457ca88-ffa8-405c-9bb6-9cb105cc969b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:05.019280 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457ca88-ffa8-405c-9bb6-9cb105cc969b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:05.021119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457ca88-ffa8-405c-9bb6-9cb105cc969b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:05.048965 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 424/855] 10.222.0.96 () {60 vars in 1165 bytes} [Fri Jan 28 01:45:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:45:05.212442 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810f9b6-87e1-4cb9-8beb-8d3c8a24e6b4 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:05.212759 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810f9b6-87e1-4cb9-8beb-8d3c8a24e6b4 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:05.213206 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810f9b6-87e1-4cb9-8beb-8d3c8a24e6b4 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:05.216503 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 432/856] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:45:05.223650 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff8f38-3d94-4ba4-b475-a1cac2b1a987 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:05.223945 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff8f38-3d94-4ba4-b475-a1cac2b1a987 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:05.224218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff8f38-3d94-4ba4-b475-a1cac2b1a987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:05.243321 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-3cff8f38-3d94-4ba4-b475-a1cac2b1a987 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:05.244988 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-3cff8f38-3d94-4ba4-b475-a1cac2b1a987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:05.263532 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 425/857] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:05 2022] POST /identity/v3/auth/tokens => generated 2291 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:05.287304 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810f9b6-87e1-4cb9-8beb-8d3c8a24e6b4 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:05.300787 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810f9b6-87e1-4cb9-8beb-8d3c8a24e6b4 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:05.305972 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a2f03-295b-4e77-a625-5cabb2530bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:05.306847 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a2f03-295b-4e77-a625-5cabb2530bde admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:05.307130 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a2f03-295b-4e77-a625-5cabb2530bde admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:05.307407 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a2f03-295b-4e77-a625-5cabb2530bde admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:05.308075 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a2f03-295b-4e77-a625-5cabb2530bde admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:05.309819 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a2f03-295b-4e77-a625-5cabb2530bde admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:05.321798 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-445a2f03-295b-4e77-a625-5cabb2530bde admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 28 01:45:05.323373 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 433/858] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:45:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:05.330250 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff8f38-3d94-4ba4-b475-a1cac2b1a987 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:05.340437 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff8f38-3d94-4ba4-b475-a1cac2b1a987 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:05.345442 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7747c2-3146-4056-9a58-094281cdded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:05.346122 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7747c2-3146-4056-9a58-094281cdded3 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:05.346405 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7747c2-3146-4056-9a58-094281cdded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:05.346683 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7747c2-3146-4056-9a58-094281cdded3 admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:05.347461 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7747c2-3146-4056-9a58-094281cdded3 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:05.347770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7747c2-3146-4056-9a58-094281cdded3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:05.349398 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7747c2-3146-4056-9a58-094281cdded3 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:05.355819 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 426/859] 10.222.0.96 () {56 vars in 1133 bytes} [Fri Jan 28 01:45:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:05.362122 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a2f03-295b-4e77-a625-5cabb2530bde admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:05.373341 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a2f03-295b-4e77-a625-5cabb2530bde admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:05.377986 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9549ed8-8ab0-4234-9e20-ecb828b8236c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:05.378644 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9549ed8-8ab0-4234-9e20-ecb828b8236c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:05.378924 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9549ed8-8ab0-4234-9e20-ecb828b8236c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:05.379205 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9549ed8-8ab0-4234-9e20-ecb828b8236c admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:05.379903 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9549ed8-8ab0-4234-9e20-ecb828b8236c admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:05.380543 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9549ed8-8ab0-4234-9e20-ecb828b8236c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:05.382204 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9549ed8-8ab0-4234-9e20-ecb828b8236c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:05.388564 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 434/860] 10.222.0.96 () {56 vars in 1133 bytes} [Fri Jan 28 01:45:05 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:06.799939 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9bd2a-60a1-45f3-be39-1b23ff5d86ba None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:06.800430 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9bd2a-60a1-45f3-be39-1b23ff5d86ba None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:06.800430 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9bd2a-60a1-45f3-be39-1b23ff5d86ba None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:06.802424 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 427/861] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:06.810601 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6865a60-3872-4d95-accf-a59c1527cbbe None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:06.811050 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6865a60-3872-4d95-accf-a59c1527cbbe None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:06.811147 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6865a60-3872-4d95-accf-a59c1527cbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:06.829420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-f6865a60-3872-4d95-accf-a59c1527cbbe None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:06.830607 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-f6865a60-3872-4d95-accf-a59c1527cbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:06.839049 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 435/862] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:06 2022] POST /identity/v3/auth/tokens => generated 2291 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:45:06.862276 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9bd2a-60a1-45f3-be39-1b23ff5d86ba None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:06.875438 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9bd2a-60a1-45f3-be39-1b23ff5d86ba None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:06.879854 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e0a38-e994-4e86-9677-7ab61e1e5c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:06.880636 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e0a38-e994-4e86-9677-7ab61e1e5c06 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:06.880946 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e0a38-e994-4e86-9677-7ab61e1e5c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:06.881219 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e0a38-e994-4e86-9677-7ab61e1e5c06 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:06.881864 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e0a38-e994-4e86-9677-7ab61e1e5c06 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:06.883743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e0a38-e994-4e86-9677-7ab61e1e5c06 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:06.894477 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-676e0a38-e994-4e86-9677-7ab61e1e5c06 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 28 01:45:06.895944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 428/863] 10.222.0.96 () {56 vars in 1126 bytes} [Fri Jan 28 01:45:06 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:06.903691 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6865a60-3872-4d95-accf-a59c1527cbbe None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:06.913292 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6865a60-3872-4d95-accf-a59c1527cbbe None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:06.919029 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d2a12-616c-4adc-8604-fbddcef2b2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:06.919716 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d2a12-616c-4adc-8604-fbddcef2b2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:06.919996 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d2a12-616c-4adc-8604-fbddcef2b2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:06.920270 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d2a12-616c-4adc-8604-fbddcef2b2c4 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:06.921020 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d2a12-616c-4adc-8604-fbddcef2b2c4 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:06.921325 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d2a12-616c-4adc-8604-fbddcef2b2c4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:06.922953 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d2a12-616c-4adc-8604-fbddcef2b2c4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:06.928942 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 436/864] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:06.935596 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e0a38-e994-4e86-9677-7ab61e1e5c06 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:06.945668 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e0a38-e994-4e86-9677-7ab61e1e5c06 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:06.951492 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd144b-f75e-46e4-867d-2b3a47a41eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:06.952149 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd144b-f75e-46e4-867d-2b3a47a41eab admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:06.952431 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd144b-f75e-46e4-867d-2b3a47a41eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:06.952703 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd144b-f75e-46e4-867d-2b3a47a41eab admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:06.953508 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd144b-f75e-46e4-867d-2b3a47a41eab admin admin] RBAC: Adding query filter params (type=image) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:06.953809 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd144b-f75e-46e4-867d-2b3a47a41eab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:06.955382 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd144b-f75e-46e4-867d-2b3a47a41eab admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:06.960545 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 429/865] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:07.012191 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11071061-c8cf-42f0-9a90-86d80eb48245 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:07.012548 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11071061-c8cf-42f0-9a90-86d80eb48245 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:07.012747 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11071061-c8cf-42f0-9a90-86d80eb48245 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:07.015025 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 437/866] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:07.024180 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a0229-80a5-4338-ba76-e6a85dd3f12a None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:07.024778 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a0229-80a5-4338-ba76-e6a85dd3f12a None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:07.025237 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a0229-80a5-4338-ba76-e6a85dd3f12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:07.045464 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-3d9a0229-80a5-4338-ba76-e6a85dd3f12a None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:07.046970 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-3d9a0229-80a5-4338-ba76-e6a85dd3f12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:07.056230 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 430/867] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:07 2022] POST /identity/v3/auth/tokens => generated 2291 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:07.080955 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11071061-c8cf-42f0-9a90-86d80eb48245 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:07.094788 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11071061-c8cf-42f0-9a90-86d80eb48245 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:07.099748 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6ce90-8411-4579-bac2-2d31c122e0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:07.100742 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6ce90-8411-4579-bac2-2d31c122e0bf admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:07.101256 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6ce90-8411-4579-bac2-2d31c122e0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:07.101606 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6ce90-8411-4579-bac2-2d31c122e0bf admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:07.102375 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6ce90-8411-4579-bac2-2d31c122e0bf admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:07.104136 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6ce90-8411-4579-bac2-2d31c122e0bf admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:07.116333 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-a2f6ce90-8411-4579-bac2-2d31c122e0bf admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:45:07.118215 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 438/868] 10.222.0.96 () {56 vars in 1147 bytes} [Fri Jan 28 01:45:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:07.125213 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a0229-80a5-4338-ba76-e6a85dd3f12a None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:07.136048 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a0229-80a5-4338-ba76-e6a85dd3f12a None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:07.141579 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b7753-6a7d-4fff-99a3-9b49e08a9f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:07.141959 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b7753-6a7d-4fff-99a3-9b49e08a9f9a admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:07.142299 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b7753-6a7d-4fff-99a3-9b49e08a9f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:07.142574 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b7753-6a7d-4fff-99a3-9b49e08a9f9a admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:07.143311 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b7753-6a7d-4fff-99a3-9b49e08a9f9a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:07.143619 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b7753-6a7d-4fff-99a3-9b49e08a9f9a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:07.145859 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b7753-6a7d-4fff-99a3-9b49e08a9f9a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:07.154852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 431/869] 10.222.0.96 () {56 vars in 1143 bytes} [Fri Jan 28 01:45:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:07.161574 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6ce90-8411-4579-bac2-2d31c122e0bf admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:07.173085 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6ce90-8411-4579-bac2-2d31c122e0bf admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:07.177751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031b91d-2a34-40e7-92aa-0f1228b42ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:07.178403 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031b91d-2a34-40e7-92aa-0f1228b42ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:07.178678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031b91d-2a34-40e7-92aa-0f1228b42ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:07.178949 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031b91d-2a34-40e7-92aa-0f1228b42ce6 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:07.179681 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031b91d-2a34-40e7-92aa-0f1228b42ce6 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:07.179987 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031b91d-2a34-40e7-92aa-0f1228b42ce6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:07.181780 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031b91d-2a34-40e7-92aa-0f1228b42ce6 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:07.187333 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 439/870] 10.222.0.96 () {56 vars in 1143 bytes} [Fri Jan 28 01:45:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:07.193804 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b7753-6a7d-4fff-99a3-9b49e08a9f9a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:07.205375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b7753-6a7d-4fff-99a3-9b49e08a9f9a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:07.209989 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a785331-b796-4907-95b3-79ea904b6f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:07.210749 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a785331-b796-4907-95b3-79ea904b6f17 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:07.211617 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a785331-b796-4907-95b3-79ea904b6f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:07.211896 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a785331-b796-4907-95b3-79ea904b6f17 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:07.212725 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a785331-b796-4907-95b3-79ea904b6f17 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:07.214333 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a785331-b796-4907-95b3-79ea904b6f17 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:07.235232 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 432/871] 10.222.0.96 () {60 vars in 1165 bytes} [Fri Jan 28 01:45:07 2022] POST /identity/v3/endpoints => generated 349 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:45:07.445868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619df92-23fd-478c-baf3-2240da66d173 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:07.446215 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619df92-23fd-478c-baf3-2240da66d173 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:07.446409 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619df92-23fd-478c-baf3-2240da66d173 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:07.448449 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 440/872] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:07.456108 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c1100-4cdd-4d1c-8c5a-aec268798187 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:07.456517 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c1100-4cdd-4d1c-8c5a-aec268798187 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:07.456928 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c1100-4cdd-4d1c-8c5a-aec268798187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:07.475677 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-fb8c1100-4cdd-4d1c-8c5a-aec268798187 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:07.476935 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-fb8c1100-4cdd-4d1c-8c5a-aec268798187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:07.500983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 433/873] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:07 2022] POST /identity/v3/auth/tokens => generated 2480 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:07.521629 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619df92-23fd-478c-baf3-2240da66d173 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:07.534432 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619df92-23fd-478c-baf3-2240da66d173 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:07.538943 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a514bf-ec5c-4b5c-bdbc-a1b8000a6b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:07.539680 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a514bf-ec5c-4b5c-bdbc-a1b8000a6b5f admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:07.539956 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a514bf-ec5c-4b5c-bdbc-a1b8000a6b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:07.540221 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a514bf-ec5c-4b5c-bdbc-a1b8000a6b5f admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:07.540957 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a514bf-ec5c-4b5c-bdbc-a1b8000a6b5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:07.542792 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a514bf-ec5c-4b5c-bdbc-a1b8000a6b5f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:07.544137 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.common [None req-49a514bf-ec5c-4b5c-bdbc-a1b8000a6b5f admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 28 01:45:07.567541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.sql.core [None req-49a514bf-ec5c-4b5c-bdbc-a1b8000a6b5f admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jan 28 01:45:07.567541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jan 28 01:45:07.567541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [parameters: {'id': 'af3bb2ab646540e7a1b34e3efeb57537', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jan 28 01:45:07.567541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79482) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 28 01:45:07.584268 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-49a514bf-ec5c-4b5c-bdbc-a1b8000a6b5f admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id af3bb2ab646540e7a1b34e3efeb57537.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id af3bb2ab646540e7a1b34e3efeb57537. Jan 28 01:45:07.590455 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 441/874] 10.222.0.96 () {60 vars in 1161 bytes} [Fri Jan 28 01:45:07 2022] POST /identity/v3/projects => generated 262 bytes in 65 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:07.593925 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c1100-4cdd-4d1c-8c5a-aec268798187 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:07.604164 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c1100-4cdd-4d1c-8c5a-aec268798187 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:07.608828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5c8a1-ddc5-4fc9-877e-e9bb0705c02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:07.609626 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5c8a1-ddc5-4fc9-877e-e9bb0705c02f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:07.609901 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5c8a1-ddc5-4fc9-877e-e9bb0705c02f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:07.610167 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5c8a1-ddc5-4fc9-877e-e9bb0705c02f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:07.617702 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5c8a1-ddc5-4fc9-877e-e9bb0705c02f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:07.619752 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5c8a1-ddc5-4fc9-877e-e9bb0705c02f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:07.633084 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-58a5c8a1-ddc5-4fc9-877e-e9bb0705c02f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:45:07.639710 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 434/875] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:45:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:07.641315 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a514bf-ec5c-4b5c-bdbc-a1b8000a6b5f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:07.653360 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a514bf-ec5c-4b5c-bdbc-a1b8000a6b5f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:07.658102 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4ad5d-111b-4ce2-878f-ccb26bf74d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:07.658746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4ad5d-111b-4ce2-878f-ccb26bf74d58 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:07.659076 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4ad5d-111b-4ce2-878f-ccb26bf74d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:07.659396 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4ad5d-111b-4ce2-878f-ccb26bf74d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:07.660139 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4ad5d-111b-4ce2-878f-ccb26bf74d58 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:07.660436 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4ad5d-111b-4ce2-878f-ccb26bf74d58 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:07.662558 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4ad5d-111b-4ce2-878f-ccb26bf74d58 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:07.675678 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca471205-8028-4dc9-bef2-293daaff2527 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:07.675678 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca471205-8028-4dc9-bef2-293daaff2527 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:07.675678 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca471205-8028-4dc9-bef2-293daaff2527 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:07.675678 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 435/876] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:07.679413 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81885e8a-37dc-4424-9219-3f74a4233a24 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:07.679703 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81885e8a-37dc-4424-9219-3f74a4233a24 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:07.680034 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81885e8a-37dc-4424-9219-3f74a4233a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:07.688061 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 442/877] 10.222.0.96 () {56 vars in 1133 bytes} [Fri Jan 28 01:45:07 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:07.698592 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-81885e8a-37dc-4424-9219-3f74a4233a24 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:07.699725 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-81885e8a-37dc-4424-9219-3f74a4233a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:07.708169 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 436/878] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:07 2022] POST /identity/v3/auth/tokens => generated 2480 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:45:07.733313 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4ad5d-111b-4ce2-878f-ccb26bf74d58 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:07.744109 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4ad5d-111b-4ce2-878f-ccb26bf74d58 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:07.749656 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf1c52-b30b-4476-898f-dc893ab7ca9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:07.750725 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf1c52-b30b-4476-898f-dc893ab7ca9a admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:07.751234 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf1c52-b30b-4476-898f-dc893ab7ca9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:07.751722 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf1c52-b30b-4476-898f-dc893ab7ca9a admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:07.752699 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf1c52-b30b-4476-898f-dc893ab7ca9a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:07.754636 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf1c52-b30b-4476-898f-dc893ab7ca9a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:07.774512 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 443/879] 10.222.0.96 () {60 vars in 1162 bytes} [Fri Jan 28 01:45:07 2022] POST /identity/v3/services => generated 242 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:45:09.288049 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82024a-14da-4a32-97f7-065fb70225ea None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:09.288590 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82024a-14da-4a32-97f7-065fb70225ea None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:09.288590 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82024a-14da-4a32-97f7-065fb70225ea None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:09.291209 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 437/880] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:09.298963 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da8b20-891a-4acf-a97c-5d49821486e0 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:09.299414 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da8b20-891a-4acf-a97c-5d49821486e0 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:09.299489 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da8b20-891a-4acf-a97c-5d49821486e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:09.318784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-19da8b20-891a-4acf-a97c-5d49821486e0 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:09.320414 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-19da8b20-891a-4acf-a97c-5d49821486e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:09.344907 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 444/881] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:09 2022] POST /identity/v3/auth/tokens => generated 2576 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:45:09.362509 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82024a-14da-4a32-97f7-065fb70225ea None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:09.375552 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82024a-14da-4a32-97f7-065fb70225ea None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:09.379942 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c624a-9f5a-4116-bfed-da86db6fb75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:09.380588 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c624a-9f5a-4116-bfed-da86db6fb75c admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:09.380985 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c624a-9f5a-4116-bfed-da86db6fb75c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:09.381167 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c624a-9f5a-4116-bfed-da86db6fb75c admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:09.381881 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c624a-9f5a-4116-bfed-da86db6fb75c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:09.384225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c624a-9f5a-4116-bfed-da86db6fb75c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:09.408990 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 438/882] 10.222.0.96 () {60 vars in 1162 bytes} [Fri Jan 28 01:45:09 2022] POST /identity/v3/services => generated 242 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:45:09.524403 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcc2a0-759d-4355-8c19-8233c5d73c10 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:09.524668 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcc2a0-759d-4355-8c19-8233c5d73c10 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:09.525225 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcc2a0-759d-4355-8c19-8233c5d73c10 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:09.527756 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 445/883] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:09.542219 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c975fd6-f303-4649-add4-bf22ac423f09 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:09.542520 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c975fd6-f303-4649-add4-bf22ac423f09 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:09.542673 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c975fd6-f303-4649-add4-bf22ac423f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:09.563678 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-0c975fd6-f303-4649-add4-bf22ac423f09 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:09.564916 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-0c975fd6-f303-4649-add4-bf22ac423f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:09.583518 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 439/884] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:09 2022] POST /identity/v3/auth/tokens => generated 2672 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:09.607893 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcc2a0-759d-4355-8c19-8233c5d73c10 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:09.621156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcc2a0-759d-4355-8c19-8233c5d73c10 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:09.625625 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82304e3f-84a6-4d90-8302-4bd9c0bd8d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:09.626425 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82304e3f-84a6-4d90-8302-4bd9c0bd8d01 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:09.626703 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82304e3f-84a6-4d90-8302-4bd9c0bd8d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:09.626964 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82304e3f-84a6-4d90-8302-4bd9c0bd8d01 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:09.627608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82304e3f-84a6-4d90-8302-4bd9c0bd8d01 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:09.629236 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82304e3f-84a6-4d90-8302-4bd9c0bd8d01 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:09.641475 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-82304e3f-84a6-4d90-8302-4bd9c0bd8d01 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:45:09.643014 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 446/885] 10.222.0.96 () {56 vars in 1147 bytes} [Fri Jan 28 01:45:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:09.649962 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c975fd6-f303-4649-add4-bf22ac423f09 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:09.659265 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c975fd6-f303-4649-add4-bf22ac423f09 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:09.664034 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab7b61-709f-4f9c-9573-3e72e26f57a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:09.664740 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab7b61-709f-4f9c-9573-3e72e26f57a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:09.665238 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab7b61-709f-4f9c-9573-3e72e26f57a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:09.665511 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab7b61-709f-4f9c-9573-3e72e26f57a4 admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:09.666210 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab7b61-709f-4f9c-9573-3e72e26f57a4 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:09.666506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab7b61-709f-4f9c-9573-3e72e26f57a4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:09.668076 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab7b61-709f-4f9c-9573-3e72e26f57a4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:09.673657 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 440/886] 10.222.0.96 () {56 vars in 1143 bytes} [Fri Jan 28 01:45:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:45:09.681140 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82304e3f-84a6-4d90-8302-4bd9c0bd8d01 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:09.690821 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82304e3f-84a6-4d90-8302-4bd9c0bd8d01 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:09.695957 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c60e7-b38a-4192-965c-f5f782aee366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:09.696615 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c60e7-b38a-4192-965c-f5f782aee366 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:09.696890 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c60e7-b38a-4192-965c-f5f782aee366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:09.697163 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c60e7-b38a-4192-965c-f5f782aee366 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:09.697855 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c60e7-b38a-4192-965c-f5f782aee366 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:09.698151 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c60e7-b38a-4192-965c-f5f782aee366 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:09.699735 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c60e7-b38a-4192-965c-f5f782aee366 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:09.705551 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 447/887] 10.222.0.96 () {56 vars in 1143 bytes} [Fri Jan 28 01:45:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:09.712698 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab7b61-709f-4f9c-9573-3e72e26f57a4 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:09.722484 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab7b61-709f-4f9c-9573-3e72e26f57a4 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:09.727672 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445337c4-fd41-4a51-8632-bc28de92a5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:09.728328 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445337c4-fd41-4a51-8632-bc28de92a5ba admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:09.728602 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445337c4-fd41-4a51-8632-bc28de92a5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:09.728911 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445337c4-fd41-4a51-8632-bc28de92a5ba admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:09.729691 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445337c4-fd41-4a51-8632-bc28de92a5ba admin admin] RBAC: Adding query filter params (interface=admin, service_id=698458cbad8141f6a9df153504ecd5fe, region_id=RegionOne) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:09.729997 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445337c4-fd41-4a51-8632-bc28de92a5ba admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:09.731561 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445337c4-fd41-4a51-8632-bc28de92a5ba admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:09.737401 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 441/888] 10.222.0.96 () {56 vars in 1270 bytes} [Fri Jan 28 01:45:09 2022] GET /identity/v3/endpoints?service_id=698458cbad8141f6a9df153504ecd5fe&interface=admin®ion_id=RegionOne => generated 193 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:09.743843 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c60e7-b38a-4192-965c-f5f782aee366 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:09.753628 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c60e7-b38a-4192-965c-f5f782aee366 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:09.758447 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371ef0f-0cc5-4360-8b32-f4212f7bf07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:09.759180 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371ef0f-0cc5-4360-8b32-f4212f7bf07b admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:09.759466 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371ef0f-0cc5-4360-8b32-f4212f7bf07b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:09.759736 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371ef0f-0cc5-4360-8b32-f4212f7bf07b admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:09.760400 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371ef0f-0cc5-4360-8b32-f4212f7bf07b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:09.762082 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371ef0f-0cc5-4360-8b32-f4212f7bf07b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:09.769508 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 448/889] 10.222.0.96 () {56 vars in 1108 bytes} [Fri Jan 28 01:45:09 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:45:10.043861 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de78bb-5d5a-4dab-ba88-76eea361cf1a None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:10.044252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de78bb-5d5a-4dab-ba88-76eea361cf1a None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:10.044432 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de78bb-5d5a-4dab-ba88-76eea361cf1a None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:10.046454 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 442/890] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:10.054000 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacbf97-48b9-4579-ba15-074722120634 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:10.054628 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacbf97-48b9-4579-ba15-074722120634 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:10.055148 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacbf97-48b9-4579-ba15-074722120634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:10.073623 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-4bacbf97-48b9-4579-ba15-074722120634 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:10.075107 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-4bacbf97-48b9-4579-ba15-074722120634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:10.088824 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 449/891] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:10 2022] POST /identity/v3/auth/tokens => generated 2672 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:10.093076 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88a273-68f8-47e6-9b31-bf029a0a8c88 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:10.093574 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88a273-68f8-47e6-9b31-bf029a0a8c88 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:10.094062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88a273-68f8-47e6-9b31-bf029a0a8c88 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:10.096274 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 443/892] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:10.103321 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd14c2-27ce-49d9-b3b6-2803756f9e24 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:10.103613 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd14c2-27ce-49d9-b3b6-2803756f9e24 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:10.103890 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd14c2-27ce-49d9-b3b6-2803756f9e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:10.112558 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88a273-68f8-47e6-9b31-bf029a0a8c88 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:10.122897 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-32dd14c2-27ce-49d9-b3b6-2803756f9e24 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:10.124078 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-32dd14c2-27ce-49d9-b3b6-2803756f9e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:10.124763 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88a273-68f8-47e6-9b31-bf029a0a8c88 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:10.129314 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfadc41-5e0e-4a01-a7cf-926facb64e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:10.130022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfadc41-5e0e-4a01-a7cf-926facb64e02 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:10.130297 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfadc41-5e0e-4a01-a7cf-926facb64e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:10.130618 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfadc41-5e0e-4a01-a7cf-926facb64e02 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:10.131306 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfadc41-5e0e-4a01-a7cf-926facb64e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:10.133038 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 450/893] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:10 2022] POST /identity/v3/auth/tokens => generated 2672 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:10.134010 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfadc41-5e0e-4a01-a7cf-926facb64e02 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:10.135342 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.common [None req-2cfadc41-5e0e-4a01-a7cf-926facb64e02 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 28 01:45:10.149876 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.sql.core [None req-2cfadc41-5e0e-4a01-a7cf-926facb64e02 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jan 28 01:45:10.149876 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jan 28 01:45:10.149876 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [parameters: {'user_id': 'cdb85273107d49d88123220fe58af40d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jan 28 01:45:10.149876 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79481) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 28 01:45:10.156117 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-2cfadc41-5e0e-4a01-a7cf-926facb64e02 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jan 28 01:45:10.157767 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd14c2-27ce-49d9-b3b6-2803756f9e24 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:10.162025 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 444/894] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:45:10 2022] POST /identity/v3/users => generated 160 bytes in 46 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:45:10.164556 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfadc41-5e0e-4a01-a7cf-926facb64e02 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:10.167666 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd14c2-27ce-49d9-b3b6-2803756f9e24 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:10.172737 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c14f16-d1f4-4437-b1aa-898aff821c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:10.173603 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c14f16-d1f4-4437-b1aa-898aff821c1a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:10.173881 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c14f16-d1f4-4437-b1aa-898aff821c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:10.174152 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c14f16-d1f4-4437-b1aa-898aff821c1a admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:10.174881 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c14f16-d1f4-4437-b1aa-898aff821c1a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:10.175932 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfadc41-5e0e-4a01-a7cf-926facb64e02 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:10.176616 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c14f16-d1f4-4437-b1aa-898aff821c1a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:10.182042 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8ac8c-0064-490c-9d22-34c719bdfc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:10.182821 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8ac8c-0064-490c-9d22-34c719bdfc34 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:10.183095 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8ac8c-0064-490c-9d22-34c719bdfc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:10.183366 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8ac8c-0064-490c-9d22-34c719bdfc34 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:10.188825 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-54c14f16-d1f4-4437-b1aa-898aff821c1a admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 28 01:45:10.190347 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 451/895] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:45:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:45:10.191296 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8ac8c-0064-490c-9d22-34c719bdfc34 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:10.193635 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8ac8c-0064-490c-9d22-34c719bdfc34 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:10.197563 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c14f16-d1f4-4437-b1aa-898aff821c1a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:10.207395 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c14f16-d1f4-4437-b1aa-898aff821c1a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:10.209882 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-6ad8ac8c-0064-490c-9d22-34c719bdfc34 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 28 01:45:10.216871 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 445/896] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:45:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:45:10.217460 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10e126-cd70-451b-98a1-fdd7cc741627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:10.218111 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10e126-cd70-451b-98a1-fdd7cc741627 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:10.219181 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8ac8c-0064-490c-9d22-34c719bdfc34 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:10.219638 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10e126-cd70-451b-98a1-fdd7cc741627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:10.219913 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10e126-cd70-451b-98a1-fdd7cc741627 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:10.220616 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10e126-cd70-451b-98a1-fdd7cc741627 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:10.220941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10e126-cd70-451b-98a1-fdd7cc741627 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:10.222669 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10e126-cd70-451b-98a1-fdd7cc741627 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:10.229261 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 452/897] 10.222.0.96 () {56 vars in 1133 bytes} [Fri Jan 28 01:45:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:45:10.233912 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8ac8c-0064-490c-9d22-34c719bdfc34 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:10.235626 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10e126-cd70-451b-98a1-fdd7cc741627 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:10.239726 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fbf0c-f10d-4a38-8326-195b2bf0a6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:10.241254 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fbf0c-f10d-4a38-8326-195b2bf0a6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:10.241787 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fbf0c-f10d-4a38-8326-195b2bf0a6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:10.242943 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fbf0c-f10d-4a38-8326-195b2bf0a6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:10.244382 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fbf0c-f10d-4a38-8326-195b2bf0a6e2 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:10.245018 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fbf0c-f10d-4a38-8326-195b2bf0a6e2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:10.246847 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10e126-cd70-451b-98a1-fdd7cc741627 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:10.247591 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fbf0c-f10d-4a38-8326-195b2bf0a6e2 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:10.251940 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0bf03-d1f3-4ed1-85f9-23cc4a034a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:10.252725 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0bf03-d1f3-4ed1-85f9-23cc4a034a30 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:10.253205 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0bf03-d1f3-4ed1-85f9-23cc4a034a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:10.253569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0bf03-d1f3-4ed1-85f9-23cc4a034a30 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:10.254407 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0bf03-d1f3-4ed1-85f9-23cc4a034a30 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:10.254803 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0bf03-d1f3-4ed1-85f9-23cc4a034a30 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:10.256608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0bf03-d1f3-4ed1-85f9-23cc4a034a30 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:10.268102 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 453/898] 10.222.0.96 () {56 vars in 1133 bytes} [Fri Jan 28 01:45:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:45:10.269188 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0bf03-d1f3-4ed1-85f9-23cc4a034a30 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:10.279743 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0bf03-d1f3-4ed1-85f9-23cc4a034a30 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:10.284394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7acd3-325b-463d-b232-eb3f685d7fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:10.285222 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7acd3-325b-463d-b232-eb3f685d7fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:10.285595 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7acd3-325b-463d-b232-eb3f685d7fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:10.285987 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7acd3-325b-463d-b232-eb3f685d7fa6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:10.286899 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7acd3-325b-463d-b232-eb3f685d7fa6 admin admin] RBAC: Adding query filter params (interface=public, service_id=2bdccd04a52249a28cf2a93e164b9160, region_id=RegionOne) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:10.287298 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7acd3-325b-463d-b232-eb3f685d7fa6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:10.290378 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7acd3-325b-463d-b232-eb3f685d7fa6 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:10.295952 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 454/899] 10.222.0.96 () {56 vars in 1272 bytes} [Fri Jan 28 01:45:10 2022] GET /identity/v3/endpoints?service_id=2bdccd04a52249a28cf2a93e164b9160&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:45:10.304941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7acd3-325b-463d-b232-eb3f685d7fa6 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:10.305661 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 446/900] 10.222.0.96 () {56 vars in 1122 bytes} [Fri Jan 28 01:45:10 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:10.313690 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7acd3-325b-463d-b232-eb3f685d7fa6 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:10.318912 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff481c-106e-477f-a58b-ea73f4446bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:10.319775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff481c-106e-477f-a58b-ea73f4446bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:10.320718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff481c-106e-477f-a58b-ea73f4446bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:10.321182 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff481c-106e-477f-a58b-ea73f4446bd3 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:10.321988 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff481c-106e-477f-a58b-ea73f4446bd3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:10.323811 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff481c-106e-477f-a58b-ea73f4446bd3 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:10.333734 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 455/901] 10.222.0.96 () {56 vars in 1108 bytes} [Fri Jan 28 01:45:10 2022] GET /identity/v3/services => generated 1957 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:45:11.718516 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6aa23-3025-4c13-844b-d7265adeb8da None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:11.719042 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6aa23-3025-4c13-844b-d7265adeb8da None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:11.719042 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6aa23-3025-4c13-844b-d7265adeb8da None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:11.720846 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 447/902] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:11.729368 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cad8b8-bf28-4a5b-8da7-278c38598cad None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:11.729941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cad8b8-bf28-4a5b-8da7-278c38598cad None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:11.730077 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cad8b8-bf28-4a5b-8da7-278c38598cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:11.748423 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-02cad8b8-bf28-4a5b-8da7-278c38598cad None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:11.749633 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-02cad8b8-bf28-4a5b-8da7-278c38598cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:11.757365 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 456/903] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:11 2022] POST /identity/v3/auth/tokens => generated 2672 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:45:11.781350 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6aa23-3025-4c13-844b-d7265adeb8da None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:11.794199 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6aa23-3025-4c13-844b-d7265adeb8da None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:11.798594 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d4efa-de55-404d-a955-6058396527a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:11.799372 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4efa-de55-404d-a955-6058396527a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:11.799654 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4efa-de55-404d-a955-6058396527a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:11.799977 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4efa-de55-404d-a955-6058396527a3 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:11.800571 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d4efa-de55-404d-a955-6058396527a3 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:11.802197 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d4efa-de55-404d-a955-6058396527a3 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:11.813456 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-bb6d4efa-de55-404d-a955-6058396527a3 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 28 01:45:11.814883 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 448/904] 10.222.0.96 () {56 vars in 1126 bytes} [Fri Jan 28 01:45:11 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:11.821341 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cad8b8-bf28-4a5b-8da7-278c38598cad None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:11.830468 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cad8b8-bf28-4a5b-8da7-278c38598cad None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:11.835040 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16782687-489c-4314-b635-fe0a128284f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:11.836485 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16782687-489c-4314-b635-fe0a128284f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:11.836763 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16782687-489c-4314-b635-fe0a128284f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:11.837072 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16782687-489c-4314-b635-fe0a128284f8 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:11.837780 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16782687-489c-4314-b635-fe0a128284f8 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:11.838085 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16782687-489c-4314-b635-fe0a128284f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:11.839681 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16782687-489c-4314-b635-fe0a128284f8 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:11.845198 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 457/905] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:11.851181 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d4efa-de55-404d-a955-6058396527a3 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:11.861606 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d4efa-de55-404d-a955-6058396527a3 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:11.866182 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330dd548-7bca-4140-a1d8-d5f4bcddfcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:11.866865 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330dd548-7bca-4140-a1d8-d5f4bcddfcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:11.867151 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330dd548-7bca-4140-a1d8-d5f4bcddfcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:11.867428 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330dd548-7bca-4140-a1d8-d5f4bcddfcf7 admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:11.868127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330dd548-7bca-4140-a1d8-d5f4bcddfcf7 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:11.868431 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330dd548-7bca-4140-a1d8-d5f4bcddfcf7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:11.870039 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330dd548-7bca-4140-a1d8-d5f4bcddfcf7 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:11.875317 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 449/906] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:11.881551 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16782687-489c-4314-b635-fe0a128284f8 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:11.891295 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16782687-489c-4314-b635-fe0a128284f8 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:11.895928 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3694f3-3c95-4b32-93b0-72b252e7cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:11.896575 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3694f3-3c95-4b32-93b0-72b252e7cb4a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:11.896895 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3694f3-3c95-4b32-93b0-72b252e7cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:11.897173 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3694f3-3c95-4b32-93b0-72b252e7cb4a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:11.897957 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3694f3-3c95-4b32-93b0-72b252e7cb4a admin admin] RBAC: Adding query filter params (interface=public, service_id=cb8b3b380d814d1b8ed514247dc9e330, region_id=RegionOne) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:11.898874 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3694f3-3c95-4b32-93b0-72b252e7cb4a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:11.900628 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3694f3-3c95-4b32-93b0-72b252e7cb4a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:11.911365 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 458/907] 10.222.0.96 () {56 vars in 1272 bytes} [Fri Jan 28 01:45:11 2022] GET /identity/v3/endpoints?service_id=cb8b3b380d814d1b8ed514247dc9e330&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:45:11.912958 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330dd548-7bca-4140-a1d8-d5f4bcddfcf7 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:11.923625 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330dd548-7bca-4140-a1d8-d5f4bcddfcf7 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:11.928305 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef9549-f49b-43ed-bba9-cf9185b7f3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:11.929008 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef9549-f49b-43ed-bba9-cf9185b7f3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:11.929286 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef9549-f49b-43ed-bba9-cf9185b7f3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:11.929582 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef9549-f49b-43ed-bba9-cf9185b7f3e0 admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:11.930249 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef9549-f49b-43ed-bba9-cf9185b7f3e0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:11.931813 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef9549-f49b-43ed-bba9-cf9185b7f3e0 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:11.944899 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 450/908] 10.222.0.96 () {56 vars in 1108 bytes} [Fri Jan 28 01:45:11 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:45:12.065223 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddd2a3-cf2a-44e9-8df7-2c53f4309b0e None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:12.065402 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddd2a3-cf2a-44e9-8df7-2c53f4309b0e None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:12.065686 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddd2a3-cf2a-44e9-8df7-2c53f4309b0e None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:12.067712 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 459/909] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:12.076192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904da8da-0b62-4e2b-aea6-b3bb5307c1fa None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:12.076518 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904da8da-0b62-4e2b-aea6-b3bb5307c1fa None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:12.076735 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904da8da-0b62-4e2b-aea6-b3bb5307c1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:12.096783 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-904da8da-0b62-4e2b-aea6-b3bb5307c1fa None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:12.098375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-904da8da-0b62-4e2b-aea6-b3bb5307c1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:12.106525 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 451/910] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:12 2022] POST /identity/v3/auth/tokens => generated 2672 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:12.129945 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddd2a3-cf2a-44e9-8df7-2c53f4309b0e None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:12.143255 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddd2a3-cf2a-44e9-8df7-2c53f4309b0e None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:12.149945 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066ce43-4646-4874-96a8-61ef2094a406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:12.150746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066ce43-4646-4874-96a8-61ef2094a406 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:12.151020 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066ce43-4646-4874-96a8-61ef2094a406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:12.151283 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066ce43-4646-4874-96a8-61ef2094a406 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:12.151928 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066ce43-4646-4874-96a8-61ef2094a406 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:12.153805 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066ce43-4646-4874-96a8-61ef2094a406 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:12.165390 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-8066ce43-4646-4874-96a8-61ef2094a406 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:45:12.166730 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 460/911] 10.222.0.96 () {56 vars in 1147 bytes} [Fri Jan 28 01:45:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:12.173299 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904da8da-0b62-4e2b-aea6-b3bb5307c1fa None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:12.182747 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904da8da-0b62-4e2b-aea6-b3bb5307c1fa None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:12.187195 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cc7df-62d0-4b8e-8a32-eb1a7c243c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:12.187841 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cc7df-62d0-4b8e-8a32-eb1a7c243c4b admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:12.188118 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cc7df-62d0-4b8e-8a32-eb1a7c243c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:12.188387 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cc7df-62d0-4b8e-8a32-eb1a7c243c4b admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:12.189112 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cc7df-62d0-4b8e-8a32-eb1a7c243c4b admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:12.189415 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cc7df-62d0-4b8e-8a32-eb1a7c243c4b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:12.190972 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cc7df-62d0-4b8e-8a32-eb1a7c243c4b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:12.196966 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 452/912] 10.222.0.96 () {56 vars in 1143 bytes} [Fri Jan 28 01:45:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:45:12.203476 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066ce43-4646-4874-96a8-61ef2094a406 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:12.213953 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066ce43-4646-4874-96a8-61ef2094a406 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:12.218665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9a002-9120-411c-873e-981d7bd3d99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:12.219324 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9a002-9120-411c-873e-981d7bd3d99e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:12.219601 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9a002-9120-411c-873e-981d7bd3d99e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:12.219868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9a002-9120-411c-873e-981d7bd3d99e admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:12.220589 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9a002-9120-411c-873e-981d7bd3d99e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:12.220919 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9a002-9120-411c-873e-981d7bd3d99e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:12.222672 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9a002-9120-411c-873e-981d7bd3d99e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:12.233041 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 461/913] 10.222.0.96 () {56 vars in 1143 bytes} [Fri Jan 28 01:45:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:12.235773 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cc7df-62d0-4b8e-8a32-eb1a7c243c4b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:12.245994 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cc7df-62d0-4b8e-8a32-eb1a7c243c4b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:12.250528 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75a408-06f0-44b4-8b51-eb38db50a00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:12.251172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75a408-06f0-44b4-8b51-eb38db50a00c admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:12.251450 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75a408-06f0-44b4-8b51-eb38db50a00c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:12.251718 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75a408-06f0-44b4-8b51-eb38db50a00c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:12.252456 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75a408-06f0-44b4-8b51-eb38db50a00c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:12.254045 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75a408-06f0-44b4-8b51-eb38db50a00c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:12.276902 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 453/914] 10.222.0.96 () {60 vars in 1165 bytes} [Fri Jan 28 01:45:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:45:12.569159 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb2bd8-5f5e-4797-8712-4ef8c886e931 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:12.569477 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb2bd8-5f5e-4797-8712-4ef8c886e931 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:12.569721 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb2bd8-5f5e-4797-8712-4ef8c886e931 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:12.572253 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 462/915] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:12.579969 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d711f3-1660-4fcf-85b1-dc1bad6b9ec2 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:12.580309 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d711f3-1660-4fcf-85b1-dc1bad6b9ec2 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:12.580567 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d711f3-1660-4fcf-85b1-dc1bad6b9ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:12.600602 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-72d711f3-1660-4fcf-85b1-dc1bad6b9ec2 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:12.601893 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-72d711f3-1660-4fcf-85b1-dc1bad6b9ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:12.620470 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 454/916] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:12 2022] POST /identity/v3/auth/tokens => generated 2821 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:12.660127 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb2bd8-5f5e-4797-8712-4ef8c886e931 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:12.683874 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb2bd8-5f5e-4797-8712-4ef8c886e931 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:12.690839 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81190238-3289-4dbe-999a-e26c2049b1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:12.692166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81190238-3289-4dbe-999a-e26c2049b1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:12.692712 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81190238-3289-4dbe-999a-e26c2049b1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:12.693217 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81190238-3289-4dbe-999a-e26c2049b1a4 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:12.694399 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81190238-3289-4dbe-999a-e26c2049b1a4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:12.698745 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81190238-3289-4dbe-999a-e26c2049b1a4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:12.720534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-81190238-3289-4dbe-999a-e26c2049b1a4 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 28 01:45:12.728834 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 463/917] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:45:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:45:12.730586 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d711f3-1660-4fcf-85b1-dc1bad6b9ec2 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:12.740496 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d711f3-1660-4fcf-85b1-dc1bad6b9ec2 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:12.745813 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08c14f-8c3b-49c1-bf35-632cf5e5891b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:12.746598 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08c14f-8c3b-49c1-bf35-632cf5e5891b admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:12.746947 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08c14f-8c3b-49c1-bf35-632cf5e5891b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:12.747293 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08c14f-8c3b-49c1-bf35-632cf5e5891b admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:12.748071 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08c14f-8c3b-49c1-bf35-632cf5e5891b admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:12.748445 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08c14f-8c3b-49c1-bf35-632cf5e5891b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:12.750217 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08c14f-8c3b-49c1-bf35-632cf5e5891b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:12.756501 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 455/918] 10.222.0.96 () {56 vars in 1133 bytes} [Fri Jan 28 01:45:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:12.762144 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81190238-3289-4dbe-999a-e26c2049b1a4 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:12.773566 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81190238-3289-4dbe-999a-e26c2049b1a4 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:12.778440 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38c6f5-7b09-4800-8e4c-1deb7db91115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:12.779084 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38c6f5-7b09-4800-8e4c-1deb7db91115 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:12.779364 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38c6f5-7b09-4800-8e4c-1deb7db91115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:12.779634 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38c6f5-7b09-4800-8e4c-1deb7db91115 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:12.780325 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38c6f5-7b09-4800-8e4c-1deb7db91115 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:12.780630 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38c6f5-7b09-4800-8e4c-1deb7db91115 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:12.782249 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38c6f5-7b09-4800-8e4c-1deb7db91115 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:12.787482 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 464/919] 10.222.0.96 () {56 vars in 1133 bytes} [Fri Jan 28 01:45:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:45:12.794584 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08c14f-8c3b-49c1-bf35-632cf5e5891b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:12.807777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08c14f-8c3b-49c1-bf35-632cf5e5891b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:12.813428 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e253f5e-8f17-4706-a512-6332488acbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:12.814308 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e253f5e-8f17-4706-a512-6332488acbd9 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:12.814762 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e253f5e-8f17-4706-a512-6332488acbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:12.815198 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e253f5e-8f17-4706-a512-6332488acbd9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:12.816182 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e253f5e-8f17-4706-a512-6332488acbd9 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:12.818079 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e253f5e-8f17-4706-a512-6332488acbd9 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:12.840313 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 456/920] 10.222.0.96 () {60 vars in 1165 bytes} [Fri Jan 28 01:45:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:45:14.280565 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38c8ae-0b74-458a-9db3-7e577673a354 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:14.281162 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38c8ae-0b74-458a-9db3-7e577673a354 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:14.281162 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38c8ae-0b74-458a-9db3-7e577673a354 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:14.282940 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 465/921] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:14.291082 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15378433-bdc7-405a-bce2-51b50d5f30ae None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:14.291546 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15378433-bdc7-405a-bce2-51b50d5f30ae None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:14.291631 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15378433-bdc7-405a-bce2-51b50d5f30ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:14.309930 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-15378433-bdc7-405a-bce2-51b50d5f30ae None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:14.311119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-15378433-bdc7-405a-bce2-51b50d5f30ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:14.329754 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 457/922] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:14 2022] POST /identity/v3/auth/tokens => generated 2977 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:14.355508 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38c8ae-0b74-458a-9db3-7e577673a354 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:14.369065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38c8ae-0b74-458a-9db3-7e577673a354 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:14.373600 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dba125-d433-4dca-a09d-3ad78c9c2396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:14.374381 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dba125-d433-4dca-a09d-3ad78c9c2396 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:14.374657 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dba125-d433-4dca-a09d-3ad78c9c2396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:14.374926 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dba125-d433-4dca-a09d-3ad78c9c2396 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:14.375566 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dba125-d433-4dca-a09d-3ad78c9c2396 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:14.377173 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dba125-d433-4dca-a09d-3ad78c9c2396 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:14.388887 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-35dba125-d433-4dca-a09d-3ad78c9c2396 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 28 01:45:14.390124 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 466/923] 10.222.0.96 () {56 vars in 1126 bytes} [Fri Jan 28 01:45:14 2022] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:14.396746 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15378433-bdc7-405a-bce2-51b50d5f30ae None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:14.406910 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15378433-bdc7-405a-bce2-51b50d5f30ae None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:14.411747 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b16467-120b-49ec-9b27-eb8df756e657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:14.412530 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b16467-120b-49ec-9b27-eb8df756e657 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:14.412927 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b16467-120b-49ec-9b27-eb8df756e657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:14.413277 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b16467-120b-49ec-9b27-eb8df756e657 admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:14.414914 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b16467-120b-49ec-9b27-eb8df756e657 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:14.415310 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b16467-120b-49ec-9b27-eb8df756e657 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:14.417002 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b16467-120b-49ec-9b27-eb8df756e657 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:14.423054 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 458/924] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:14.430528 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dba125-d433-4dca-a09d-3ad78c9c2396 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:14.440947 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dba125-d433-4dca-a09d-3ad78c9c2396 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:14.446627 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f3710-4768-4196-95d1-b761b4febf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:14.447299 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f3710-4768-4196-95d1-b761b4febf58 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:14.447578 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f3710-4768-4196-95d1-b761b4febf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:14.447850 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f3710-4768-4196-95d1-b761b4febf58 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:14.448559 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f3710-4768-4196-95d1-b761b4febf58 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:14.448896 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f3710-4768-4196-95d1-b761b4febf58 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:14.450481 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f3710-4768-4196-95d1-b761b4febf58 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:14.461389 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 467/925] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:45:14.463167 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b16467-120b-49ec-9b27-eb8df756e657 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:14.473556 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b16467-120b-49ec-9b27-eb8df756e657 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:14.478438 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857cf0b-d59a-4477-9657-02c908ef78db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:14.479143 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857cf0b-d59a-4477-9657-02c908ef78db admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:14.479429 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857cf0b-d59a-4477-9657-02c908ef78db admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:14.479702 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857cf0b-d59a-4477-9657-02c908ef78db admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:14.480445 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857cf0b-d59a-4477-9657-02c908ef78db admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:14.482075 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857cf0b-d59a-4477-9657-02c908ef78db admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:14.501131 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 459/926] 10.222.0.96 () {60 vars in 1165 bytes} [Fri Jan 28 01:45:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:45:14.526556 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135614c5-67e2-43b6-84f6-5442f02bbb54 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:14.526913 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135614c5-67e2-43b6-84f6-5442f02bbb54 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:14.527121 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135614c5-67e2-43b6-84f6-5442f02bbb54 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:14.529530 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 468/927] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:14.537613 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3659b1-4721-4d93-b5ae-f75f3b865249 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:14.537870 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3659b1-4721-4d93-b5ae-f75f3b865249 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:14.538098 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3659b1-4721-4d93-b5ae-f75f3b865249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:14.560241 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-dd3659b1-4721-4d93-b5ae-f75f3b865249 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:14.561584 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-dd3659b1-4721-4d93-b5ae-f75f3b865249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:14.581346 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 460/928] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:14 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:14.607178 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135614c5-67e2-43b6-84f6-5442f02bbb54 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:14.621126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135614c5-67e2-43b6-84f6-5442f02bbb54 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:14.625767 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17734f54-48c8-408d-b098-e8bb77b5fe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:14.626626 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17734f54-48c8-408d-b098-e8bb77b5fe4e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:14.626923 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17734f54-48c8-408d-b098-e8bb77b5fe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:14.627199 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17734f54-48c8-408d-b098-e8bb77b5fe4e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:14.628509 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17734f54-48c8-408d-b098-e8bb77b5fe4e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:14.630282 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17734f54-48c8-408d-b098-e8bb77b5fe4e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:14.632213 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 469/929] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:14.639308 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3659b1-4721-4d93-b5ae-f75f3b865249 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:14.649282 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3659b1-4721-4d93-b5ae-f75f3b865249 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:14.654400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a80150-095a-4c4a-85db-a6e38dd63ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:14.655076 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a80150-095a-4c4a-85db-a6e38dd63ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:14.655356 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a80150-095a-4c4a-85db-a6e38dd63ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:14.655628 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a80150-095a-4c4a-85db-a6e38dd63ad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:14.656361 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a80150-095a-4c4a-85db-a6e38dd63ad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:14.658494 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a80150-095a-4c4a-85db-a6e38dd63ad9 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:14.689660 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 461/930] 10.222.0.96 () {60 vars in 1162 bytes} [Fri Jan 28 01:45:14 2022] POST /identity/v3/projects => generated 311 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:45:15.141835 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6e8c0-11db-4580-987c-ab5d313e6d6b None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:15.142232 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6e8c0-11db-4580-987c-ab5d313e6d6b None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:15.142436 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6e8c0-11db-4580-987c-ab5d313e6d6b None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:15.144318 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 470/931] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:15.151845 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecfd59-80ee-40e4-abc6-48c6fc0e025e None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:15.152133 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecfd59-80ee-40e4-abc6-48c6fc0e025e None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:15.152650 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecfd59-80ee-40e4-abc6-48c6fc0e025e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:15.170420 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-cdecfd59-80ee-40e4-abc6-48c6fc0e025e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:15.171585 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-cdecfd59-80ee-40e4-abc6-48c6fc0e025e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:15.227608 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 462/932] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:15 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:15.252086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6e8c0-11db-4580-987c-ab5d313e6d6b None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:15.268049 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6e8c0-11db-4580-987c-ab5d313e6d6b None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:15.272340 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b76cb-7ec6-4d38-997a-cf465154d534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:15.273306 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b76cb-7ec6-4d38-997a-cf465154d534 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:15.273715 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b76cb-7ec6-4d38-997a-cf465154d534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:15.273997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b76cb-7ec6-4d38-997a-cf465154d534 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:15.288288 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b76cb-7ec6-4d38-997a-cf465154d534 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:45:15.296185 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-9f0b76cb-7ec6-4d38-997a-cf465154d534 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:45:15.297582 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 471/933] 10.222.0.96 () {56 vars in 1141 bytes} [Fri Jan 28 01:45:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:15.303957 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecfd59-80ee-40e4-abc6-48c6fc0e025e None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:15.313566 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecfd59-80ee-40e4-abc6-48c6fc0e025e None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:15.318019 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec523c7-67f3-4762-b553-518c0408c68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:15.318675 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec523c7-67f3-4762-b553-518c0408c68a admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:15.318949 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec523c7-67f3-4762-b553-518c0408c68a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:15.319213 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec523c7-67f3-4762-b553-518c0408c68a admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:15.320004 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec523c7-67f3-4762-b553-518c0408c68a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:15.320478 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec523c7-67f3-4762-b553-518c0408c68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:15.322128 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec523c7-67f3-4762-b553-518c0408c68a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:15.330588 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 463/934] 10.222.0.96 () {56 vars in 1136 bytes} [Fri Jan 28 01:45:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:15.337148 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b76cb-7ec6-4d38-997a-cf465154d534 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:15.347102 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b76cb-7ec6-4d38-997a-cf465154d534 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:15.352706 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ece66-d790-4582-a52c-bef25716def9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:15.353622 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ece66-d790-4582-a52c-bef25716def9 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:15.353977 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ece66-d790-4582-a52c-bef25716def9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:15.354333 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ece66-d790-4582-a52c-bef25716def9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:15.365131 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ece66-d790-4582-a52c-bef25716def9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:15.367764 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ece66-d790-4582-a52c-bef25716def9 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:15.387420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-036ece66-d790-4582-a52c-bef25716def9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:45:15.388838 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 472/935] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:15.395098 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec523c7-67f3-4762-b553-518c0408c68a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:15.405640 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec523c7-67f3-4762-b553-518c0408c68a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:15.410251 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98a0c9-c769-4c44-9c37-efddd6e70431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:15.410977 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98a0c9-c769-4c44-9c37-efddd6e70431 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:15.411323 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98a0c9-c769-4c44-9c37-efddd6e70431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:15.411661 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98a0c9-c769-4c44-9c37-efddd6e70431 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:15.412436 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98a0c9-c769-4c44-9c37-efddd6e70431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:15.412818 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98a0c9-c769-4c44-9c37-efddd6e70431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:15.414497 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98a0c9-c769-4c44-9c37-efddd6e70431 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:15.427077 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 464/936] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:45:15.434338 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ece66-d790-4582-a52c-bef25716def9 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:15.444156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ece66-d790-4582-a52c-bef25716def9 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:15.449409 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae94f0-c595-43f9-8d58-91941baeaecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:15.450258 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae94f0-c595-43f9-8d58-91941baeaecd admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:15.450603 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae94f0-c595-43f9-8d58-91941baeaecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:15.450938 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae94f0-c595-43f9-8d58-91941baeaecd admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:15.459106 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae94f0-c595-43f9-8d58-91941baeaecd admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:15.461213 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae94f0-c595-43f9-8d58-91941baeaecd admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:15.475289 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-bbae94f0-c595-43f9-8d58-91941baeaecd admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:45:15.476978 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 473/937] 10.222.0.96 () {56 vars in 1114 bytes} [Fri Jan 28 01:45:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:45:15.483590 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98a0c9-c769-4c44-9c37-efddd6e70431 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:15.493899 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98a0c9-c769-4c44-9c37-efddd6e70431 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:15.498333 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31317c-122d-49a7-8e77-f25e0e181e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:15.498982 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31317c-122d-49a7-8e77-f25e0e181e37 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:15.499260 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31317c-122d-49a7-8e77-f25e0e181e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:15.499530 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31317c-122d-49a7-8e77-f25e0e181e37 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:15.500351 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31317c-122d-49a7-8e77-f25e0e181e37 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:15.500654 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31317c-122d-49a7-8e77-f25e0e181e37 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:15.502481 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31317c-122d-49a7-8e77-f25e0e181e37 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:15.520448 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 465/938] 10.222.0.96 () {56 vars in 1154 bytes} [Fri Jan 28 01:45:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:45:15.527120 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae94f0-c595-43f9-8d58-91941baeaecd admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:15.537919 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae94f0-c595-43f9-8d58-91941baeaecd admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:15.542769 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae233b-c8eb-4184-a513-ef05ab5e7b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:15.543409 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae233b-c8eb-4184-a513-ef05ab5e7b17 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:15.543681 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae233b-c8eb-4184-a513-ef05ab5e7b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:15.543947 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae233b-c8eb-4184-a513-ef05ab5e7b17 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:15.552616 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae233b-c8eb-4184-a513-ef05ab5e7b17 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:15.554934 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae233b-c8eb-4184-a513-ef05ab5e7b17 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:15.569907 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 474/939] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:45:15 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:45:15.571920 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31317c-122d-49a7-8e77-f25e0e181e37 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:15.583168 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31317c-122d-49a7-8e77-f25e0e181e37 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:15.588263 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a72965-599d-44e9-a650-64cd6c8f63df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:15.589106 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a72965-599d-44e9-a650-64cd6c8f63df admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:15.589387 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a72965-599d-44e9-a650-64cd6c8f63df admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:15.589656 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a72965-599d-44e9-a650-64cd6c8f63df admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:15.600188 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a72965-599d-44e9-a650-64cd6c8f63df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:15.602039 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a72965-599d-44e9-a650-64cd6c8f63df admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:15.619600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-02a72965-599d-44e9-a650-64cd6c8f63df admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:45:15.621039 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 466/940] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:15.627238 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae233b-c8eb-4184-a513-ef05ab5e7b17 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:15.636929 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae233b-c8eb-4184-a513-ef05ab5e7b17 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:15.641648 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7af9f2-77b1-4c55-a871-8b41413c5808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:15.642305 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7af9f2-77b1-4c55-a871-8b41413c5808 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:15.642585 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7af9f2-77b1-4c55-a871-8b41413c5808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:15.642856 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7af9f2-77b1-4c55-a871-8b41413c5808 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:15.643596 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7af9f2-77b1-4c55-a871-8b41413c5808 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:15.643899 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7af9f2-77b1-4c55-a871-8b41413c5808 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:15.645585 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7af9f2-77b1-4c55-a871-8b41413c5808 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:15.657665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 475/941] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:15.663808 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a72965-599d-44e9-a650-64cd6c8f63df admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:15.673793 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a72965-599d-44e9-a650-64cd6c8f63df admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:15.678401 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7831b6-6f50-499c-a57c-8bf81626e2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:15.679185 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7831b6-6f50-499c-a57c-8bf81626e2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:15.679958 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7831b6-6f50-499c-a57c-8bf81626e2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:15.680231 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7831b6-6f50-499c-a57c-8bf81626e2d1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:15.687409 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7831b6-6f50-499c-a57c-8bf81626e2d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:15.689409 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7831b6-6f50-499c-a57c-8bf81626e2d1 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:15.702946 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-1b7831b6-6f50-499c-a57c-8bf81626e2d1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:45:15.704276 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 467/942] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:45:15.710972 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7af9f2-77b1-4c55-a871-8b41413c5808 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:15.720620 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7af9f2-77b1-4c55-a871-8b41413c5808 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:15.725385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a139f0-a0c7-48ae-bb66-00fde7e84a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:15.726044 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a139f0-a0c7-48ae-bb66-00fde7e84a02 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:15.726372 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a139f0-a0c7-48ae-bb66-00fde7e84a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:15.726646 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a139f0-a0c7-48ae-bb66-00fde7e84a02 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:15.727558 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a139f0-a0c7-48ae-bb66-00fde7e84a02 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:15.727882 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a139f0-a0c7-48ae-bb66-00fde7e84a02 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:15.729819 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a139f0-a0c7-48ae-bb66-00fde7e84a02 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:15.744525 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 476/943] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:45:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:45:15.751510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7831b6-6f50-499c-a57c-8bf81626e2d1 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:15.762471 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7831b6-6f50-499c-a57c-8bf81626e2d1 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:15.767346 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72dee23-4bf0-483e-ae55-4344e5c799e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:15.768070 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dee23-4bf0-483e-ae55-4344e5c799e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:15.768351 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dee23-4bf0-483e-ae55-4344e5c799e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:15.768618 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dee23-4bf0-483e-ae55-4344e5c799e0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:15.769467 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72dee23-4bf0-483e-ae55-4344e5c799e0 admin admin] RBAC: Adding query filter params (role.id=0acbfad7f9ea4a69860babec7e6a317c, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=cc85f5db9c3c47fca68ebab33b0bb73c) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:15.769825 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72dee23-4bf0-483e-ae55-4344e5c799e0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:15.771624 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72dee23-4bf0-483e-ae55-4344e5c799e0 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:15.777978 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 468/944] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:45:15 2022] GET /identity/v3/role_assignments?user.id=cc85f5db9c3c47fca68ebab33b0bb73c&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=0acbfad7f9ea4a69860babec7e6a317c => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:16.768608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f21f4e-aef6-482d-93c2-fc7e4d79f8fd None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:16.769189 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f21f4e-aef6-482d-93c2-fc7e4d79f8fd None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:16.769267 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f21f4e-aef6-482d-93c2-fc7e4d79f8fd None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:16.771046 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 477/945] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:16.779148 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c624d-8be0-4312-979f-24d04501af52 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:16.779599 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c624d-8be0-4312-979f-24d04501af52 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:16.779779 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c624d-8be0-4312-979f-24d04501af52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:16.797704 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-2e4c624d-8be0-4312-979f-24d04501af52 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:16.798883 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2e4c624d-8be0-4312-979f-24d04501af52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:16.807661 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 469/946] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:16 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:16.831497 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f21f4e-aef6-482d-93c2-fc7e4d79f8fd None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:16.845358 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f21f4e-aef6-482d-93c2-fc7e4d79f8fd None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:16.849748 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a830a3-01b4-4190-a9ea-65641eeaad20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:16.850390 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a830a3-01b4-4190-a9ea-65641eeaad20 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:16.850662 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a830a3-01b4-4190-a9ea-65641eeaad20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:16.850930 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a830a3-01b4-4190-a9ea-65641eeaad20 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:16.859469 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a830a3-01b4-4190-a9ea-65641eeaad20 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:16.861271 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a830a3-01b4-4190-a9ea-65641eeaad20 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:16.873288 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 478/947] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:45:16 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:45:16.880107 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c624d-8be0-4312-979f-24d04501af52 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:16.889841 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c624d-8be0-4312-979f-24d04501af52 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:16.894472 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b2e69-22d1-4c43-9104-bd58248c9dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:16.895350 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b2e69-22d1-4c43-9104-bd58248c9dad admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:16.895702 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b2e69-22d1-4c43-9104-bd58248c9dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:16.896068 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b2e69-22d1-4c43-9104-bd58248c9dad admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:16.897376 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b2e69-22d1-4c43-9104-bd58248c9dad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:16.899769 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b2e69-22d1-4c43-9104-bd58248c9dad admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:16.901645 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 470/948] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:17.021614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893250e0-af3d-4471-8994-b780eebbb255 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:17.021935 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893250e0-af3d-4471-8994-b780eebbb255 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:17.022166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893250e0-af3d-4471-8994-b780eebbb255 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:17.024585 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 479/949] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:17.032779 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebd6c4-227c-4696-b096-6d1dc0b4f031 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:17.033098 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebd6c4-227c-4696-b096-6d1dc0b4f031 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:17.033361 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebd6c4-227c-4696-b096-6d1dc0b4f031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:17.052500 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-a2ebd6c4-227c-4696-b096-6d1dc0b4f031 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:17.053779 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-a2ebd6c4-227c-4696-b096-6d1dc0b4f031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:17.062977 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 471/950] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:17 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:17.089936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893250e0-af3d-4471-8994-b780eebbb255 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:17.102821 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893250e0-af3d-4471-8994-b780eebbb255 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:17.107451 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cd2d0-6804-4c24-aa74-c8607509ee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:17.108234 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cd2d0-6804-4c24-aa74-c8607509ee60 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:17.108516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cd2d0-6804-4c24-aa74-c8607509ee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:17.108784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cd2d0-6804-4c24-aa74-c8607509ee60 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:17.110017 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cd2d0-6804-4c24-aa74-c8607509ee60 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:17.111697 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cd2d0-6804-4c24-aa74-c8607509ee60 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:17.113362 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 480/951] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:17.121012 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebd6c4-227c-4696-b096-6d1dc0b4f031 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:17.130101 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebd6c4-227c-4696-b096-6d1dc0b4f031 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:17.136316 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da3fab-7e10-48e5-bd37-40f6f66510a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:17.137029 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da3fab-7e10-48e5-bd37-40f6f66510a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:17.137310 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da3fab-7e10-48e5-bd37-40f6f66510a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:17.137580 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da3fab-7e10-48e5-bd37-40f6f66510a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:17.138299 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da3fab-7e10-48e5-bd37-40f6f66510a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:17.140208 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da3fab-7e10-48e5-bd37-40f6f66510a1 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:17.162895 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 472/952] 10.222.0.96 () {60 vars in 1153 bytes} [Fri Jan 28 01:45:17 2022] POST /identity/v3/users => generated 285 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:45:18.038222 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646d8d9-5edb-4477-b286-167d9297ea65 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:18.038756 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646d8d9-5edb-4477-b286-167d9297ea65 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:18.038847 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646d8d9-5edb-4477-b286-167d9297ea65 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:18.040627 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 481/953] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:18.048125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b73ab3-86b8-4b71-8b2b-c6776964028d None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:18.048594 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b73ab3-86b8-4b71-8b2b-c6776964028d None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:18.048685 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b73ab3-86b8-4b71-8b2b-c6776964028d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:18.066440 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-41b73ab3-86b8-4b71-8b2b-c6776964028d None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:18.067601 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-41b73ab3-86b8-4b71-8b2b-c6776964028d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:18.075942 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 473/954] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:18 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:18.100069 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646d8d9-5edb-4477-b286-167d9297ea65 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:18.112541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646d8d9-5edb-4477-b286-167d9297ea65 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:18.117435 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab4cab-e2ca-4806-bb8d-54470cbdf384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:18.118262 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab4cab-e2ca-4806-bb8d-54470cbdf384 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:18.118535 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab4cab-e2ca-4806-bb8d-54470cbdf384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:18.118800 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab4cab-e2ca-4806-bb8d-54470cbdf384 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:18.128784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab4cab-e2ca-4806-bb8d-54470cbdf384 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:45:18.135936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-abab4cab-e2ca-4806-bb8d-54470cbdf384 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:45:18.137330 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 482/955] 10.222.0.96 () {56 vars in 1141 bytes} [Fri Jan 28 01:45:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:18.143631 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b73ab3-86b8-4b71-8b2b-c6776964028d None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:18.152925 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b73ab3-86b8-4b71-8b2b-c6776964028d None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:18.157421 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256c694-274e-4193-84e4-f2ec0ba10d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:18.158071 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256c694-274e-4193-84e4-f2ec0ba10d2d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:18.158351 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256c694-274e-4193-84e4-f2ec0ba10d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:18.158624 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256c694-274e-4193-84e4-f2ec0ba10d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:18.159363 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256c694-274e-4193-84e4-f2ec0ba10d2d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:18.159666 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256c694-274e-4193-84e4-f2ec0ba10d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:18.161297 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256c694-274e-4193-84e4-f2ec0ba10d2d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:18.169927 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 474/956] 10.222.0.96 () {56 vars in 1136 bytes} [Fri Jan 28 01:45:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:18.176295 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab4cab-e2ca-4806-bb8d-54470cbdf384 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:18.186997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab4cab-e2ca-4806-bb8d-54470cbdf384 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:18.191477 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b13ab3-97a3-485a-a2c4-9b57fccd5a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:18.192243 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b13ab3-97a3-485a-a2c4-9b57fccd5a5e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:18.192523 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b13ab3-97a3-485a-a2c4-9b57fccd5a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:18.192803 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b13ab3-97a3-485a-a2c4-9b57fccd5a5e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:18.202951 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b13ab3-97a3-485a-a2c4-9b57fccd5a5e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:18.204763 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b13ab3-97a3-485a-a2c4-9b57fccd5a5e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:18.221100 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-84b13ab3-97a3-485a-a2c4-9b57fccd5a5e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:45:18.222268 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 483/957] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:18.229125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256c694-274e-4193-84e4-f2ec0ba10d2d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:18.238666 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256c694-274e-4193-84e4-f2ec0ba10d2d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:18.243895 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5101cac-9d64-4499-8bbb-bd78c3a85e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:18.244544 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5101cac-9d64-4499-8bbb-bd78c3a85e09 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:18.244855 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5101cac-9d64-4499-8bbb-bd78c3a85e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:18.245133 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5101cac-9d64-4499-8bbb-bd78c3a85e09 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:18.245954 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5101cac-9d64-4499-8bbb-bd78c3a85e09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:18.246261 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5101cac-9d64-4499-8bbb-bd78c3a85e09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:18.247829 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5101cac-9d64-4499-8bbb-bd78c3a85e09 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:18.259958 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 475/958] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:18.266154 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b13ab3-97a3-485a-a2c4-9b57fccd5a5e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:18.275861 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b13ab3-97a3-485a-a2c4-9b57fccd5a5e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:18.280593 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328966a-891c-4be0-bbf6-1618a710097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:18.281406 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328966a-891c-4be0-bbf6-1618a710097e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:18.281683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328966a-891c-4be0-bbf6-1618a710097e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:18.281949 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328966a-891c-4be0-bbf6-1618a710097e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:18.290095 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328966a-891c-4be0-bbf6-1618a710097e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:18.292004 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328966a-891c-4be0-bbf6-1618a710097e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:18.305918 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-8328966a-891c-4be0-bbf6-1618a710097e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:45:18.307068 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 484/959] 10.222.0.96 () {56 vars in 1114 bytes} [Fri Jan 28 01:45:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:18.313525 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5101cac-9d64-4499-8bbb-bd78c3a85e09 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:18.323478 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5101cac-9d64-4499-8bbb-bd78c3a85e09 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:18.327952 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae16fa4-3f48-4eec-8a7c-d63881a63eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:18.328605 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae16fa4-3f48-4eec-8a7c-d63881a63eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:18.328932 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae16fa4-3f48-4eec-8a7c-d63881a63eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:18.329208 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae16fa4-3f48-4eec-8a7c-d63881a63eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:18.330034 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae16fa4-3f48-4eec-8a7c-d63881a63eb7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:18.330342 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae16fa4-3f48-4eec-8a7c-d63881a63eb7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:18.332182 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae16fa4-3f48-4eec-8a7c-d63881a63eb7 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:18.349108 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 476/960] 10.222.0.96 () {56 vars in 1154 bytes} [Fri Jan 28 01:45:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:18.356098 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328966a-891c-4be0-bbf6-1618a710097e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:18.365533 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328966a-891c-4be0-bbf6-1618a710097e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:18.371527 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc9135-b5dc-41e6-92be-ec67e9d0ee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:18.372322 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc9135-b5dc-41e6-92be-ec67e9d0ee90 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:18.372598 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc9135-b5dc-41e6-92be-ec67e9d0ee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:18.372896 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc9135-b5dc-41e6-92be-ec67e9d0ee90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:18.384885 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc9135-b5dc-41e6-92be-ec67e9d0ee90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:18.386766 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc9135-b5dc-41e6-92be-ec67e9d0ee90 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:18.406212 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-68bc9135-b5dc-41e6-92be-ec67e9d0ee90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:45:18.407420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 485/961] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:18.414024 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae16fa4-3f48-4eec-8a7c-d63881a63eb7 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:18.423827 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae16fa4-3f48-4eec-8a7c-d63881a63eb7 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:18.428331 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c24cf-812f-4ef3-8887-5c5bef5cd42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:18.429002 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c24cf-812f-4ef3-8887-5c5bef5cd42e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:18.429774 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c24cf-812f-4ef3-8887-5c5bef5cd42e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:18.430198 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c24cf-812f-4ef3-8887-5c5bef5cd42e admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:18.430917 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c24cf-812f-4ef3-8887-5c5bef5cd42e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:18.431223 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c24cf-812f-4ef3-8887-5c5bef5cd42e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:18.432825 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c24cf-812f-4ef3-8887-5c5bef5cd42e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:18.444380 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 477/962] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:18.451459 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc9135-b5dc-41e6-92be-ec67e9d0ee90 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:18.461000 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc9135-b5dc-41e6-92be-ec67e9d0ee90 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:18.465436 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b7ef2-740d-4b43-8782-7a5ee2dcf651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:18.466207 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b7ef2-740d-4b43-8782-7a5ee2dcf651 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:18.466480 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b7ef2-740d-4b43-8782-7a5ee2dcf651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:18.466770 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b7ef2-740d-4b43-8782-7a5ee2dcf651 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:18.473798 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b7ef2-740d-4b43-8782-7a5ee2dcf651 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:18.475730 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b7ef2-740d-4b43-8782-7a5ee2dcf651 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:18.488602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-ec9b7ef2-740d-4b43-8782-7a5ee2dcf651 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:45:18.489829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 486/963] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:45:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:18.497004 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c24cf-812f-4ef3-8887-5c5bef5cd42e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:18.506695 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c24cf-812f-4ef3-8887-5c5bef5cd42e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:18.511750 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec425d22-b0a2-4959-8878-bc3881bfefab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:18.512394 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec425d22-b0a2-4959-8878-bc3881bfefab admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:18.512668 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec425d22-b0a2-4959-8878-bc3881bfefab admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:18.512975 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec425d22-b0a2-4959-8878-bc3881bfefab admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:18.513737 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec425d22-b0a2-4959-8878-bc3881bfefab admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:18.514043 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec425d22-b0a2-4959-8878-bc3881bfefab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:18.515918 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec425d22-b0a2-4959-8878-bc3881bfefab admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:18.528788 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 478/964] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:45:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:18.535551 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b7ef2-740d-4b43-8782-7a5ee2dcf651 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:18.546209 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b7ef2-740d-4b43-8782-7a5ee2dcf651 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:18.551301 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee76428-9386-4b2a-93b7-2eee6d7e455e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:18.552181 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee76428-9386-4b2a-93b7-2eee6d7e455e admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:18.552455 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee76428-9386-4b2a-93b7-2eee6d7e455e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:18.552722 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee76428-9386-4b2a-93b7-2eee6d7e455e admin admin] PATH_INFO: `/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/cc85f5db9c3c47fca68ebab33b0bb73c/roles/0acbfad7f9ea4a69860babec7e6a317c` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:18.555444 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee76428-9386-4b2a-93b7-2eee6d7e455e admin admin] RBAC: Authorizing `identity:create_grant(project_id=356ecb479ba24136a7c38cb5a58a0a18, user_id=cc85f5db9c3c47fca68ebab33b0bb73c, role_id=0acbfad7f9ea4a69860babec7e6a317c)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:18.558067 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee76428-9386-4b2a-93b7-2eee6d7e455e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:18.572007 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 487/965] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:45:18 2022] PUT /identity/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/cc85f5db9c3c47fca68ebab33b0bb73c/roles/0acbfad7f9ea4a69860babec7e6a317c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:45:19.419933 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a89470-42b6-49bb-a43d-88c0b82fc0b2 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:19.420463 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a89470-42b6-49bb-a43d-88c0b82fc0b2 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:19.420463 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a89470-42b6-49bb-a43d-88c0b82fc0b2 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:19.422254 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 479/966] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:19.430536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a05cd-93c6-4917-a5bd-985780a4ec06 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:19.430970 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a05cd-93c6-4917-a5bd-985780a4ec06 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:19.431297 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a05cd-93c6-4917-a5bd-985780a4ec06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:19.449141 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-df9a05cd-93c6-4917-a5bd-985780a4ec06 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:19.450334 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-df9a05cd-93c6-4917-a5bd-985780a4ec06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:19.507056 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 488/967] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:19 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:19.533362 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a89470-42b6-49bb-a43d-88c0b82fc0b2 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:19.545562 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a89470-42b6-49bb-a43d-88c0b82fc0b2 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:19.549907 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d23517-ddf0-466c-942e-b4f08d88a81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:19.550706 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d23517-ddf0-466c-942e-b4f08d88a81e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:19.550983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d23517-ddf0-466c-942e-b4f08d88a81e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:19.551247 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d23517-ddf0-466c-942e-b4f08d88a81e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:19.562358 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d23517-ddf0-466c-942e-b4f08d88a81e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:45:19.569064 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-74d23517-ddf0-466c-942e-b4f08d88a81e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:45:19.570861 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 480/968] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:45:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:19.577538 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a05cd-93c6-4917-a5bd-985780a4ec06 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:19.586746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a05cd-93c6-4917-a5bd-985780a4ec06 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:19.591200 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9beb1-db77-4238-b3f0-3c885ce8c838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:19.591857 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9beb1-db77-4238-b3f0-3c885ce8c838 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:19.592133 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9beb1-db77-4238-b3f0-3c885ce8c838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:19.592690 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9beb1-db77-4238-b3f0-3c885ce8c838 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:19.593457 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9beb1-db77-4238-b3f0-3c885ce8c838 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:19.593761 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9beb1-db77-4238-b3f0-3c885ce8c838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:19.595343 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9beb1-db77-4238-b3f0-3c885ce8c838 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:19.604888 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 489/969] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:45:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:19.611339 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d23517-ddf0-466c-942e-b4f08d88a81e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:19.621816 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d23517-ddf0-466c-942e-b4f08d88a81e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:19.626281 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ff293-25f7-478e-b0a1-77349f6bdf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:19.627148 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ff293-25f7-478e-b0a1-77349f6bdf79 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:19.627422 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ff293-25f7-478e-b0a1-77349f6bdf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:19.627689 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ff293-25f7-478e-b0a1-77349f6bdf79 admin admin] PATH_INFO: `/v3/users/cf8bf512957b4380ad665209c8598739` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:19.642244 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ff293-25f7-478e-b0a1-77349f6bdf79 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf8bf512957b4380ad665209c8598739)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:19.644351 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ff293-25f7-478e-b0a1-77349f6bdf79 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:19.646104 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 481/970] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:45:19 2022] GET /identity/v3/users/cf8bf512957b4380ad665209c8598739 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:19.653717 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9beb1-db77-4238-b3f0-3c885ce8c838 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:19.663345 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9beb1-db77-4238-b3f0-3c885ce8c838 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:19.668140 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f022a9-7ba7-4c9a-8a9e-34f6f84d8241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:19.668778 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f022a9-7ba7-4c9a-8a9e-34f6f84d8241 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:19.669080 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f022a9-7ba7-4c9a-8a9e-34f6f84d8241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:19.669349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f022a9-7ba7-4c9a-8a9e-34f6f84d8241 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:19.677420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f022a9-7ba7-4c9a-8a9e-34f6f84d8241 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:19.679094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f022a9-7ba7-4c9a-8a9e-34f6f84d8241 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:19.688299 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 490/971] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:45:19 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:45:19.695383 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ff293-25f7-478e-b0a1-77349f6bdf79 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:19.705341 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ff293-25f7-478e-b0a1-77349f6bdf79 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:19.709817 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e4af5-614d-4d1d-a72a-be0c616dd706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:19.711279 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e4af5-614d-4d1d-a72a-be0c616dd706 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:19.711555 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e4af5-614d-4d1d-a72a-be0c616dd706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:19.711820 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e4af5-614d-4d1d-a72a-be0c616dd706 admin admin] PATH_INFO: `/v3/projects/0b4a58b4778f408f901761cdbb7786a3` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:19.713032 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e4af5-614d-4d1d-a72a-be0c616dd706 admin admin] RBAC: Authorizing `identity:get_project(project_id=0b4a58b4778f408f901761cdbb7786a3)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:19.715089 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e4af5-614d-4d1d-a72a-be0c616dd706 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:19.716897 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 482/972] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:45:19 2022] GET /identity/v3/projects/0b4a58b4778f408f901761cdbb7786a3 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:19.723903 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f022a9-7ba7-4c9a-8a9e-34f6f84d8241 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:19.733737 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f022a9-7ba7-4c9a-8a9e-34f6f84d8241 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:19.738594 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ed11f-8b13-440b-9a03-9241e74e5426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:19.739276 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ed11f-8b13-440b-9a03-9241e74e5426 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:19.739558 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ed11f-8b13-440b-9a03-9241e74e5426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:19.739832 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ed11f-8b13-440b-9a03-9241e74e5426 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:19.740678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ed11f-8b13-440b-9a03-9241e74e5426 admin admin] RBAC: Adding query filter params (role.id=253c0a1dc8d6421298a7987caaa55676, scope.project.id=0b4a58b4778f408f901761cdbb7786a3, user.id=cf8bf512957b4380ad665209c8598739) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:19.741025 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ed11f-8b13-440b-9a03-9241e74e5426 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:19.743439 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ed11f-8b13-440b-9a03-9241e74e5426 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:19.749677 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 491/973] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:45:19 2022] GET /identity/v3/role_assignments?user.id=cf8bf512957b4380ad665209c8598739&scope.project.id=0b4a58b4778f408f901761cdbb7786a3&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:20.769062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fb238-b1fb-4e74-b417-7bc9136d08fe None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:20.769663 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fb238-b1fb-4e74-b417-7bc9136d08fe None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:20.769663 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fb238-b1fb-4e74-b417-7bc9136d08fe None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:20.771388 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 483/974] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:20.779825 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ffc08-f2da-427e-8872-90fc5245fe63 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:20.780338 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ffc08-f2da-427e-8872-90fc5245fe63 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:20.780435 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ffc08-f2da-427e-8872-90fc5245fe63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:20.798543 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-046ffc08-f2da-427e-8872-90fc5245fe63 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:20.799760 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-046ffc08-f2da-427e-8872-90fc5245fe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:20.807325 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 492/975] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:20 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:20.832080 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fb238-b1fb-4e74-b417-7bc9136d08fe None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:20.844893 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fb238-b1fb-4e74-b417-7bc9136d08fe None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:20.849311 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f576c6-e039-447e-8655-2a792290f567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:20.850132 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f576c6-e039-447e-8655-2a792290f567 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:20.850412 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f576c6-e039-447e-8655-2a792290f567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:20.850684 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f576c6-e039-447e-8655-2a792290f567 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:20.862546 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f576c6-e039-447e-8655-2a792290f567 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:45:20.870288 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-60f576c6-e039-447e-8655-2a792290f567 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:45:20.871646 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 484/976] 10.222.0.96 () {56 vars in 1141 bytes} [Fri Jan 28 01:45:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:20.878167 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ffc08-f2da-427e-8872-90fc5245fe63 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:20.887097 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ffc08-f2da-427e-8872-90fc5245fe63 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:20.891650 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a2ee4-07b7-4fe4-808c-bdfce1866963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:20.892395 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a2ee4-07b7-4fe4-808c-bdfce1866963 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:20.892735 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a2ee4-07b7-4fe4-808c-bdfce1866963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:20.893102 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a2ee4-07b7-4fe4-808c-bdfce1866963 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:20.893912 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a2ee4-07b7-4fe4-808c-bdfce1866963 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:20.894277 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a2ee4-07b7-4fe4-808c-bdfce1866963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:20.895937 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a2ee4-07b7-4fe4-808c-bdfce1866963 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:20.905581 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 493/977] 10.222.0.96 () {56 vars in 1136 bytes} [Fri Jan 28 01:45:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:20.911952 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f576c6-e039-447e-8655-2a792290f567 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:20.922708 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f576c6-e039-447e-8655-2a792290f567 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:20.927211 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed16d4-1e5c-4ebe-ab81-62797b1c0756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:20.927991 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed16d4-1e5c-4ebe-ab81-62797b1c0756 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:20.928268 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed16d4-1e5c-4ebe-ab81-62797b1c0756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:20.928539 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed16d4-1e5c-4ebe-ab81-62797b1c0756 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:20.939520 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed16d4-1e5c-4ebe-ab81-62797b1c0756 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:20.941406 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed16d4-1e5c-4ebe-ab81-62797b1c0756 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:20.958892 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-08ed16d4-1e5c-4ebe-ab81-62797b1c0756 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:45:20.960113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 485/978] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:20.967140 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a2ee4-07b7-4fe4-808c-bdfce1866963 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:20.977645 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a2ee4-07b7-4fe4-808c-bdfce1866963 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:20.982285 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846536b-31fe-4fb0-874d-e160caec49b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:20.982940 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846536b-31fe-4fb0-874d-e160caec49b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:20.983219 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846536b-31fe-4fb0-874d-e160caec49b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:20.983491 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846536b-31fe-4fb0-874d-e160caec49b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:20.984202 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846536b-31fe-4fb0-874d-e160caec49b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:20.984506 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846536b-31fe-4fb0-874d-e160caec49b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:20.986138 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846536b-31fe-4fb0-874d-e160caec49b2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:20.998641 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 494/979] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:21.005180 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed16d4-1e5c-4ebe-ab81-62797b1c0756 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:21.015671 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed16d4-1e5c-4ebe-ab81-62797b1c0756 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:21.020136 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa88388-eb4f-4aea-9001-49c868acd62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:21.020952 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa88388-eb4f-4aea-9001-49c868acd62d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:21.021230 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa88388-eb4f-4aea-9001-49c868acd62d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:21.021499 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa88388-eb4f-4aea-9001-49c868acd62d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:21.030184 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa88388-eb4f-4aea-9001-49c868acd62d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:21.032159 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa88388-eb4f-4aea-9001-49c868acd62d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:21.045077 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-dfa88388-eb4f-4aea-9001-49c868acd62d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:45:21.046246 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 486/980] 10.222.0.96 () {56 vars in 1114 bytes} [Fri Jan 28 01:45:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:21.052814 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846536b-31fe-4fb0-874d-e160caec49b2 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:21.062918 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846536b-31fe-4fb0-874d-e160caec49b2 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:21.067402 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3266d4a-0b2e-42f6-a839-d26a724074a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:21.068055 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3266d4a-0b2e-42f6-a839-d26a724074a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:21.068329 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3266d4a-0b2e-42f6-a839-d26a724074a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:21.068594 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3266d4a-0b2e-42f6-a839-d26a724074a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:21.069452 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3266d4a-0b2e-42f6-a839-d26a724074a5 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:21.069751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3266d4a-0b2e-42f6-a839-d26a724074a5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:21.072104 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3266d4a-0b2e-42f6-a839-d26a724074a5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:21.091166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 495/981] 10.222.0.96 () {56 vars in 1154 bytes} [Fri Jan 28 01:45:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:21.098513 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa88388-eb4f-4aea-9001-49c868acd62d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:21.109000 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa88388-eb4f-4aea-9001-49c868acd62d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:21.113417 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1746501-1eba-486c-a890-3be25ab47e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:21.114050 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1746501-1eba-486c-a890-3be25ab47e68 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:21.114326 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1746501-1eba-486c-a890-3be25ab47e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:21.114595 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1746501-1eba-486c-a890-3be25ab47e68 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:21.128384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1746501-1eba-486c-a890-3be25ab47e68 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:21.128384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1746501-1eba-486c-a890-3be25ab47e68 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:21.134455 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 487/982] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:45:21 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:45:21.142054 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3266d4a-0b2e-42f6-a839-d26a724074a5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:21.151027 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3266d4a-0b2e-42f6-a839-d26a724074a5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:21.155998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba5571-a74a-4a3c-81c2-ad0fe3b25783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:21.156787 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba5571-a74a-4a3c-81c2-ad0fe3b25783 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:21.157100 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba5571-a74a-4a3c-81c2-ad0fe3b25783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:21.157364 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba5571-a74a-4a3c-81c2-ad0fe3b25783 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:21.168646 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba5571-a74a-4a3c-81c2-ad0fe3b25783 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:21.170537 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba5571-a74a-4a3c-81c2-ad0fe3b25783 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:21.188308 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-9cba5571-a74a-4a3c-81c2-ad0fe3b25783 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:45:21.189483 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 496/983] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:21.196009 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1746501-1eba-486c-a890-3be25ab47e68 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:21.204756 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1746501-1eba-486c-a890-3be25ab47e68 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:21.209290 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914ef5a-c7c7-49fb-97e5-0cf08a95a12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:21.209928 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914ef5a-c7c7-49fb-97e5-0cf08a95a12f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:21.210210 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914ef5a-c7c7-49fb-97e5-0cf08a95a12f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:21.210483 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914ef5a-c7c7-49fb-97e5-0cf08a95a12f admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:21.211190 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914ef5a-c7c7-49fb-97e5-0cf08a95a12f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:21.211490 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914ef5a-c7c7-49fb-97e5-0cf08a95a12f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:21.213064 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914ef5a-c7c7-49fb-97e5-0cf08a95a12f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:21.224614 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 488/984] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:21.231107 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba5571-a74a-4a3c-81c2-ad0fe3b25783 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:21.240761 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba5571-a74a-4a3c-81c2-ad0fe3b25783 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:21.246176 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e65c2-2921-4387-ab5f-b6222b8ee03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:21.246988 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e65c2-2921-4387-ab5f-b6222b8ee03e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:21.247276 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e65c2-2921-4387-ab5f-b6222b8ee03e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:21.247548 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e65c2-2921-4387-ab5f-b6222b8ee03e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:21.255118 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e65c2-2921-4387-ab5f-b6222b8ee03e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:21.257095 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e65c2-2921-4387-ab5f-b6222b8ee03e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:21.269873 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-d52e65c2-2921-4387-ab5f-b6222b8ee03e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:45:21.276311 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 497/985] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:45:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:21.278082 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914ef5a-c7c7-49fb-97e5-0cf08a95a12f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:21.287635 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914ef5a-c7c7-49fb-97e5-0cf08a95a12f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:21.292686 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20200e75-47b4-43d0-a896-18f31fb894e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:21.293362 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20200e75-47b4-43d0-a896-18f31fb894e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:21.293646 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20200e75-47b4-43d0-a896-18f31fb894e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:21.293919 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20200e75-47b4-43d0-a896-18f31fb894e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:21.294694 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20200e75-47b4-43d0-a896-18f31fb894e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:21.294998 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20200e75-47b4-43d0-a896-18f31fb894e2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:21.296816 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20200e75-47b4-43d0-a896-18f31fb894e2 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:21.308913 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 489/986] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:45:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:45:21.315524 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e65c2-2921-4387-ab5f-b6222b8ee03e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:21.326177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e65c2-2921-4387-ab5f-b6222b8ee03e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:21.330617 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c1f29-dc3f-474b-acda-55297e18b2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:21.331242 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c1f29-dc3f-474b-acda-55297e18b2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:21.331518 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c1f29-dc3f-474b-acda-55297e18b2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:21.331790 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c1f29-dc3f-474b-acda-55297e18b2a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:21.332597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c1f29-dc3f-474b-acda-55297e18b2a4 admin admin] RBAC: Adding query filter params (role.id=0acbfad7f9ea4a69860babec7e6a317c, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=cc85f5db9c3c47fca68ebab33b0bb73c) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:21.332942 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c1f29-dc3f-474b-acda-55297e18b2a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:21.334750 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c1f29-dc3f-474b-acda-55297e18b2a4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:21.340683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 498/987] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:45:21 2022] GET /identity/v3/role_assignments?user.id=cc85f5db9c3c47fca68ebab33b0bb73c&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=0acbfad7f9ea4a69860babec7e6a317c => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:22.003250 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6889e97-857c-4d0b-8aa8-7c58a64249b7 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:22.003762 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6889e97-857c-4d0b-8aa8-7c58a64249b7 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:22.003848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6889e97-857c-4d0b-8aa8-7c58a64249b7 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:22.005615 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 490/988] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:22.014263 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e41882-f5a9-4cc8-b9da-ccd14ef96ce4 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:22.014770 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e41882-f5a9-4cc8-b9da-ccd14ef96ce4 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:22.014872 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e41882-f5a9-4cc8-b9da-ccd14ef96ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:22.033234 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-10e41882-f5a9-4cc8-b9da-ccd14ef96ce4 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:22.034413 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-10e41882-f5a9-4cc8-b9da-ccd14ef96ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:22.042324 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 499/989] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:22 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:22.065999 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6889e97-857c-4d0b-8aa8-7c58a64249b7 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:22.079105 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6889e97-857c-4d0b-8aa8-7c58a64249b7 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:22.088310 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4cde2-be68-4e26-8e40-dbde03ef7bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:22.089151 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4cde2-be68-4e26-8e40-dbde03ef7bcf admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:22.089428 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4cde2-be68-4e26-8e40-dbde03ef7bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:22.089697 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4cde2-be68-4e26-8e40-dbde03ef7bcf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:22.100901 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4cde2-be68-4e26-8e40-dbde03ef7bcf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:45:22.108221 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-7ed4cde2-be68-4e26-8e40-dbde03ef7bcf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:45:22.109678 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 491/990] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:45:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:22.116275 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e41882-f5a9-4cc8-b9da-ccd14ef96ce4 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:22.126091 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e41882-f5a9-4cc8-b9da-ccd14ef96ce4 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:22.130838 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc083321-a5b7-438b-9234-75c6ecbb312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:22.131502 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc083321-a5b7-438b-9234-75c6ecbb312a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:22.131779 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc083321-a5b7-438b-9234-75c6ecbb312a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:22.132045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc083321-a5b7-438b-9234-75c6ecbb312a admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:22.133694 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc083321-a5b7-438b-9234-75c6ecbb312a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:22.134113 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc083321-a5b7-438b-9234-75c6ecbb312a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:22.135693 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc083321-a5b7-438b-9234-75c6ecbb312a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:22.144624 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 500/991] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:45:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:22.152148 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4cde2-be68-4e26-8e40-dbde03ef7bcf admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:22.162890 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4cde2-be68-4e26-8e40-dbde03ef7bcf admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:22.167596 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad4a89-884b-4d4c-a6ae-69afdb8f1dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:22.168451 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad4a89-884b-4d4c-a6ae-69afdb8f1dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:22.168731 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad4a89-884b-4d4c-a6ae-69afdb8f1dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:22.169032 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad4a89-884b-4d4c-a6ae-69afdb8f1dd6 admin admin] PATH_INFO: `/v3/users/cf8bf512957b4380ad665209c8598739` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:22.170237 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad4a89-884b-4d4c-a6ae-69afdb8f1dd6 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf8bf512957b4380ad665209c8598739)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:22.172340 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad4a89-884b-4d4c-a6ae-69afdb8f1dd6 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:22.173999 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 492/992] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:45:22 2022] GET /identity/v3/users/cf8bf512957b4380ad665209c8598739 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:22.181056 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc083321-a5b7-438b-9234-75c6ecbb312a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:22.191702 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc083321-a5b7-438b-9234-75c6ecbb312a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:22.197032 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a05fd-2a13-452d-955e-df1c854dfbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:22.197890 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a05fd-2a13-452d-955e-df1c854dfbff admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:22.198173 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a05fd-2a13-452d-955e-df1c854dfbff admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:22.198443 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a05fd-2a13-452d-955e-df1c854dfbff admin admin] PATH_INFO: `/v3/projects/0b4a58b4778f408f901761cdbb7786a3` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:22.199618 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a05fd-2a13-452d-955e-df1c854dfbff admin admin] RBAC: Authorizing `identity:get_project(project_id=0b4a58b4778f408f901761cdbb7786a3)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:22.201685 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a05fd-2a13-452d-955e-df1c854dfbff admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:22.203365 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 501/993] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:45:22 2022] GET /identity/v3/projects/0b4a58b4778f408f901761cdbb7786a3 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:22.210203 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad4a89-884b-4d4c-a6ae-69afdb8f1dd6 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:22.220264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad4a89-884b-4d4c-a6ae-69afdb8f1dd6 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:22.224790 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c9c4a-b936-4873-ada4-1c377beca4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:22.225704 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c9c4a-b936-4873-ada4-1c377beca4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:22.225981 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c9c4a-b936-4873-ada4-1c377beca4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:22.226374 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c9c4a-b936-4873-ada4-1c377beca4eb admin admin] PATH_INFO: `/v3/projects/0b4a58b4778f408f901761cdbb7786a3/users/cf8bf512957b4380ad665209c8598739/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:22.228447 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c9c4a-b936-4873-ada4-1c377beca4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4a58b4778f408f901761cdbb7786a3, user_id=cf8bf512957b4380ad665209c8598739, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:22.231067 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c9c4a-b936-4873-ada4-1c377beca4eb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:22.244400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 493/994] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:45:22 2022] PUT /identity/v3/projects/0b4a58b4778f408f901761cdbb7786a3/users/cf8bf512957b4380ad665209c8598739/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:45:24.410971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c133d1e-dbe4-4c8d-8331-2c4ba45daa40 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:24.411598 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c133d1e-dbe4-4c8d-8331-2c4ba45daa40 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:24.411598 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c133d1e-dbe4-4c8d-8331-2c4ba45daa40 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:24.413333 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 502/995] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:24.420808 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdaaa2-7fa4-4518-9f38-a1a3d0f99762 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:24.421251 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdaaa2-7fa4-4518-9f38-a1a3d0f99762 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:24.421361 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdaaa2-7fa4-4518-9f38-a1a3d0f99762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:24.439094 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-47cdaaa2-7fa4-4518-9f38-a1a3d0f99762 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:24.440263 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-47cdaaa2-7fa4-4518-9f38-a1a3d0f99762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:24.496115 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 494/996] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:24 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:24.520482 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c133d1e-dbe4-4c8d-8331-2c4ba45daa40 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:24.532715 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c133d1e-dbe4-4c8d-8331-2c4ba45daa40 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:24.536983 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056a7c5-6c04-4f88-8500-a7af39400a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:24.537750 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056a7c5-6c04-4f88-8500-a7af39400a68 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:24.538027 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056a7c5-6c04-4f88-8500-a7af39400a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:24.538294 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056a7c5-6c04-4f88-8500-a7af39400a68 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:24.549022 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056a7c5-6c04-4f88-8500-a7af39400a68 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:45:24.556177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-e056a7c5-6c04-4f88-8500-a7af39400a68 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:45:24.557401 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 503/997] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:45:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:24.564101 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdaaa2-7fa4-4518-9f38-a1a3d0f99762 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:24.574048 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdaaa2-7fa4-4518-9f38-a1a3d0f99762 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:24.578798 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b875d83-a7ad-4250-951d-7eec876315e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:24.579453 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b875d83-a7ad-4250-951d-7eec876315e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:24.579732 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b875d83-a7ad-4250-951d-7eec876315e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:24.580001 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b875d83-a7ad-4250-951d-7eec876315e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:24.580743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b875d83-a7ad-4250-951d-7eec876315e2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:24.581088 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b875d83-a7ad-4250-951d-7eec876315e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:24.582655 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b875d83-a7ad-4250-951d-7eec876315e2 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:24.591315 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 495/998] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:45:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:24.597738 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056a7c5-6c04-4f88-8500-a7af39400a68 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:24.607423 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056a7c5-6c04-4f88-8500-a7af39400a68 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:24.611847 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1561acb-610f-4d00-8414-4b6facaef145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:24.612688 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1561acb-610f-4d00-8414-4b6facaef145 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:24.613082 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1561acb-610f-4d00-8414-4b6facaef145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:24.613352 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1561acb-610f-4d00-8414-4b6facaef145 admin admin] PATH_INFO: `/v3/users/cf8bf512957b4380ad665209c8598739` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:24.614506 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1561acb-610f-4d00-8414-4b6facaef145 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf8bf512957b4380ad665209c8598739)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:24.616604 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1561acb-610f-4d00-8414-4b6facaef145 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:24.618746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 504/999] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:45:24 2022] GET /identity/v3/users/cf8bf512957b4380ad665209c8598739 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:24.624947 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b875d83-a7ad-4250-951d-7eec876315e2 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:24.634894 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b875d83-a7ad-4250-951d-7eec876315e2 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:24.639516 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af193e-83f2-456e-bbe6-1d15d3047b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:24.640143 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af193e-83f2-456e-bbe6-1d15d3047b81 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:24.640420 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af193e-83f2-456e-bbe6-1d15d3047b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:24.640691 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af193e-83f2-456e-bbe6-1d15d3047b81 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:24.648232 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af193e-83f2-456e-bbe6-1d15d3047b81 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:24.649977 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af193e-83f2-456e-bbe6-1d15d3047b81 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:24.658730 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 496/1000] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:45:24 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:45:24.665224 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1561acb-610f-4d00-8414-4b6facaef145 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:24.674493 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1561acb-610f-4d00-8414-4b6facaef145 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:24.678928 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5e301-7a88-4e2b-b0d9-753d95fcdd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:24.680259 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5e301-7a88-4e2b-b0d9-753d95fcdd50 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:24.680534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5e301-7a88-4e2b-b0d9-753d95fcdd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:24.680822 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5e301-7a88-4e2b-b0d9-753d95fcdd50 admin admin] PATH_INFO: `/v3/projects/0b4a58b4778f408f901761cdbb7786a3` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:24.681981 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5e301-7a88-4e2b-b0d9-753d95fcdd50 admin admin] RBAC: Authorizing `identity:get_project(project_id=0b4a58b4778f408f901761cdbb7786a3)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:24.683997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5e301-7a88-4e2b-b0d9-753d95fcdd50 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:24.685687 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 505/1001] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:45:24 2022] GET /identity/v3/projects/0b4a58b4778f408f901761cdbb7786a3 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:45:24.692243 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af193e-83f2-456e-bbe6-1d15d3047b81 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:24.701535 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af193e-83f2-456e-bbe6-1d15d3047b81 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:24.706005 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1f65a-0b1e-4415-bf2d-262e87610816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:24.706629 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1f65a-0b1e-4415-bf2d-262e87610816 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:24.706906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1f65a-0b1e-4415-bf2d-262e87610816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:24.707177 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1f65a-0b1e-4415-bf2d-262e87610816 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:24.707982 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1f65a-0b1e-4415-bf2d-262e87610816 admin admin] RBAC: Adding query filter params (role.id=253c0a1dc8d6421298a7987caaa55676, scope.project.id=0b4a58b4778f408f901761cdbb7786a3, user.id=cf8bf512957b4380ad665209c8598739) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:24.708287 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1f65a-0b1e-4415-bf2d-262e87610816 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:24.710118 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1f65a-0b1e-4415-bf2d-262e87610816 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:24.717631 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 497/1002] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:45:24 2022] GET /identity/v3/role_assignments?user.id=cf8bf512957b4380ad665209c8598739&scope.project.id=0b4a58b4778f408f901761cdbb7786a3&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:26.936757 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eea843-9a15-4a3f-bef1-72e38fc0b61c None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:26.937312 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eea843-9a15-4a3f-bef1-72e38fc0b61c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:26.937312 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eea843-9a15-4a3f-bef1-72e38fc0b61c None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:26.939012 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 506/1003] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:26.946280 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d8c94-ef5e-48ea-99ed-5a4180c7a717 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:26.946710 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d8c94-ef5e-48ea-99ed-5a4180c7a717 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:26.946829 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d8c94-ef5e-48ea-99ed-5a4180c7a717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:26.965014 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-545d8c94-ef5e-48ea-99ed-5a4180c7a717 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:26.966186 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-545d8c94-ef5e-48ea-99ed-5a4180c7a717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:26.973710 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 498/1004] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:26 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:27.000366 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eea843-9a15-4a3f-bef1-72e38fc0b61c None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:27.013024 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eea843-9a15-4a3f-bef1-72e38fc0b61c None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:27.017348 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9119eda-30c5-4422-9a21-d3d2e776cc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:27.018121 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9119eda-30c5-4422-9a21-d3d2e776cc6b admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:27.018399 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9119eda-30c5-4422-9a21-d3d2e776cc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:27.018668 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9119eda-30c5-4422-9a21-d3d2e776cc6b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:27.019829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9119eda-30c5-4422-9a21-d3d2e776cc6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:27.021557 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9119eda-30c5-4422-9a21-d3d2e776cc6b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:27.023187 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 507/1005] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:27.030436 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d8c94-ef5e-48ea-99ed-5a4180c7a717 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:27.040081 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d8c94-ef5e-48ea-99ed-5a4180c7a717 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:27.044607 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b3e97-1f60-4cb2-ba4e-ebd3882a0c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:27.045319 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b3e97-1f60-4cb2-ba4e-ebd3882a0c64 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:27.045598 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b3e97-1f60-4cb2-ba4e-ebd3882a0c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:27.045870 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b3e97-1f60-4cb2-ba4e-ebd3882a0c64 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:27.046565 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b3e97-1f60-4cb2-ba4e-ebd3882a0c64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:27.048449 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b3e97-1f60-4cb2-ba4e-ebd3882a0c64 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:27.070688 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 499/1006] 10.222.0.96 () {60 vars in 1153 bytes} [Fri Jan 28 01:45:27 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:45:29.323575 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068a76e-7196-4bef-bc5a-bb3620bca615 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:29.324138 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068a76e-7196-4bef-bc5a-bb3620bca615 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:29.324138 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068a76e-7196-4bef-bc5a-bb3620bca615 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:29.325905 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 508/1007] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:29.333364 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb856e0-836a-40d0-96b4-88a9f742d4ea None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:29.333802 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb856e0-836a-40d0-96b4-88a9f742d4ea None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:29.333894 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb856e0-836a-40d0-96b4-88a9f742d4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:29.351745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-ceb856e0-836a-40d0-96b4-88a9f742d4ea None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:29.352964 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ceb856e0-836a-40d0-96b4-88a9f742d4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:29.360449 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 500/1008] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:29 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:29.385791 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068a76e-7196-4bef-bc5a-bb3620bca615 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:29.397572 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068a76e-7196-4bef-bc5a-bb3620bca615 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:29.402488 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea13098-39da-4f38-880f-51ac6b62fe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:29.403590 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea13098-39da-4f38-880f-51ac6b62fe52 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:29.403860 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea13098-39da-4f38-880f-51ac6b62fe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:29.404125 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea13098-39da-4f38-880f-51ac6b62fe52 admin admin] PATH_INFO: `/v3/roles/fb4c25e67ee749378e33ec4843ae1dbf` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:29.405569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea13098-39da-4f38-880f-51ac6b62fe52 admin admin] RBAC: Authorizing `identity:get_role(role_id=fb4c25e67ee749378e33ec4843ae1dbf)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:29.406571 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-cea13098-39da-4f38-880f-51ac6b62fe52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:45:29.406571 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:45:29.406571 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:45:29.407419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea13098-39da-4f38-880f-51ac6b62fe52 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:29.408738 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 509/1009] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:45:29 2022] GET /identity/v3/roles/fb4c25e67ee749378e33ec4843ae1dbf => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:29.415273 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb856e0-836a-40d0-96b4-88a9f742d4ea None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:29.424086 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb856e0-836a-40d0-96b4-88a9f742d4ea None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:29.428541 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790bf36-f08a-46f8-9ce8-2afd5bdce34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:29.429510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790bf36-f08a-46f8-9ce8-2afd5bdce34f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:29.429791 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790bf36-f08a-46f8-9ce8-2afd5bdce34f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:29.430053 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790bf36-f08a-46f8-9ce8-2afd5bdce34f admin admin] PATH_INFO: `/v3/users/d5fc401c1a34498cb95ac61813a57efa` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:29.443110 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790bf36-f08a-46f8-9ce8-2afd5bdce34f admin admin] RBAC: Authorizing `identity:get_user(user_id=d5fc401c1a34498cb95ac61813a57efa)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:29.445789 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790bf36-f08a-46f8-9ce8-2afd5bdce34f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:29.447539 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 501/1010] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:45:29 2022] GET /identity/v3/users/d5fc401c1a34498cb95ac61813a57efa => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:29.453990 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea13098-39da-4f38-880f-51ac6b62fe52 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:29.464138 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea13098-39da-4f38-880f-51ac6b62fe52 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:29.468604 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca106999-2dfa-4886-ba3a-a096a8e6fb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:29.469272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca106999-2dfa-4886-ba3a-a096a8e6fb3c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:29.469551 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca106999-2dfa-4886-ba3a-a096a8e6fb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:29.469821 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca106999-2dfa-4886-ba3a-a096a8e6fb3c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:29.477972 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca106999-2dfa-4886-ba3a-a096a8e6fb3c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:29.479690 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca106999-2dfa-4886-ba3a-a096a8e6fb3c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:29.488344 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 510/1011] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:45:29 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:45:29.495041 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790bf36-f08a-46f8-9ce8-2afd5bdce34f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:29.504549 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790bf36-f08a-46f8-9ce8-2afd5bdce34f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:29.509700 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdba95e-ec59-42c3-b00b-cff1c5a51b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:29.510547 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdba95e-ec59-42c3-b00b-cff1c5a51b64 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:29.510828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdba95e-ec59-42c3-b00b-cff1c5a51b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:29.511104 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdba95e-ec59-42c3-b00b-cff1c5a51b64 admin admin] PATH_INFO: `/v3/projects/0b4a58b4778f408f901761cdbb7786a3` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:29.512268 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdba95e-ec59-42c3-b00b-cff1c5a51b64 admin admin] RBAC: Authorizing `identity:get_project(project_id=0b4a58b4778f408f901761cdbb7786a3)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:29.514326 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdba95e-ec59-42c3-b00b-cff1c5a51b64 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:29.516004 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 502/1012] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:45:29 2022] GET /identity/v3/projects/0b4a58b4778f408f901761cdbb7786a3 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:29.522809 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca106999-2dfa-4886-ba3a-a096a8e6fb3c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:29.532746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca106999-2dfa-4886-ba3a-a096a8e6fb3c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:29.537343 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33a874-0b89-4f79-9675-b4796efb4530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:29.537983 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33a874-0b89-4f79-9675-b4796efb4530 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:29.538263 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33a874-0b89-4f79-9675-b4796efb4530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:29.538534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33a874-0b89-4f79-9675-b4796efb4530 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:29.539356 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33a874-0b89-4f79-9675-b4796efb4530 admin admin] RBAC: Adding query filter params (role.id=fb4c25e67ee749378e33ec4843ae1dbf, scope.project.id=0b4a58b4778f408f901761cdbb7786a3, user.id=d5fc401c1a34498cb95ac61813a57efa) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:29.539662 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33a874-0b89-4f79-9675-b4796efb4530 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:29.541548 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33a874-0b89-4f79-9675-b4796efb4530 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:29.547173 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 511/1013] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:45:29 2022] GET /identity/v3/role_assignments?user.id=d5fc401c1a34498cb95ac61813a57efa&scope.project.id=0b4a58b4778f408f901761cdbb7786a3&role.id=fb4c25e67ee749378e33ec4843ae1dbf => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:31.723043 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95048f-288d-4b14-b631-4a6bb22a5810 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:31.723600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95048f-288d-4b14-b631-4a6bb22a5810 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:31.723600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95048f-288d-4b14-b631-4a6bb22a5810 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:31.725409 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 503/1014] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:31.733135 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a0dd9-3ba6-4f01-a2c0-e1e879be9d8e None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:31.733627 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a0dd9-3ba6-4f01-a2c0-e1e879be9d8e None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:31.733737 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a0dd9-3ba6-4f01-a2c0-e1e879be9d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:31.751472 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-238a0dd9-3ba6-4f01-a2c0-e1e879be9d8e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:31.752663 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-238a0dd9-3ba6-4f01-a2c0-e1e879be9d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:31.761016 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 512/1015] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:31 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:31.785854 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95048f-288d-4b14-b631-4a6bb22a5810 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:31.797901 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95048f-288d-4b14-b631-4a6bb22a5810 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:31.802260 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6be5b-4799-4487-bc78-063c861d330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:31.803051 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6be5b-4799-4487-bc78-063c861d330f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:31.803330 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6be5b-4799-4487-bc78-063c861d330f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:31.803605 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6be5b-4799-4487-bc78-063c861d330f admin admin] PATH_INFO: `/v3/roles/fb4c25e67ee749378e33ec4843ae1dbf` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:31.805105 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6be5b-4799-4487-bc78-063c861d330f admin admin] RBAC: Authorizing `identity:get_role(role_id=fb4c25e67ee749378e33ec4843ae1dbf)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:31.806113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING py.warnings [None req-3bb6be5b-4799-4487-bc78-063c861d330f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:45:31.806113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: warnings.warn(msg) Jan 28 01:45:31.806113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: Jan 28 01:45:31.806977 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6be5b-4799-4487-bc78-063c861d330f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:31.808305 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 504/1016] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:45:31 2022] GET /identity/v3/roles/fb4c25e67ee749378e33ec4843ae1dbf => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:31.814868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a0dd9-3ba6-4f01-a2c0-e1e879be9d8e None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:31.824254 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a0dd9-3ba6-4f01-a2c0-e1e879be9d8e None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:31.828667 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d26167-2455-4756-a82f-94a9f83ce973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:31.829545 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d26167-2455-4756-a82f-94a9f83ce973 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:31.829823 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d26167-2455-4756-a82f-94a9f83ce973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:31.830098 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d26167-2455-4756-a82f-94a9f83ce973 admin admin] PATH_INFO: `/v3/users/d5fc401c1a34498cb95ac61813a57efa` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:31.831259 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d26167-2455-4756-a82f-94a9f83ce973 admin admin] RBAC: Authorizing `identity:get_user(user_id=d5fc401c1a34498cb95ac61813a57efa)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:31.833367 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d26167-2455-4756-a82f-94a9f83ce973 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:31.834941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 513/1017] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:45:31 2022] GET /identity/v3/users/d5fc401c1a34498cb95ac61813a57efa => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:31.842077 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6be5b-4799-4487-bc78-063c861d330f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:31.851697 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6be5b-4799-4487-bc78-063c861d330f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:31.856198 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da8df7-630e-4ca5-a4e8-fb12883db728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:31.857070 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da8df7-630e-4ca5-a4e8-fb12883db728 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:31.857354 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da8df7-630e-4ca5-a4e8-fb12883db728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:31.857633 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da8df7-630e-4ca5-a4e8-fb12883db728 admin admin] PATH_INFO: `/v3/projects/0b4a58b4778f408f901761cdbb7786a3` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:31.858790 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da8df7-630e-4ca5-a4e8-fb12883db728 admin admin] RBAC: Authorizing `identity:get_project(project_id=0b4a58b4778f408f901761cdbb7786a3)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:31.860821 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da8df7-630e-4ca5-a4e8-fb12883db728 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:31.862516 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 505/1018] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:45:31 2022] GET /identity/v3/projects/0b4a58b4778f408f901761cdbb7786a3 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:31.869121 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d26167-2455-4756-a82f-94a9f83ce973 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:31.878519 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d26167-2455-4756-a82f-94a9f83ce973 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:31.883693 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2340b-8a15-4105-9eba-1b142ae998e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:31.884556 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2340b-8a15-4105-9eba-1b142ae998e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:31.884884 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2340b-8a15-4105-9eba-1b142ae998e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:31.885154 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2340b-8a15-4105-9eba-1b142ae998e2 admin admin] PATH_INFO: `/v3/projects/0b4a58b4778f408f901761cdbb7786a3/users/d5fc401c1a34498cb95ac61813a57efa/roles/fb4c25e67ee749378e33ec4843ae1dbf` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:31.887325 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2340b-8a15-4105-9eba-1b142ae998e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4a58b4778f408f901761cdbb7786a3, user_id=d5fc401c1a34498cb95ac61813a57efa, role_id=fb4c25e67ee749378e33ec4843ae1dbf)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:31.889922 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2340b-8a15-4105-9eba-1b142ae998e2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:31.904240 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 514/1019] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:45:31 2022] PUT /identity/v3/projects/0b4a58b4778f408f901761cdbb7786a3/users/d5fc401c1a34498cb95ac61813a57efa/roles/fb4c25e67ee749378e33ec4843ae1dbf => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:45:34.034317 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cd581-db15-4faa-b8cc-5edd46d7770b None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:34.034937 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cd581-db15-4faa-b8cc-5edd46d7770b None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:34.034937 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cd581-db15-4faa-b8cc-5edd46d7770b None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:34.036625 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 506/1020] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:34.044536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf97e23-a82c-4093-bf93-65f4ad0dda1a None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:34.045021 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf97e23-a82c-4093-bf93-65f4ad0dda1a None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:34.045119 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf97e23-a82c-4093-bf93-65f4ad0dda1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:34.062713 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-6cf97e23-a82c-4093-bf93-65f4ad0dda1a None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:34.063875 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-6cf97e23-a82c-4093-bf93-65f4ad0dda1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:34.117745 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 515/1021] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:34 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:45:34.141997 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cd581-db15-4faa-b8cc-5edd46d7770b None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:34.154113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cd581-db15-4faa-b8cc-5edd46d7770b None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:34.158361 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0d422-baf9-4b58-8829-b9eee6fc9a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:34.159191 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0d422-baf9-4b58-8829-b9eee6fc9a1f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:34.159469 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0d422-baf9-4b58-8829-b9eee6fc9a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:34.159742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0d422-baf9-4b58-8829-b9eee6fc9a1f admin admin] PATH_INFO: `/v3/roles/fb4c25e67ee749378e33ec4843ae1dbf` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:34.161191 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0d422-baf9-4b58-8829-b9eee6fc9a1f admin admin] RBAC: Authorizing `identity:get_role(role_id=fb4c25e67ee749378e33ec4843ae1dbf)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:34.162738 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0d422-baf9-4b58-8829-b9eee6fc9a1f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:34.164572 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 507/1022] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:45:34 2022] GET /identity/v3/roles/fb4c25e67ee749378e33ec4843ae1dbf => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:34.170701 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf97e23-a82c-4093-bf93-65f4ad0dda1a None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:34.179998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf97e23-a82c-4093-bf93-65f4ad0dda1a None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:34.184425 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd114d9b-a7c9-474c-a597-a5184d5b6b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:34.185294 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd114d9b-a7c9-474c-a597-a5184d5b6b21 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:34.185567 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd114d9b-a7c9-474c-a597-a5184d5b6b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:34.185833 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd114d9b-a7c9-474c-a597-a5184d5b6b21 admin admin] PATH_INFO: `/v3/users/d5fc401c1a34498cb95ac61813a57efa` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:34.186997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd114d9b-a7c9-474c-a597-a5184d5b6b21 admin admin] RBAC: Authorizing `identity:get_user(user_id=d5fc401c1a34498cb95ac61813a57efa)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:34.189105 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd114d9b-a7c9-474c-a597-a5184d5b6b21 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:34.190661 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 516/1023] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:45:34 2022] GET /identity/v3/users/d5fc401c1a34498cb95ac61813a57efa => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:34.196882 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0d422-baf9-4b58-8829-b9eee6fc9a1f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:34.206265 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0d422-baf9-4b58-8829-b9eee6fc9a1f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:34.211285 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c7dd8-56ed-4b21-8921-7151ca796748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:34.211903 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c7dd8-56ed-4b21-8921-7151ca796748 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:34.212181 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c7dd8-56ed-4b21-8921-7151ca796748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:34.212450 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c7dd8-56ed-4b21-8921-7151ca796748 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:34.219901 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c7dd8-56ed-4b21-8921-7151ca796748 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:34.221647 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c7dd8-56ed-4b21-8921-7151ca796748 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:34.230772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 508/1024] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:45:34 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:45:34.237139 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd114d9b-a7c9-474c-a597-a5184d5b6b21 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:34.246760 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd114d9b-a7c9-474c-a597-a5184d5b6b21 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:34.251137 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327392e8-7641-4d13-bc18-7cb2e5a7b694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:34.251951 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327392e8-7641-4d13-bc18-7cb2e5a7b694 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:34.252225 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327392e8-7641-4d13-bc18-7cb2e5a7b694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:34.252493 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327392e8-7641-4d13-bc18-7cb2e5a7b694 admin admin] PATH_INFO: `/v3/projects/0b4a58b4778f408f901761cdbb7786a3` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:34.253659 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327392e8-7641-4d13-bc18-7cb2e5a7b694 admin admin] RBAC: Authorizing `identity:get_project(project_id=0b4a58b4778f408f901761cdbb7786a3)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:34.255639 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327392e8-7641-4d13-bc18-7cb2e5a7b694 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:34.257329 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 517/1025] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:45:34 2022] GET /identity/v3/projects/0b4a58b4778f408f901761cdbb7786a3 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:34.263601 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c7dd8-56ed-4b21-8921-7151ca796748 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:34.272153 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c7dd8-56ed-4b21-8921-7151ca796748 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:34.277273 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108365d-22d7-4b7d-af41-8bb1e6c9d9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:34.278144 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108365d-22d7-4b7d-af41-8bb1e6c9d9bb admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:34.278425 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108365d-22d7-4b7d-af41-8bb1e6c9d9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:34.278697 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108365d-22d7-4b7d-af41-8bb1e6c9d9bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:34.279509 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108365d-22d7-4b7d-af41-8bb1e6c9d9bb admin admin] RBAC: Adding query filter params (role.id=fb4c25e67ee749378e33ec4843ae1dbf, scope.project.id=0b4a58b4778f408f901761cdbb7786a3, user.id=d5fc401c1a34498cb95ac61813a57efa) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:34.279818 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108365d-22d7-4b7d-af41-8bb1e6c9d9bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:34.281638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108365d-22d7-4b7d-af41-8bb1e6c9d9bb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:34.287261 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 509/1026] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:45:34 2022] GET /identity/v3/role_assignments?user.id=d5fc401c1a34498cb95ac61813a57efa&scope.project.id=0b4a58b4778f408f901761cdbb7786a3&role.id=fb4c25e67ee749378e33ec4843ae1dbf => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:36.515007 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508d306-8477-4fcb-a899-84aad7429bce None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:36.515567 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508d306-8477-4fcb-a899-84aad7429bce None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:36.515567 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508d306-8477-4fcb-a899-84aad7429bce None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:36.517368 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 518/1027] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:36.525691 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece940d-1e93-4884-bce4-8d617de1f1c3 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:36.526193 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece940d-1e93-4884-bce4-8d617de1f1c3 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:36.526293 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece940d-1e93-4884-bce4-8d617de1f1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:36.545265 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-6ece940d-1e93-4884-bce4-8d617de1f1c3 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:36.546458 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-6ece940d-1e93-4884-bce4-8d617de1f1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:36.554344 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 510/1028] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:36 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:36.579798 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508d306-8477-4fcb-a899-84aad7429bce None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:36.592275 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508d306-8477-4fcb-a899-84aad7429bce None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:36.596540 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c76ea6-6243-4bc4-ae9f-68b25c0e9b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:36.597337 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c76ea6-6243-4bc4-ae9f-68b25c0e9b1f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:36.597641 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c76ea6-6243-4bc4-ae9f-68b25c0e9b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:36.597906 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c76ea6-6243-4bc4-ae9f-68b25c0e9b1f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:36.599039 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c76ea6-6243-4bc4-ae9f-68b25c0e9b1f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:36.600693 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c76ea6-6243-4bc4-ae9f-68b25c0e9b1f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:36.603027 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 519/1029] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:36.609703 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece940d-1e93-4884-bce4-8d617de1f1c3 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:36.619130 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece940d-1e93-4884-bce4-8d617de1f1c3 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:36.624558 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f8771-9bdb-4b87-9b79-9998f5cbe663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:36.625739 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f8771-9bdb-4b87-9b79-9998f5cbe663 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:36.626247 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f8771-9bdb-4b87-9b79-9998f5cbe663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:36.626748 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f8771-9bdb-4b87-9b79-9998f5cbe663 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:36.628074 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f8771-9bdb-4b87-9b79-9998f5cbe663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:36.631825 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f8771-9bdb-4b87-9b79-9998f5cbe663 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:36.660867 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 511/1030] 10.222.0.96 () {60 vars in 1162 bytes} [Fri Jan 28 01:45:36 2022] POST /identity/v3/projects => generated 311 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:45:38.862708 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91da29-e4a7-4529-bb3d-5cbec74f8cb5 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:38.863244 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91da29-e4a7-4529-bb3d-5cbec74f8cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:38.863244 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91da29-e4a7-4529-bb3d-5cbec74f8cb5 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:38.864964 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 520/1031] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:38.873257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0471b4-599a-45f4-810d-25e55cf37a6e None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:38.873764 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0471b4-599a-45f4-810d-25e55cf37a6e None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:38.873880 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0471b4-599a-45f4-810d-25e55cf37a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:38.892769 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-db0471b4-599a-45f4-810d-25e55cf37a6e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:38.894013 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-db0471b4-599a-45f4-810d-25e55cf37a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:38.950994 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 512/1032] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:38 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:38.977067 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91da29-e4a7-4529-bb3d-5cbec74f8cb5 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:38.989327 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91da29-e4a7-4529-bb3d-5cbec74f8cb5 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:38.993811 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0826a41-ee22-44e6-a63e-dc4b644230a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:38.994577 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0826a41-ee22-44e6-a63e-dc4b644230a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:38.994853 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0826a41-ee22-44e6-a63e-dc4b644230a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:38.995119 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0826a41-ee22-44e6-a63e-dc4b644230a7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:38.996263 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0826a41-ee22-44e6-a63e-dc4b644230a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:38.997955 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0826a41-ee22-44e6-a63e-dc4b644230a7 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:38.999520 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 521/1033] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:45:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:39.005727 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0471b4-599a-45f4-810d-25e55cf37a6e None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:39.015022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0471b4-599a-45f4-810d-25e55cf37a6e None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:39.019749 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c062cd-143b-4976-bcbd-570b6407ad92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:39.020416 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c062cd-143b-4976-bcbd-570b6407ad92 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:39.020693 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c062cd-143b-4976-bcbd-570b6407ad92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:39.021000 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c062cd-143b-4976-bcbd-570b6407ad92 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:39.021709 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c062cd-143b-4976-bcbd-570b6407ad92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:39.024303 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c062cd-143b-4976-bcbd-570b6407ad92 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:39.044336 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 513/1034] 10.222.0.96 () {60 vars in 1153 bytes} [Fri Jan 28 01:45:39 2022] POST /identity/v3/users => generated 286 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:45:41.294993 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998851e5-6875-4931-b2d5-caccece8785c None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:41.295545 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998851e5-6875-4931-b2d5-caccece8785c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:41.295545 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998851e5-6875-4931-b2d5-caccece8785c None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:41.297341 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 522/1035] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:41.304562 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2449993-8aa0-44ef-b00d-5b5fc971605f None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:41.305037 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2449993-8aa0-44ef-b00d-5b5fc971605f None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:41.305142 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2449993-8aa0-44ef-b00d-5b5fc971605f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:41.322725 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-a2449993-8aa0-44ef-b00d-5b5fc971605f None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:41.323892 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-a2449993-8aa0-44ef-b00d-5b5fc971605f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:41.331349 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 514/1036] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:41 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:41.356335 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998851e5-6875-4931-b2d5-caccece8785c None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:41.368571 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998851e5-6875-4931-b2d5-caccece8785c None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:41.372954 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d8ba3-ed33-41dc-851f-db3e827905fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:41.373721 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d8ba3-ed33-41dc-851f-db3e827905fa admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:41.374000 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d8ba3-ed33-41dc-851f-db3e827905fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:41.374271 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d8ba3-ed33-41dc-851f-db3e827905fa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:41.384969 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d8ba3-ed33-41dc-851f-db3e827905fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:45:41.391580 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-455d8ba3-ed33-41dc-851f-db3e827905fa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:45:41.392738 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 523/1037] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:45:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:41.400047 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2449993-8aa0-44ef-b00d-5b5fc971605f None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:41.409163 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2449993-8aa0-44ef-b00d-5b5fc971605f None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:41.413752 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbea596-d296-42c1-8a08-572dc61f198e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:41.414481 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbea596-d296-42c1-8a08-572dc61f198e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:41.414763 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbea596-d296-42c1-8a08-572dc61f198e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:41.415038 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbea596-d296-42c1-8a08-572dc61f198e admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:41.415798 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbea596-d296-42c1-8a08-572dc61f198e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:41.416121 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbea596-d296-42c1-8a08-572dc61f198e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:41.417856 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbea596-d296-42c1-8a08-572dc61f198e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:41.426446 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 515/1038] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:45:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:41.433064 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d8ba3-ed33-41dc-851f-db3e827905fa admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:41.442954 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d8ba3-ed33-41dc-851f-db3e827905fa admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:41.448040 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd11283-2926-4142-856f-f19c7622afd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:41.449081 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd11283-2926-4142-856f-f19c7622afd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:41.449359 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd11283-2926-4142-856f-f19c7622afd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:41.449625 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd11283-2926-4142-856f-f19c7622afd0 admin admin] PATH_INFO: `/v3/users/80f8272889e841a6800faf598d676e78` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:41.462704 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd11283-2926-4142-856f-f19c7622afd0 admin admin] RBAC: Authorizing `identity:get_user(user_id=80f8272889e841a6800faf598d676e78)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:41.464842 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd11283-2926-4142-856f-f19c7622afd0 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:41.466448 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 524/1039] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:45:41 2022] GET /identity/v3/users/80f8272889e841a6800faf598d676e78 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:41.472943 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbea596-d296-42c1-8a08-572dc61f198e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:41.483394 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbea596-d296-42c1-8a08-572dc61f198e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:41.487899 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d441a-c367-4cdd-9649-1e3b5c0757a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:41.488531 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d441a-c367-4cdd-9649-1e3b5c0757a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:41.488837 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d441a-c367-4cdd-9649-1e3b5c0757a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:41.489115 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d441a-c367-4cdd-9649-1e3b5c0757a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:41.497110 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d441a-c367-4cdd-9649-1e3b5c0757a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:41.498833 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d441a-c367-4cdd-9649-1e3b5c0757a5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:41.507944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 516/1040] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:45:41 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:45:41.514556 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd11283-2926-4142-856f-f19c7622afd0 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:41.524697 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd11283-2926-4142-856f-f19c7622afd0 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:41.529479 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11efd99-f351-4ff1-94bd-7f71ca40f943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:41.530320 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11efd99-f351-4ff1-94bd-7f71ca40f943 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:41.530597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11efd99-f351-4ff1-94bd-7f71ca40f943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:41.530866 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11efd99-f351-4ff1-94bd-7f71ca40f943 admin admin] PATH_INFO: `/v3/projects/984daf2b18594b5685fcce748488ac0e` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:41.532022 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11efd99-f351-4ff1-94bd-7f71ca40f943 admin admin] RBAC: Authorizing `identity:get_project(project_id=984daf2b18594b5685fcce748488ac0e)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:41.534075 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11efd99-f351-4ff1-94bd-7f71ca40f943 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:41.535743 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 525/1041] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:45:41 2022] GET /identity/v3/projects/984daf2b18594b5685fcce748488ac0e => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:41.543020 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d441a-c367-4cdd-9649-1e3b5c0757a5 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:41.551947 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d441a-c367-4cdd-9649-1e3b5c0757a5 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:41.557437 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fbf54-7d8f-4b87-994b-07c4761eefd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:41.558073 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fbf54-7d8f-4b87-994b-07c4761eefd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:41.558352 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fbf54-7d8f-4b87-994b-07c4761eefd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:41.558699 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fbf54-7d8f-4b87-994b-07c4761eefd5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:41.559514 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fbf54-7d8f-4b87-994b-07c4761eefd5 admin admin] RBAC: Adding query filter params (role.id=253c0a1dc8d6421298a7987caaa55676, scope.project.id=984daf2b18594b5685fcce748488ac0e, user.id=80f8272889e841a6800faf598d676e78) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:41.559822 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fbf54-7d8f-4b87-994b-07c4761eefd5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:41.561664 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fbf54-7d8f-4b87-994b-07c4761eefd5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:41.566952 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 517/1042] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:45:41 2022] GET /identity/v3/role_assignments?user.id=80f8272889e841a6800faf598d676e78&scope.project.id=984daf2b18594b5685fcce748488ac0e&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:43.740853 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9b219-aa89-4cd9-8ddf-db9f7df591b8 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:43.741375 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9b219-aa89-4cd9-8ddf-db9f7df591b8 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:43.741375 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9b219-aa89-4cd9-8ddf-db9f7df591b8 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:43.743277 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 526/1043] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:43.750385 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc87f6-b313-4ba3-8c45-495f9f4431c8 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:43.750780 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc87f6-b313-4ba3-8c45-495f9f4431c8 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:43.750929 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc87f6-b313-4ba3-8c45-495f9f4431c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:43.768721 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-b2dc87f6-b313-4ba3-8c45-495f9f4431c8 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:43.769914 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b2dc87f6-b313-4ba3-8c45-495f9f4431c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:43.778446 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 518/1044] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:43 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:43.801402 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9b219-aa89-4cd9-8ddf-db9f7df591b8 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:43.813086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9b219-aa89-4cd9-8ddf-db9f7df591b8 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:43.817330 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145f0bd-ae48-4237-8077-60cd07cfda3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:43.818082 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145f0bd-ae48-4237-8077-60cd07cfda3a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:43.818355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145f0bd-ae48-4237-8077-60cd07cfda3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:43.818620 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145f0bd-ae48-4237-8077-60cd07cfda3a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:43.828777 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145f0bd-ae48-4237-8077-60cd07cfda3a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:45:43.835325 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-4145f0bd-ae48-4237-8077-60cd07cfda3a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:45:43.837012 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 527/1045] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:45:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:43.843189 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc87f6-b313-4ba3-8c45-495f9f4431c8 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:43.851831 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc87f6-b313-4ba3-8c45-495f9f4431c8 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:43.856288 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025fa7b-80a9-4963-bbff-042e90eab126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:43.856967 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025fa7b-80a9-4963-bbff-042e90eab126 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:43.857248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025fa7b-80a9-4963-bbff-042e90eab126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:43.857519 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025fa7b-80a9-4963-bbff-042e90eab126 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:43.858250 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025fa7b-80a9-4963-bbff-042e90eab126 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:43.858552 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025fa7b-80a9-4963-bbff-042e90eab126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:43.860108 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025fa7b-80a9-4963-bbff-042e90eab126 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:43.868134 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 519/1046] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:45:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:43.874298 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145f0bd-ae48-4237-8077-60cd07cfda3a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:43.884923 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145f0bd-ae48-4237-8077-60cd07cfda3a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:43.889361 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ddd01-db2c-417c-af62-02921cb614fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:43.890182 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ddd01-db2c-417c-af62-02921cb614fc admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:43.890461 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ddd01-db2c-417c-af62-02921cb614fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:43.890731 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ddd01-db2c-417c-af62-02921cb614fc admin admin] PATH_INFO: `/v3/users/80f8272889e841a6800faf598d676e78` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:43.891874 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ddd01-db2c-417c-af62-02921cb614fc admin admin] RBAC: Authorizing `identity:get_user(user_id=80f8272889e841a6800faf598d676e78)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:43.893984 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ddd01-db2c-417c-af62-02921cb614fc admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:43.895688 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 528/1047] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:45:43 2022] GET /identity/v3/users/80f8272889e841a6800faf598d676e78 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:43.902017 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025fa7b-80a9-4963-bbff-042e90eab126 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:43.911547 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025fa7b-80a9-4963-bbff-042e90eab126 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:43.916068 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112e329-e998-4157-bc0b-b972a92aa8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:43.916914 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112e329-e998-4157-bc0b-b972a92aa8bc admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:43.917197 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112e329-e998-4157-bc0b-b972a92aa8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:43.917469 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112e329-e998-4157-bc0b-b972a92aa8bc admin admin] PATH_INFO: `/v3/projects/984daf2b18594b5685fcce748488ac0e` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:43.918615 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112e329-e998-4157-bc0b-b972a92aa8bc admin admin] RBAC: Authorizing `identity:get_project(project_id=984daf2b18594b5685fcce748488ac0e)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:43.920605 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112e329-e998-4157-bc0b-b972a92aa8bc admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:43.922394 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 520/1048] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:45:43 2022] GET /identity/v3/projects/984daf2b18594b5685fcce748488ac0e => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:43.928227 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ddd01-db2c-417c-af62-02921cb614fc admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:43.938356 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ddd01-db2c-417c-af62-02921cb614fc admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:43.942867 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225268f4-0cdb-4cdb-999b-5891515ece7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:43.943729 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225268f4-0cdb-4cdb-999b-5891515ece7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:43.944008 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225268f4-0cdb-4cdb-999b-5891515ece7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:43.944280 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225268f4-0cdb-4cdb-999b-5891515ece7c admin admin] PATH_INFO: `/v3/projects/984daf2b18594b5685fcce748488ac0e/users/80f8272889e841a6800faf598d676e78/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:43.947196 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225268f4-0cdb-4cdb-999b-5891515ece7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=984daf2b18594b5685fcce748488ac0e, user_id=80f8272889e841a6800faf598d676e78, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:43.949871 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225268f4-0cdb-4cdb-999b-5891515ece7c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:43.962699 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 529/1049] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:45:43 2022] PUT /identity/v3/projects/984daf2b18594b5685fcce748488ac0e/users/80f8272889e841a6800faf598d676e78/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:45:46.161007 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26461144-57f2-45a9-b81e-0ea646962abe None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:46.161541 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26461144-57f2-45a9-b81e-0ea646962abe None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:46.161541 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26461144-57f2-45a9-b81e-0ea646962abe None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:46.163419 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 521/1050] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:46.171618 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0e8f7-5dc6-47b4-a5cc-ff405272e064 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:46.172039 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0e8f7-5dc6-47b4-a5cc-ff405272e064 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:46.172158 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0e8f7-5dc6-47b4-a5cc-ff405272e064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:46.190331 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-b7f0e8f7-5dc6-47b4-a5cc-ff405272e064 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:46.191491 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b7f0e8f7-5dc6-47b4-a5cc-ff405272e064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:46.245824 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 530/1051] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:46 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:46.270330 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26461144-57f2-45a9-b81e-0ea646962abe None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:46.283157 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26461144-57f2-45a9-b81e-0ea646962abe None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:46.287433 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67bb45-6ed6-43f2-bdf9-ad029c9de0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:46.288192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67bb45-6ed6-43f2-bdf9-ad029c9de0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:46.288605 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67bb45-6ed6-43f2-bdf9-ad029c9de0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:46.289418 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67bb45-6ed6-43f2-bdf9-ad029c9de0b1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:46.299233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67bb45-6ed6-43f2-bdf9-ad029c9de0b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:45:46.305852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-9f67bb45-6ed6-43f2-bdf9-ad029c9de0b1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:45:46.306958 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 522/1052] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:45:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:46.313284 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0e8f7-5dc6-47b4-a5cc-ff405272e064 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:46.321825 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0e8f7-5dc6-47b4-a5cc-ff405272e064 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:46.326219 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd880e5-3943-4c96-9c1c-75dd47cd30e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:46.326853 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd880e5-3943-4c96-9c1c-75dd47cd30e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:46.327127 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd880e5-3943-4c96-9c1c-75dd47cd30e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:46.327397 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd880e5-3943-4c96-9c1c-75dd47cd30e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:46.328116 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd880e5-3943-4c96-9c1c-75dd47cd30e1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:46.328416 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd880e5-3943-4c96-9c1c-75dd47cd30e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:46.330020 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd880e5-3943-4c96-9c1c-75dd47cd30e1 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:46.338474 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 531/1053] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:45:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:46.344559 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67bb45-6ed6-43f2-bdf9-ad029c9de0b1 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:46.355112 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67bb45-6ed6-43f2-bdf9-ad029c9de0b1 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:46.359591 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1c9c6-0753-409d-a0d0-4fcab6cd99cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:46.360423 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1c9c6-0753-409d-a0d0-4fcab6cd99cf admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:46.360698 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1c9c6-0753-409d-a0d0-4fcab6cd99cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:46.360997 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1c9c6-0753-409d-a0d0-4fcab6cd99cf admin admin] PATH_INFO: `/v3/users/80f8272889e841a6800faf598d676e78` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:46.362172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1c9c6-0753-409d-a0d0-4fcab6cd99cf admin admin] RBAC: Authorizing `identity:get_user(user_id=80f8272889e841a6800faf598d676e78)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:46.364257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1c9c6-0753-409d-a0d0-4fcab6cd99cf admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:46.365849 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 523/1054] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:45:46 2022] GET /identity/v3/users/80f8272889e841a6800faf598d676e78 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:46.372381 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd880e5-3943-4c96-9c1c-75dd47cd30e1 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:46.381867 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd880e5-3943-4c96-9c1c-75dd47cd30e1 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:46.386565 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed1f7f-fd35-46d3-b2a8-87f30460ab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:46.387188 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed1f7f-fd35-46d3-b2a8-87f30460ab2b admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:46.387461 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed1f7f-fd35-46d3-b2a8-87f30460ab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:46.387728 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed1f7f-fd35-46d3-b2a8-87f30460ab2b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:46.395302 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed1f7f-fd35-46d3-b2a8-87f30460ab2b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:46.397046 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed1f7f-fd35-46d3-b2a8-87f30460ab2b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:46.406344 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 532/1055] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:45:46 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:45:46.413410 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1c9c6-0753-409d-a0d0-4fcab6cd99cf admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:46.423965 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1c9c6-0753-409d-a0d0-4fcab6cd99cf admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:46.428443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957491d-07f0-4f00-afb0-17e50f0ea67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:46.429777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957491d-07f0-4f00-afb0-17e50f0ea67f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:46.430056 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957491d-07f0-4f00-afb0-17e50f0ea67f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:46.430318 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957491d-07f0-4f00-afb0-17e50f0ea67f admin admin] PATH_INFO: `/v3/projects/984daf2b18594b5685fcce748488ac0e` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:46.431491 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957491d-07f0-4f00-afb0-17e50f0ea67f admin admin] RBAC: Authorizing `identity:get_project(project_id=984daf2b18594b5685fcce748488ac0e)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:46.433536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957491d-07f0-4f00-afb0-17e50f0ea67f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:46.435151 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 524/1056] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:45:46 2022] GET /identity/v3/projects/984daf2b18594b5685fcce748488ac0e => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:46.441612 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed1f7f-fd35-46d3-b2a8-87f30460ab2b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:46.450123 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed1f7f-fd35-46d3-b2a8-87f30460ab2b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:46.454584 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565b2af-50c9-4763-a36d-3bc25541867f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:46.455193 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565b2af-50c9-4763-a36d-3bc25541867f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:46.455467 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565b2af-50c9-4763-a36d-3bc25541867f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:46.455734 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565b2af-50c9-4763-a36d-3bc25541867f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:46.456529 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565b2af-50c9-4763-a36d-3bc25541867f admin admin] RBAC: Adding query filter params (role.id=253c0a1dc8d6421298a7987caaa55676, scope.project.id=984daf2b18594b5685fcce748488ac0e, user.id=80f8272889e841a6800faf598d676e78) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:46.456868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565b2af-50c9-4763-a36d-3bc25541867f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:46.458646 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565b2af-50c9-4763-a36d-3bc25541867f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:46.464642 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 533/1057] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:45:46 2022] GET /identity/v3/role_assignments?user.id=80f8272889e841a6800faf598d676e78&scope.project.id=984daf2b18594b5685fcce748488ac0e&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:48.631062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f9124-5f23-4839-8a8e-6f6e49733b35 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:48.631570 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f9124-5f23-4839-8a8e-6f6e49733b35 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:48.631656 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f9124-5f23-4839-8a8e-6f6e49733b35 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:48.633404 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 525/1058] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:48.640541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64720020-fe6b-4abb-9502-c28980f9012d None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:48.640966 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64720020-fe6b-4abb-9502-c28980f9012d None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:48.641105 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64720020-fe6b-4abb-9502-c28980f9012d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:48.659039 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-64720020-fe6b-4abb-9502-c28980f9012d None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:48.660197 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-64720020-fe6b-4abb-9502-c28980f9012d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:48.668266 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 534/1059] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:48 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:48.691589 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f9124-5f23-4839-8a8e-6f6e49733b35 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:48.704213 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f9124-5f23-4839-8a8e-6f6e49733b35 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:48.708549 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a4ee3-dc20-47ce-b08a-dcd5bfe579af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:48.709200 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a4ee3-dc20-47ce-b08a-dcd5bfe579af admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:48.709482 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a4ee3-dc20-47ce-b08a-dcd5bfe579af admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:48.709764 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a4ee3-dc20-47ce-b08a-dcd5bfe579af admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:48.717934 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a4ee3-dc20-47ce-b08a-dcd5bfe579af admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:48.719663 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a4ee3-dc20-47ce-b08a-dcd5bfe579af admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:48.729081 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 526/1060] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:45:48 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:45:48.735701 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64720020-fe6b-4abb-9502-c28980f9012d None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:48.744619 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64720020-fe6b-4abb-9502-c28980f9012d None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:48.749111 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa3288-fae6-4a80-9e0c-e3acfe1c2f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:48.749881 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa3288-fae6-4a80-9e0c-e3acfe1c2f02 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:48.750151 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa3288-fae6-4a80-9e0c-e3acfe1c2f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:48.750412 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa3288-fae6-4a80-9e0c-e3acfe1c2f02 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:48.757020 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa3288-fae6-4a80-9e0c-e3acfe1c2f02 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:48.759225 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa3288-fae6-4a80-9e0c-e3acfe1c2f02 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:48.772179 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-adfa3288-fae6-4a80-9e0c-e3acfe1c2f02 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jan 28 01:45:48.773913 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 535/1061] 10.222.0.96 () {56 vars in 1138 bytes} [Fri Jan 28 01:45:48 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:45:48.780566 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a4ee3-dc20-47ce-b08a-dcd5bfe579af admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:48.789856 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a4ee3-dc20-47ce-b08a-dcd5bfe579af admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:48.794544 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd117ef-98fe-4f46-9618-a6f8dcfdc84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:48.795180 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd117ef-98fe-4f46-9618-a6f8dcfdc84b admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:48.795461 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd117ef-98fe-4f46-9618-a6f8dcfdc84b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:48.795735 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd117ef-98fe-4f46-9618-a6f8dcfdc84b admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:48.796442 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd117ef-98fe-4f46-9618-a6f8dcfdc84b admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:48.796747 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd117ef-98fe-4f46-9618-a6f8dcfdc84b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:48.798331 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd117ef-98fe-4f46-9618-a6f8dcfdc84b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:48.805913 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 527/1062] 10.222.0.96 () {56 vars in 1136 bytes} [Fri Jan 28 01:45:48 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:50.946647 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ed4d0-a103-4068-95fa-0eec356a74b4 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:50.947166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ed4d0-a103-4068-95fa-0eec356a74b4 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:50.947166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ed4d0-a103-4068-95fa-0eec356a74b4 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:50.949063 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 536/1063] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:45:50.956651 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd52e2-8a1c-4036-80e6-cc71719b25b1 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:50.957114 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd52e2-8a1c-4036-80e6-cc71719b25b1 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:50.957237 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd52e2-8a1c-4036-80e6-cc71719b25b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:50.975597 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-b5fd52e2-8a1c-4036-80e6-cc71719b25b1 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:50.977781 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b5fd52e2-8a1c-4036-80e6-cc71719b25b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:50.985464 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 528/1064] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:50 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:51.011058 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ed4d0-a103-4068-95fa-0eec356a74b4 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:51.023790 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ed4d0-a103-4068-95fa-0eec356a74b4 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:51.028834 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908881e-b4fb-4161-bc3f-fd04b67bb83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:51.029478 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908881e-b4fb-4161-bc3f-fd04b67bb83e admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:51.029759 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908881e-b4fb-4161-bc3f-fd04b67bb83e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:51.030031 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908881e-b4fb-4161-bc3f-fd04b67bb83e admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:51.030757 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908881e-b4fb-4161-bc3f-fd04b67bb83e admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:51.031827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-8908881e-b4fb-4161-bc3f-fd04b67bb83e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:45:51.031827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:45:51.031827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:45:51.032788 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908881e-b4fb-4161-bc3f-fd04b67bb83e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:51.055787 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 537/1065] 10.222.0.96 () {60 vars in 1159 bytes} [Fri Jan 28 01:45:51 2022] POST /identity/v3/domains => generated 267 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:45:53.578975 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966962c-e6f5-4706-a679-4c998da118fa None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:53.579512 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966962c-e6f5-4706-a679-4c998da118fa None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:53.579512 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966962c-e6f5-4706-a679-4c998da118fa None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:53.581341 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 529/1066] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:53.589407 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cbab7-3811-4308-916a-100a701fcf66 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:53.589878 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cbab7-3811-4308-916a-100a701fcf66 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:53.590010 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cbab7-3811-4308-916a-100a701fcf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:53.609652 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-914cbab7-3811-4308-916a-100a701fcf66 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:53.610826 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-914cbab7-3811-4308-916a-100a701fcf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:53.669125 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 538/1067] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:53 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:53.694446 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966962c-e6f5-4706-a679-4c998da118fa None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:53.706709 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966962c-e6f5-4706-a679-4c998da118fa None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:53.711887 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639f4df-cf32-40fd-9905-46eb36dc7e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:53.712726 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639f4df-cf32-40fd-9905-46eb36dc7e37 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:53.713036 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639f4df-cf32-40fd-9905-46eb36dc7e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:53.713310 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639f4df-cf32-40fd-9905-46eb36dc7e37 admin admin] PATH_INFO: `/v3/domains/cb2fa40e713f4cb4a4a6c06f4e9d318c` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:53.724400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639f4df-cf32-40fd-9905-46eb36dc7e37 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=cb2fa40e713f4cb4a4a6c06f4e9d318c)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:53.727312 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639f4df-cf32-40fd-9905-46eb36dc7e37 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:53.729034 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 530/1068] 10.222.0.96 () {56 vars in 1204 bytes} [Fri Jan 28 01:45:53 2022] GET /identity/v3/domains/cb2fa40e713f4cb4a4a6c06f4e9d318c => generated 267 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:53.735560 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cbab7-3811-4308-916a-100a701fcf66 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:53.744379 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cbab7-3811-4308-916a-100a701fcf66 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:53.748810 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930496f-48a7-4b8c-92e2-19edc0fd608f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:53.749453 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930496f-48a7-4b8c-92e2-19edc0fd608f admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:53.749726 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930496f-48a7-4b8c-92e2-19edc0fd608f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:53.750016 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930496f-48a7-4b8c-92e2-19edc0fd608f admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:53.750708 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930496f-48a7-4b8c-92e2-19edc0fd608f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:53.752574 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930496f-48a7-4b8c-92e2-19edc0fd608f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:53.778254 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 539/1069] 10.222.0.96 () {60 vars in 1162 bytes} [Fri Jan 28 01:45:53 2022] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:45:56.036607 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e501b-a5b7-4a7c-bf85-0d60b7d5776b None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:56.037228 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e501b-a5b7-4a7c-bf85-0d60b7d5776b None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:56.037228 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e501b-a5b7-4a7c-bf85-0d60b7d5776b None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:56.039019 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 531/1070] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:56.046433 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e528f4d-cf7d-430e-83a7-0fd5a82b3b96 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:56.046851 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e528f4d-cf7d-430e-83a7-0fd5a82b3b96 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:56.046980 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e528f4d-cf7d-430e-83a7-0fd5a82b3b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:56.065467 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-1e528f4d-cf7d-430e-83a7-0fd5a82b3b96 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:56.066649 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-1e528f4d-cf7d-430e-83a7-0fd5a82b3b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:56.122484 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 540/1071] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:56 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:56.148525 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e501b-a5b7-4a7c-bf85-0d60b7d5776b None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:56.160934 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e501b-a5b7-4a7c-bf85-0d60b7d5776b None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:56.165400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a93e2-2e04-4a2e-8faf-354d56d1c1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:56.166234 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a93e2-2e04-4a2e-8faf-354d56d1c1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:56.166515 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a93e2-2e04-4a2e-8faf-354d56d1c1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:56.166787 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a93e2-2e04-4a2e-8faf-354d56d1c1f9 admin admin] PATH_INFO: `/v3/domains/cb2fa40e713f4cb4a4a6c06f4e9d318c` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:56.167954 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a93e2-2e04-4a2e-8faf-354d56d1c1f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=cb2fa40e713f4cb4a4a6c06f4e9d318c)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:56.169923 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a93e2-2e04-4a2e-8faf-354d56d1c1f9 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:56.171511 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 532/1072] 10.222.0.96 () {56 vars in 1204 bytes} [Fri Jan 28 01:45:56 2022] GET /identity/v3/domains/cb2fa40e713f4cb4a4a6c06f4e9d318c => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:56.178101 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e528f4d-cf7d-430e-83a7-0fd5a82b3b96 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:56.187567 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e528f4d-cf7d-430e-83a7-0fd5a82b3b96 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:56.192067 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee78036-8f4c-46ed-8865-43828f197481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:56.192719 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee78036-8f4c-46ed-8865-43828f197481 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:56.193042 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee78036-8f4c-46ed-8865-43828f197481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:56.193417 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee78036-8f4c-46ed-8865-43828f197481 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:56.194505 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee78036-8f4c-46ed-8865-43828f197481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:56.197253 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee78036-8f4c-46ed-8865-43828f197481 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:56.217131 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 541/1073] 10.222.0.96 () {60 vars in 1153 bytes} [Fri Jan 28 01:45:56 2022] POST /identity/v3/users => generated 311 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:45:58.447262 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2750caf-376f-47b0-a6ad-9fd843da0d43 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:58.447826 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2750caf-376f-47b0-a6ad-9fd843da0d43 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:58.447826 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2750caf-376f-47b0-a6ad-9fd843da0d43 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:58.449595 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 533/1074] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:45:58.457270 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31061e07-3244-4488-8c0d-3fe423c4601f None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:58.457722 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31061e07-3244-4488-8c0d-3fe423c4601f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:58.457849 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31061e07-3244-4488-8c0d-3fe423c4601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:58.475783 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-31061e07-3244-4488-8c0d-3fe423c4601f None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:45:58.477130 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-31061e07-3244-4488-8c0d-3fe423c4601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:45:58.484992 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 542/1075] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:45:58 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:45:58.511059 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2750caf-376f-47b0-a6ad-9fd843da0d43 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:58.523055 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2750caf-376f-47b0-a6ad-9fd843da0d43 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:58.527412 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8a36a-fc12-414c-8400-b0eaf4a7df1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:58.528180 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a36a-fc12-414c-8400-b0eaf4a7df1b admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:58.528463 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a36a-fc12-414c-8400-b0eaf4a7df1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:58.529029 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a36a-fc12-414c-8400-b0eaf4a7df1b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:58.539628 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8a36a-fc12-414c-8400-b0eaf4a7df1b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:45:58.546347 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-e1c8a36a-fc12-414c-8400-b0eaf4a7df1b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:45:58.547511 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 534/1076] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:45:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:45:58.554283 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31061e07-3244-4488-8c0d-3fe423c4601f None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:58.564823 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31061e07-3244-4488-8c0d-3fe423c4601f None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:58.569336 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fe64c-cc76-4137-bc39-fe80c16ab355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:58.569983 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fe64c-cc76-4137-bc39-fe80c16ab355 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:58.570259 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fe64c-cc76-4137-bc39-fe80c16ab355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:58.570528 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fe64c-cc76-4137-bc39-fe80c16ab355 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:58.571261 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fe64c-cc76-4137-bc39-fe80c16ab355 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:58.571560 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fe64c-cc76-4137-bc39-fe80c16ab355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:58.573167 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fe64c-cc76-4137-bc39-fe80c16ab355 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:58.581238 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 543/1077] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:45:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:58.588453 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8a36a-fc12-414c-8400-b0eaf4a7df1b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:58.598105 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8a36a-fc12-414c-8400-b0eaf4a7df1b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:58.602743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b576aeb-ea49-49dd-97ae-fa9b5035f3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:58.603588 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b576aeb-ea49-49dd-97ae-fa9b5035f3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:58.603869 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b576aeb-ea49-49dd-97ae-fa9b5035f3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:58.604141 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b576aeb-ea49-49dd-97ae-fa9b5035f3c4 admin admin] PATH_INFO: `/v3/users/a7e854b856dc470396d4bb14982283c7` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:58.617332 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b576aeb-ea49-49dd-97ae-fa9b5035f3c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=a7e854b856dc470396d4bb14982283c7)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:58.619435 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b576aeb-ea49-49dd-97ae-fa9b5035f3c4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:58.621083 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 535/1078] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:45:58 2022] GET /identity/v3/users/a7e854b856dc470396d4bb14982283c7 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:58.628041 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fe64c-cc76-4137-bc39-fe80c16ab355 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:58.639699 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fe64c-cc76-4137-bc39-fe80c16ab355 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:58.644746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2379603-2b4c-4222-9635-87a89d46907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:58.645440 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2379603-2b4c-4222-9635-87a89d46907f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:58.645870 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2379603-2b4c-4222-9635-87a89d46907f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:58.646182 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2379603-2b4c-4222-9635-87a89d46907f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:58.655236 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2379603-2b4c-4222-9635-87a89d46907f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:58.656986 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2379603-2b4c-4222-9635-87a89d46907f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:58.666059 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 544/1079] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:45:58 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:45:58.673675 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b576aeb-ea49-49dd-97ae-fa9b5035f3c4 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:58.683708 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b576aeb-ea49-49dd-97ae-fa9b5035f3c4 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:58.688222 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292c0d8-4a03-416f-aab1-31e3b5ed9954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:58.689094 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292c0d8-4a03-416f-aab1-31e3b5ed9954 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:58.689372 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292c0d8-4a03-416f-aab1-31e3b5ed9954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:58.689644 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292c0d8-4a03-416f-aab1-31e3b5ed9954 admin admin] PATH_INFO: `/v3/projects/b3d292f6183d478783a4a9c0964b9cc3` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:58.690801 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292c0d8-4a03-416f-aab1-31e3b5ed9954 admin admin] RBAC: Authorizing `identity:get_project(project_id=b3d292f6183d478783a4a9c0964b9cc3)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:58.692837 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292c0d8-4a03-416f-aab1-31e3b5ed9954 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:58.694468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 536/1080] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:45:58 2022] GET /identity/v3/projects/b3d292f6183d478783a4a9c0964b9cc3 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:45:58.702079 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2379603-2b4c-4222-9635-87a89d46907f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:45:58.711117 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2379603-2b4c-4222-9635-87a89d46907f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:45:58.715644 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e091e00-e407-40dc-8a1b-989de50d7ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:45:58.716264 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e091e00-e407-40dc-8a1b-989de50d7ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:58.716541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e091e00-e407-40dc-8a1b-989de50d7ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:58.716834 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e091e00-e407-40dc-8a1b-989de50d7ae1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:58.717644 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e091e00-e407-40dc-8a1b-989de50d7ae1 admin admin] RBAC: Adding query filter params (role.id=253c0a1dc8d6421298a7987caaa55676, scope.project.id=b3d292f6183d478783a4a9c0964b9cc3, user.id=a7e854b856dc470396d4bb14982283c7) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:45:58.717948 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e091e00-e407-40dc-8a1b-989de50d7ae1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:45:58.719742 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e091e00-e407-40dc-8a1b-989de50d7ae1 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:45:58.725062 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 545/1081] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:45:58 2022] GET /identity/v3/role_assignments?user.id=a7e854b856dc470396d4bb14982283c7&scope.project.id=b3d292f6183d478783a4a9c0964b9cc3&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:00.888498 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce768809-d519-4e17-bca0-c0a114019844 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:00.889178 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce768809-d519-4e17-bca0-c0a114019844 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:00.889178 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce768809-d519-4e17-bca0-c0a114019844 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:00.890757 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 537/1082] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:00.898583 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f134abe-641d-47dc-ac5f-92548d824bb0 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:00.899018 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f134abe-641d-47dc-ac5f-92548d824bb0 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:00.899207 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f134abe-641d-47dc-ac5f-92548d824bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:00.917120 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-0f134abe-641d-47dc-ac5f-92548d824bb0 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:00.918289 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-0f134abe-641d-47dc-ac5f-92548d824bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:00.925725 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 546/1083] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:00 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:00.949121 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce768809-d519-4e17-bca0-c0a114019844 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:00.961417 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce768809-d519-4e17-bca0-c0a114019844 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:00.965746 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920ce41-c61d-4233-9527-469591e061f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:00.966512 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920ce41-c61d-4233-9527-469591e061f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:00.966792 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920ce41-c61d-4233-9527-469591e061f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:00.967062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920ce41-c61d-4233-9527-469591e061f6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:00.977527 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920ce41-c61d-4233-9527-469591e061f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:00.984131 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-4920ce41-c61d-4233-9527-469591e061f6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:46:00.985279 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 538/1084] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:46:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:00.992216 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f134abe-641d-47dc-ac5f-92548d824bb0 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:01.000943 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f134abe-641d-47dc-ac5f-92548d824bb0 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:01.005389 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131549d8-b92e-4698-8d18-98a96d7cf55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:01.006031 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131549d8-b92e-4698-8d18-98a96d7cf55a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:01.006307 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131549d8-b92e-4698-8d18-98a96d7cf55a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:01.006577 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131549d8-b92e-4698-8d18-98a96d7cf55a admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:01.007750 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131549d8-b92e-4698-8d18-98a96d7cf55a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:01.008064 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131549d8-b92e-4698-8d18-98a96d7cf55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:01.009665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131549d8-b92e-4698-8d18-98a96d7cf55a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:01.017683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 547/1085] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:01.025074 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920ce41-c61d-4233-9527-469591e061f6 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:01.035256 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920ce41-c61d-4233-9527-469591e061f6 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:01.040366 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8e8d3-8338-47eb-9c31-e817a26efb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:01.041226 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8e8d3-8338-47eb-9c31-e817a26efb9d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:01.041503 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8e8d3-8338-47eb-9c31-e817a26efb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:01.041772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8e8d3-8338-47eb-9c31-e817a26efb9d admin admin] PATH_INFO: `/v3/users/a7e854b856dc470396d4bb14982283c7` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:01.042934 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8e8d3-8338-47eb-9c31-e817a26efb9d admin admin] RBAC: Authorizing `identity:get_user(user_id=a7e854b856dc470396d4bb14982283c7)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:01.045043 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8e8d3-8338-47eb-9c31-e817a26efb9d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:01.046597 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 539/1086] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:01 2022] GET /identity/v3/users/a7e854b856dc470396d4bb14982283c7 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:01.052786 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131549d8-b92e-4698-8d18-98a96d7cf55a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:01.062798 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131549d8-b92e-4698-8d18-98a96d7cf55a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:01.067180 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cec55-ae7c-4d40-be7b-64b82fd4d45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:01.068005 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cec55-ae7c-4d40-be7b-64b82fd4d45f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:01.068281 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cec55-ae7c-4d40-be7b-64b82fd4d45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:01.068551 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cec55-ae7c-4d40-be7b-64b82fd4d45f admin admin] PATH_INFO: `/v3/projects/b3d292f6183d478783a4a9c0964b9cc3` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:01.070303 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cec55-ae7c-4d40-be7b-64b82fd4d45f admin admin] RBAC: Authorizing `identity:get_project(project_id=b3d292f6183d478783a4a9c0964b9cc3)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:01.072293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cec55-ae7c-4d40-be7b-64b82fd4d45f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:01.073936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 548/1087] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:01 2022] GET /identity/v3/projects/b3d292f6183d478783a4a9c0964b9cc3 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:01.080079 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8e8d3-8338-47eb-9c31-e817a26efb9d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:01.089343 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8e8d3-8338-47eb-9c31-e817a26efb9d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:01.093781 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120291f-fcdc-4793-b3c4-0d2b5084aa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:01.094627 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120291f-fcdc-4793-b3c4-0d2b5084aa46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:01.094906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120291f-fcdc-4793-b3c4-0d2b5084aa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:01.095176 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120291f-fcdc-4793-b3c4-0d2b5084aa46 admin admin] PATH_INFO: `/v3/projects/b3d292f6183d478783a4a9c0964b9cc3/users/a7e854b856dc470396d4bb14982283c7/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:01.097113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120291f-fcdc-4793-b3c4-0d2b5084aa46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d292f6183d478783a4a9c0964b9cc3, user_id=a7e854b856dc470396d4bb14982283c7, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:01.099657 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120291f-fcdc-4793-b3c4-0d2b5084aa46 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:01.112227 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 540/1088] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:46:01 2022] PUT /identity/v3/projects/b3d292f6183d478783a4a9c0964b9cc3/users/a7e854b856dc470396d4bb14982283c7/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:46:03.279243 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dac20-9a28-41b6-a9d7-a199081dfa6e None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:03.279775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dac20-9a28-41b6-a9d7-a199081dfa6e None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:03.279775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dac20-9a28-41b6-a9d7-a199081dfa6e None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:03.281589 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 549/1089] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:03.289745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722c365-b7a7-400a-a14a-f2325a6d6a51 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:03.290175 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722c365-b7a7-400a-a14a-f2325a6d6a51 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:03.290298 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722c365-b7a7-400a-a14a-f2325a6d6a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:03.307748 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-1722c365-b7a7-400a-a14a-f2325a6d6a51 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:03.308972 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1722c365-b7a7-400a-a14a-f2325a6d6a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:03.363891 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 541/1090] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:03 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:03.388901 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389dac20-9a28-41b6-a9d7-a199081dfa6e None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:03.401426 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389dac20-9a28-41b6-a9d7-a199081dfa6e None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:03.405983 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6938ef5-09f2-4618-8185-06d5210d7299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:03.406752 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6938ef5-09f2-4618-8185-06d5210d7299 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:03.407026 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6938ef5-09f2-4618-8185-06d5210d7299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:03.407294 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6938ef5-09f2-4618-8185-06d5210d7299 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:03.418348 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6938ef5-09f2-4618-8185-06d5210d7299 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:03.425216 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-b6938ef5-09f2-4618-8185-06d5210d7299 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:46:03.426405 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 550/1091] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:46:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:03.433357 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722c365-b7a7-400a-a14a-f2325a6d6a51 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:03.442232 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722c365-b7a7-400a-a14a-f2325a6d6a51 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:03.446968 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d19567-01d7-4a8b-aef1-b3f9138428b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:03.447622 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d19567-01d7-4a8b-aef1-b3f9138428b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:03.447903 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d19567-01d7-4a8b-aef1-b3f9138428b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:03.448178 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d19567-01d7-4a8b-aef1-b3f9138428b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:03.448953 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d19567-01d7-4a8b-aef1-b3f9138428b2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:03.449260 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d19567-01d7-4a8b-aef1-b3f9138428b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:03.450851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d19567-01d7-4a8b-aef1-b3f9138428b2 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:03.459277 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 542/1092] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:03.466227 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6938ef5-09f2-4618-8185-06d5210d7299 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:03.476846 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6938ef5-09f2-4618-8185-06d5210d7299 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:03.481341 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddffe9-f9dd-4aaa-8d08-767e0486a777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:03.482182 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddffe9-f9dd-4aaa-8d08-767e0486a777 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:03.482457 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddffe9-f9dd-4aaa-8d08-767e0486a777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:03.482724 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddffe9-f9dd-4aaa-8d08-767e0486a777 admin admin] PATH_INFO: `/v3/users/a7e854b856dc470396d4bb14982283c7` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:03.483877 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bddffe9-f9dd-4aaa-8d08-767e0486a777 admin admin] RBAC: Authorizing `identity:get_user(user_id=a7e854b856dc470396d4bb14982283c7)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:03.486012 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bddffe9-f9dd-4aaa-8d08-767e0486a777 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:03.487602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 551/1093] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:03 2022] GET /identity/v3/users/a7e854b856dc470396d4bb14982283c7 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:03.494924 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d19567-01d7-4a8b-aef1-b3f9138428b2 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:03.504453 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d19567-01d7-4a8b-aef1-b3f9138428b2 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:03.509773 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6c1ec-bd66-48ca-8cc3-799b1047524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:03.510409 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6c1ec-bd66-48ca-8cc3-799b1047524f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:03.510689 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6c1ec-bd66-48ca-8cc3-799b1047524f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:03.510962 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6c1ec-bd66-48ca-8cc3-799b1047524f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:03.518905 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6c1ec-bd66-48ca-8cc3-799b1047524f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:03.520650 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6c1ec-bd66-48ca-8cc3-799b1047524f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:03.529994 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 543/1094] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:03 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:46:03.536514 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddffe9-f9dd-4aaa-8d08-767e0486a777 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:03.546642 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddffe9-f9dd-4aaa-8d08-767e0486a777 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:03.551811 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e3a78-6157-4494-95f1-0d140de43b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:03.552656 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e3a78-6157-4494-95f1-0d140de43b6e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:03.552973 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e3a78-6157-4494-95f1-0d140de43b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:03.553244 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e3a78-6157-4494-95f1-0d140de43b6e admin admin] PATH_INFO: `/v3/projects/b3d292f6183d478783a4a9c0964b9cc3` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:03.555092 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e3a78-6157-4494-95f1-0d140de43b6e admin admin] RBAC: Authorizing `identity:get_project(project_id=b3d292f6183d478783a4a9c0964b9cc3)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:03.557151 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e3a78-6157-4494-95f1-0d140de43b6e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:03.558823 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 552/1095] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:03 2022] GET /identity/v3/projects/b3d292f6183d478783a4a9c0964b9cc3 => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:03.565747 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6c1ec-bd66-48ca-8cc3-799b1047524f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:03.575261 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6c1ec-bd66-48ca-8cc3-799b1047524f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:03.579768 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8604b9d-cc41-4439-8163-28de36256cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:03.580409 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8604b9d-cc41-4439-8163-28de36256cce admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:03.580690 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8604b9d-cc41-4439-8163-28de36256cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:03.580996 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8604b9d-cc41-4439-8163-28de36256cce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:03.581812 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8604b9d-cc41-4439-8163-28de36256cce admin admin] RBAC: Adding query filter params (role.id=253c0a1dc8d6421298a7987caaa55676, scope.project.id=b3d292f6183d478783a4a9c0964b9cc3, user.id=a7e854b856dc470396d4bb14982283c7) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:03.582123 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8604b9d-cc41-4439-8163-28de36256cce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:03.583928 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8604b9d-cc41-4439-8163-28de36256cce admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:03.590498 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 544/1096] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:46:03 2022] GET /identity/v3/role_assignments?user.id=a7e854b856dc470396d4bb14982283c7&scope.project.id=b3d292f6183d478783a4a9c0964b9cc3&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:00.331535 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381a4e0-2a10-41a9-a629-504eb19a261d None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.332127 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381a4e0-2a10-41a9-a629-504eb19a261d None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.332614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381a4e0-2a10-41a9-a629-504eb19a261d None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.337025 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 553/1097] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:47:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:00.346999 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6776f6-a63f-4609-81ce-713e8b11f23f None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.347539 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6776f6-a63f-4609-81ce-713e8b11f23f None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.348021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6776f6-a63f-4609-81ce-713e8b11f23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.388519 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-5b6776f6-a63f-4609-81ce-713e8b11f23f None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:00.390537 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-5b6776f6-a63f-4609-81ce-713e8b11f23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:00.412841 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 545/1098] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:00 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:00.436821 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381a4e0-2a10-41a9-a629-504eb19a261d None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.452549 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381a4e0-2a10-41a9-a629-504eb19a261d None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.457754 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512932a5-f7f3-4ec0-bcf8-622f714d78ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.458741 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512932a5-f7f3-4ec0-bcf8-622f714d78ba admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.459080 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512932a5-f7f3-4ec0-bcf8-622f714d78ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.459419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512932a5-f7f3-4ec0-bcf8-622f714d78ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.472393 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512932a5-f7f3-4ec0-bcf8-622f714d78ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.474375 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512932a5-f7f3-4ec0-bcf8-622f714d78ba admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.493462 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-512932a5-f7f3-4ec0-bcf8-622f714d78ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:00.501560 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 554/1099] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:00.503355 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6776f6-a63f-4609-81ce-713e8b11f23f None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.517521 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6776f6-a63f-4609-81ce-713e8b11f23f None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.524681 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f07fa-4c6a-473e-beee-c1eb1561003e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.525571 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f07fa-4c6a-473e-beee-c1eb1561003e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.526107 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f07fa-4c6a-473e-beee-c1eb1561003e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.526465 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f07fa-4c6a-473e-beee-c1eb1561003e admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.527342 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f07fa-4c6a-473e-beee-c1eb1561003e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:00.527666 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f07fa-4c6a-473e-beee-c1eb1561003e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.529658 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f07fa-4c6a-473e-beee-c1eb1561003e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.552877 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 546/1100] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:00.554977 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512932a5-f7f3-4ec0-bcf8-622f714d78ba admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.566079 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512932a5-f7f3-4ec0-bcf8-622f714d78ba admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.572868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb7fb5-f8bf-422f-bcd9-f47b360ed94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.573695 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb7fb5-f8bf-422f-bcd9-f47b360ed94f admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.574076 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb7fb5-f8bf-422f-bcd9-f47b360ed94f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.574495 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb7fb5-f8bf-422f-bcd9-f47b360ed94f admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.575313 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb7fb5-f8bf-422f-bcd9-f47b360ed94f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.577487 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb7fb5-f8bf-422f-bcd9-f47b360ed94f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.608846 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 555/1101] 10.222.0.96 () {60 vars in 1153 bytes} [Fri Jan 28 01:47:00 2022] POST /identity/v3/users => generated 251 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:47:03.057187 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256b5c0-754d-410c-8478-712ed479bcbb None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.057749 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256b5c0-754d-410c-8478-712ed479bcbb None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.057749 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256b5c0-754d-410c-8478-712ed479bcbb None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.060036 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 547/1102] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:47:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:03.068551 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cf562-81ee-4101-90aa-bfe15cee99bf None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.069151 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cf562-81ee-4101-90aa-bfe15cee99bf None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.069151 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cf562-81ee-4101-90aa-bfe15cee99bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.090139 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-506cf562-81ee-4101-90aa-bfe15cee99bf None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:03.091634 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-506cf562-81ee-4101-90aa-bfe15cee99bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:03.102689 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 556/1103] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:03 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:03.129480 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256b5c0-754d-410c-8478-712ed479bcbb None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.146273 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256b5c0-754d-410c-8478-712ed479bcbb None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.149934 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5b1b5-bcd2-4bcd-a14f-08e761a9284f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.153491 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5b1b5-bcd2-4bcd-a14f-08e761a9284f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.153491 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5b1b5-bcd2-4bcd-a14f-08e761a9284f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.153491 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5b1b5-bcd2-4bcd-a14f-08e761a9284f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.165732 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5b1b5-bcd2-4bcd-a14f-08e761a9284f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:03.173532 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-bec5b1b5-bcd2-4bcd-a14f-08e761a9284f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:47:03.180839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 548/1104] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:03.182560 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cf562-81ee-4101-90aa-bfe15cee99bf None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.192311 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cf562-81ee-4101-90aa-bfe15cee99bf None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.198751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd71a83-e8d3-4dac-86b0-6440eec04836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.199412 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd71a83-e8d3-4dac-86b0-6440eec04836 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.199739 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd71a83-e8d3-4dac-86b0-6440eec04836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.200008 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd71a83-e8d3-4dac-86b0-6440eec04836 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.200886 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd71a83-e8d3-4dac-86b0-6440eec04836 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:03.201292 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd71a83-e8d3-4dac-86b0-6440eec04836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.203067 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd71a83-e8d3-4dac-86b0-6440eec04836 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.216830 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 557/1105] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:03.219502 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5b1b5-bcd2-4bcd-a14f-08e761a9284f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.231044 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5b1b5-bcd2-4bcd-a14f-08e761a9284f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.236886 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b76e7-4ffc-44ba-8d2a-e080a187624f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.237615 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b76e7-4ffc-44ba-8d2a-e080a187624f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.237892 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b76e7-4ffc-44ba-8d2a-e080a187624f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.238157 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b76e7-4ffc-44ba-8d2a-e080a187624f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.250753 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b76e7-4ffc-44ba-8d2a-e080a187624f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.252720 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b76e7-4ffc-44ba-8d2a-e080a187624f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.277122 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-6b3b76e7-4ffc-44ba-8d2a-e080a187624f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:03.283840 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 549/1106] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:03.286571 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd71a83-e8d3-4dac-86b0-6440eec04836 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.297602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd71a83-e8d3-4dac-86b0-6440eec04836 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.307074 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd4611-d8cb-4862-8a31-903ca63830d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.307718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd4611-d8cb-4862-8a31-903ca63830d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.307937 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd4611-d8cb-4862-8a31-903ca63830d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.308209 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd4611-d8cb-4862-8a31-903ca63830d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.308971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd4611-d8cb-4862-8a31-903ca63830d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:03.309277 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd4611-d8cb-4862-8a31-903ca63830d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.310883 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd4611-d8cb-4862-8a31-903ca63830d6 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.325608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 558/1107] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:03.332910 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b76e7-4ffc-44ba-8d2a-e080a187624f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.343952 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b76e7-4ffc-44ba-8d2a-e080a187624f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.349058 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc433ff-6973-4265-8ae6-8630381f0275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.349959 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc433ff-6973-4265-8ae6-8630381f0275 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.350336 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc433ff-6973-4265-8ae6-8630381f0275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.350702 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc433ff-6973-4265-8ae6-8630381f0275 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.360846 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc433ff-6973-4265-8ae6-8630381f0275 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.361556 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc433ff-6973-4265-8ae6-8630381f0275 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.378324 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-8cc433ff-6973-4265-8ae6-8630381f0275 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:47:03.385936 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 550/1108] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:03.387936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd4611-d8cb-4862-8a31-903ca63830d6 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.400016 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd4611-d8cb-4862-8a31-903ca63830d6 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.408003 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc45497-07bc-4004-819f-ab63d43dcc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.408003 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc45497-07bc-4004-819f-ab63d43dcc10 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.408003 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc45497-07bc-4004-819f-ab63d43dcc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.408003 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc45497-07bc-4004-819f-ab63d43dcc10 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.408440 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc45497-07bc-4004-819f-ab63d43dcc10 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:03.408822 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc45497-07bc-4004-819f-ab63d43dcc10 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.410781 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc45497-07bc-4004-819f-ab63d43dcc10 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.433251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 559/1109] 10.222.0.96 () {56 vars in 1164 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:03.439704 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc433ff-6973-4265-8ae6-8630381f0275 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.450929 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc433ff-6973-4265-8ae6-8630381f0275 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.456892 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73079f9-d39b-474f-a925-66fc8fa668ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.457751 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73079f9-d39b-474f-a925-66fc8fa668ff admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.458096 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73079f9-d39b-474f-a925-66fc8fa668ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.458475 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73079f9-d39b-474f-a925-66fc8fa668ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.468197 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73079f9-d39b-474f-a925-66fc8fa668ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.470479 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73079f9-d39b-474f-a925-66fc8fa668ff admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.481845 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 551/1110] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:03.488889 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc45497-07bc-4004-819f-ab63d43dcc10 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.502643 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc45497-07bc-4004-819f-ab63d43dcc10 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.509689 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ff212-b8b3-41d7-abbc-91e5af4bebd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.510676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ff212-b8b3-41d7-abbc-91e5af4bebd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.511088 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ff212-b8b3-41d7-abbc-91e5af4bebd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.511421 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ff212-b8b3-41d7-abbc-91e5af4bebd8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.526314 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ff212-b8b3-41d7-abbc-91e5af4bebd8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.528654 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ff212-b8b3-41d7-abbc-91e5af4bebd8 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.549923 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-670ff212-b8b3-41d7-abbc-91e5af4bebd8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:03.551578 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 560/1111] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:03.559624 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73079f9-d39b-474f-a925-66fc8fa668ff admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.569484 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73079f9-d39b-474f-a925-66fc8fa668ff admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.576963 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c52cd3-15de-4c3e-b207-1be2b2ea66b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.579281 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c52cd3-15de-4c3e-b207-1be2b2ea66b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.579281 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c52cd3-15de-4c3e-b207-1be2b2ea66b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.579281 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c52cd3-15de-4c3e-b207-1be2b2ea66b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.579281 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c52cd3-15de-4c3e-b207-1be2b2ea66b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:03.579864 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c52cd3-15de-4c3e-b207-1be2b2ea66b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.581838 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c52cd3-15de-4c3e-b207-1be2b2ea66b3 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.596919 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 552/1112] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:03.606362 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ff212-b8b3-41d7-abbc-91e5af4bebd8 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.619249 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ff212-b8b3-41d7-abbc-91e5af4bebd8 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.625166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed51d02-4ba8-4be5-84de-adb111089828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.626143 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed51d02-4ba8-4be5-84de-adb111089828 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.626493 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed51d02-4ba8-4be5-84de-adb111089828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.626859 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed51d02-4ba8-4be5-84de-adb111089828 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.637008 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed51d02-4ba8-4be5-84de-adb111089828 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.638999 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed51d02-4ba8-4be5-84de-adb111089828 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.655998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-1ed51d02-4ba8-4be5-84de-adb111089828 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:03.657566 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 561/1113] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:03.665834 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c52cd3-15de-4c3e-b207-1be2b2ea66b3 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.681115 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c52cd3-15de-4c3e-b207-1be2b2ea66b3 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.686467 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6711e-3862-4fdd-97eb-755083927b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.687145 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6711e-3862-4fdd-97eb-755083927b25 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.687415 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6711e-3862-4fdd-97eb-755083927b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.687688 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6711e-3862-4fdd-97eb-755083927b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.688474 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6711e-3862-4fdd-97eb-755083927b25 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:03.688821 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6711e-3862-4fdd-97eb-755083927b25 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.690639 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6711e-3862-4fdd-97eb-755083927b25 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.704588 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 553/1114] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:03.711724 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed51d02-4ba8-4be5-84de-adb111089828 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.725386 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed51d02-4ba8-4be5-84de-adb111089828 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.731986 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddfd58-9d6d-4431-a821-84fb76ed6187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.732786 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddfd58-9d6d-4431-a821-84fb76ed6187 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.733131 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddfd58-9d6d-4431-a821-84fb76ed6187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.733468 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddfd58-9d6d-4431-a821-84fb76ed6187 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.734549 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ddfd58-9d6d-4431-a821-84fb76ed6187 admin admin] RBAC: Adding query filter params (role.id=4d7fce301eec49a7a54390167747fe24, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=88a16f0ecf3448428e969359be57dda8) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:03.734866 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ddfd58-9d6d-4431-a821-84fb76ed6187 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.736996 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ddfd58-9d6d-4431-a821-84fb76ed6187 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.744268 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 562/1115] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/role_assignments?user.id=88a16f0ecf3448428e969359be57dda8&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=4d7fce301eec49a7a54390167747fe24 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:06.125517 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091083a-5af8-4640-91ae-8542f0188619 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:06.126185 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091083a-5af8-4640-91ae-8542f0188619 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:06.126185 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091083a-5af8-4640-91ae-8542f0188619 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:06.127973 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 554/1116] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:06.136481 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6b031-2072-4df7-a480-cd957fa1f8df None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:06.137052 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6b031-2072-4df7-a480-cd957fa1f8df None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:06.137052 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6b031-2072-4df7-a480-cd957fa1f8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:06.155460 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-fcc6b031-2072-4df7-a480-cd957fa1f8df None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:06.156964 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-fcc6b031-2072-4df7-a480-cd957fa1f8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:06.165598 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 563/1117] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:06 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:06.191782 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091083a-5af8-4640-91ae-8542f0188619 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:06.205435 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091083a-5af8-4640-91ae-8542f0188619 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:06.210072 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb6f66-3d30-4aaa-b36f-5e0d31616dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:06.210934 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb6f66-3d30-4aaa-b36f-5e0d31616dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:06.211222 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb6f66-3d30-4aaa-b36f-5e0d31616dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:06.211535 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb6f66-3d30-4aaa-b36f-5e0d31616dc5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:06.223127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb6f66-3d30-4aaa-b36f-5e0d31616dc5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:06.230597 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-acfb6f66-3d30-4aaa-b36f-5e0d31616dc5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:47:06.231930 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 555/1118] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:06.238971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6b031-2072-4df7-a480-cd957fa1f8df None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:06.249162 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6b031-2072-4df7-a480-cd957fa1f8df None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:06.254135 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc12eae-dd27-4a7f-a2a3-42a07e46b9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:06.254810 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc12eae-dd27-4a7f-a2a3-42a07e46b9de admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:06.255112 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc12eae-dd27-4a7f-a2a3-42a07e46b9de admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:06.255426 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc12eae-dd27-4a7f-a2a3-42a07e46b9de admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:06.256221 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc12eae-dd27-4a7f-a2a3-42a07e46b9de admin admin] RBAC: Adding query filter params (name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:06.256539 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc12eae-dd27-4a7f-a2a3-42a07e46b9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:06.258901 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc12eae-dd27-4a7f-a2a3-42a07e46b9de admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:06.273819 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 564/1119] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:47:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:06.275003 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb6f66-3d30-4aaa-b36f-5e0d31616dc5 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:06.286430 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb6f66-3d30-4aaa-b36f-5e0d31616dc5 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:06.291561 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69668bb7-c51f-498b-be64-a02a9a893327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:06.292564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668bb7-c51f-498b-be64-a02a9a893327 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:06.292987 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668bb7-c51f-498b-be64-a02a9a893327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:06.293268 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668bb7-c51f-498b-be64-a02a9a893327 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:06.306583 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69668bb7-c51f-498b-be64-a02a9a893327 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:06.308864 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69668bb7-c51f-498b-be64-a02a9a893327 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:06.327963 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-69668bb7-c51f-498b-be64-a02a9a893327 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:06.329192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 556/1120] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:06.335748 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc12eae-dd27-4a7f-a2a3-42a07e46b9de admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:06.345711 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc12eae-dd27-4a7f-a2a3-42a07e46b9de admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:06.350191 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded827de-8aef-452f-849c-bcb6d5f68a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:06.350906 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded827de-8aef-452f-849c-bcb6d5f68a4c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:06.351364 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded827de-8aef-452f-849c-bcb6d5f68a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:06.351643 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded827de-8aef-452f-849c-bcb6d5f68a4c admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:06.352351 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded827de-8aef-452f-849c-bcb6d5f68a4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:06.352652 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded827de-8aef-452f-849c-bcb6d5f68a4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:06.354652 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded827de-8aef-452f-849c-bcb6d5f68a4c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:06.368643 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 565/1121] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:06.375061 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69668bb7-c51f-498b-be64-a02a9a893327 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:06.386007 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69668bb7-c51f-498b-be64-a02a9a893327 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:06.390807 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcbcee-5cc9-4ab5-8d6d-d50841650c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:06.391638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcbcee-5cc9-4ab5-8d6d-d50841650c9a admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:06.391913 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcbcee-5cc9-4ab5-8d6d-d50841650c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:06.392183 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcbcee-5cc9-4ab5-8d6d-d50841650c9a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:06.400483 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcbcee-5cc9-4ab5-8d6d-d50841650c9a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:06.402496 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcbcee-5cc9-4ab5-8d6d-d50841650c9a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:06.416811 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-5adcbcee-5cc9-4ab5-8d6d-d50841650c9a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:47:06.418163 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 557/1122] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:06.426046 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded827de-8aef-452f-849c-bcb6d5f68a4c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:06.438323 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded827de-8aef-452f-849c-bcb6d5f68a4c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:06.444098 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bc5f0-ca99-4e63-8b83-476ef0d26efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:06.445586 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bc5f0-ca99-4e63-8b83-476ef0d26efc admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:06.445869 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bc5f0-ca99-4e63-8b83-476ef0d26efc admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:06.446139 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bc5f0-ca99-4e63-8b83-476ef0d26efc admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:06.447153 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bc5f0-ca99-4e63-8b83-476ef0d26efc admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:06.447513 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bc5f0-ca99-4e63-8b83-476ef0d26efc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:06.449647 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bc5f0-ca99-4e63-8b83-476ef0d26efc admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:06.471146 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 566/1123] 10.222.0.96 () {56 vars in 1164 bytes} [Fri Jan 28 01:47:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:06.477607 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcbcee-5cc9-4ab5-8d6d-d50841650c9a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:06.488327 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcbcee-5cc9-4ab5-8d6d-d50841650c9a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:06.495444 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f7c54-28d7-4f7b-857e-a4ff40a776d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:06.496484 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f7c54-28d7-4f7b-857e-a4ff40a776d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:06.496944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f7c54-28d7-4f7b-857e-a4ff40a776d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:06.497215 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f7c54-28d7-4f7b-857e-a4ff40a776d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:06.511405 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f7c54-28d7-4f7b-857e-a4ff40a776d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:06.513717 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f7c54-28d7-4f7b-857e-a4ff40a776d6 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:06.534312 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-fc6f7c54-28d7-4f7b-857e-a4ff40a776d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:06.535560 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 558/1124] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:06.542849 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bc5f0-ca99-4e63-8b83-476ef0d26efc admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:06.553358 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bc5f0-ca99-4e63-8b83-476ef0d26efc admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:06.558989 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867d839-c3dd-4af3-9b20-64983e616168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:06.559645 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867d839-c3dd-4af3-9b20-64983e616168 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:06.559929 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867d839-c3dd-4af3-9b20-64983e616168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:06.560205 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867d839-c3dd-4af3-9b20-64983e616168 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:06.560952 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867d839-c3dd-4af3-9b20-64983e616168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:06.561257 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867d839-c3dd-4af3-9b20-64983e616168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:06.562870 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867d839-c3dd-4af3-9b20-64983e616168 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:06.574845 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 567/1125] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:06.581509 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f7c54-28d7-4f7b-857e-a4ff40a776d6 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:06.592155 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f7c54-28d7-4f7b-857e-a4ff40a776d6 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:06.597078 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb06095-9b2d-4a16-aa98-6b2137a655d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:06.600370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb06095-9b2d-4a16-aa98-6b2137a655d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:06.600370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb06095-9b2d-4a16-aa98-6b2137a655d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:06.600370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb06095-9b2d-4a16-aa98-6b2137a655d6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:06.606942 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb06095-9b2d-4a16-aa98-6b2137a655d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:06.608994 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb06095-9b2d-4a16-aa98-6b2137a655d6 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:06.623492 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-fcb06095-9b2d-4a16-aa98-6b2137a655d6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:06.624731 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 559/1126] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:06.631508 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867d839-c3dd-4af3-9b20-64983e616168 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:06.642599 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867d839-c3dd-4af3-9b20-64983e616168 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:06.647379 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364e2eb-aa75-47f1-b4c4-87db37a9967b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:06.649015 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364e2eb-aa75-47f1-b4c4-87db37a9967b admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:06.649396 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364e2eb-aa75-47f1-b4c4-87db37a9967b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:06.649672 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364e2eb-aa75-47f1-b4c4-87db37a9967b admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:06.650456 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364e2eb-aa75-47f1-b4c4-87db37a9967b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:06.650824 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364e2eb-aa75-47f1-b4c4-87db37a9967b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:06.652638 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364e2eb-aa75-47f1-b4c4-87db37a9967b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:06.665653 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 568/1127] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:06.672433 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb06095-9b2d-4a16-aa98-6b2137a655d6 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:06.683416 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb06095-9b2d-4a16-aa98-6b2137a655d6 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:06.688264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef79fb2-8744-4ad7-af43-a7995ce36323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:06.689250 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef79fb2-8744-4ad7-af43-a7995ce36323 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:06.689532 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef79fb2-8744-4ad7-af43-a7995ce36323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:06.689846 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef79fb2-8744-4ad7-af43-a7995ce36323 admin admin] PATH_INFO: `/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/88a16f0ecf3448428e969359be57dda8/roles/4d7fce301eec49a7a54390167747fe24` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:06.705247 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef79fb2-8744-4ad7-af43-a7995ce36323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356ecb479ba24136a7c38cb5a58a0a18, user_id=88a16f0ecf3448428e969359be57dda8, role_id=4d7fce301eec49a7a54390167747fe24)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:06.707874 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef79fb2-8744-4ad7-af43-a7995ce36323 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:06.721379 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 560/1128] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:47:06 2022] PUT /identity/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/88a16f0ecf3448428e969359be57dda8/roles/4d7fce301eec49a7a54390167747fe24 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:47:09.183496 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352760-18f1-4f06-bb19-481e032d422a None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.184052 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352760-18f1-4f06-bb19-481e032d422a None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.184052 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43352760-18f1-4f06-bb19-481e032d422a None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.186088 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 569/1129] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:47:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:09.196172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c270a4-46b6-47ff-aeab-a47e38857717 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.196773 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c270a4-46b6-47ff-aeab-a47e38857717 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.196898 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c270a4-46b6-47ff-aeab-a47e38857717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.216311 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-d6c270a4-46b6-47ff-aeab-a47e38857717 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:09.217534 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-d6c270a4-46b6-47ff-aeab-a47e38857717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:09.278470 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 561/1130] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:09 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:09.306987 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43352760-18f1-4f06-bb19-481e032d422a None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.341335 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43352760-18f1-4f06-bb19-481e032d422a None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.346756 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a159fe1-ef4d-4057-99f5-47da11d368cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.347639 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a159fe1-ef4d-4057-99f5-47da11d368cc admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.348102 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a159fe1-ef4d-4057-99f5-47da11d368cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.348227 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a159fe1-ef4d-4057-99f5-47da11d368cc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.361247 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a159fe1-ef4d-4057-99f5-47da11d368cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:09.369177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-5a159fe1-ef4d-4057-99f5-47da11d368cc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:47:09.370476 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 570/1131] 10.222.0.96 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:09.377222 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c270a4-46b6-47ff-aeab-a47e38857717 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.386840 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c270a4-46b6-47ff-aeab-a47e38857717 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.391979 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816bf78-9e27-4ba4-8e79-0e72acce0ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.392644 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816bf78-9e27-4ba4-8e79-0e72acce0ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.392968 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816bf78-9e27-4ba4-8e79-0e72acce0ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.393245 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816bf78-9e27-4ba4-8e79-0e72acce0ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.393993 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816bf78-9e27-4ba4-8e79-0e72acce0ee8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:09.394286 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816bf78-9e27-4ba4-8e79-0e72acce0ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.395872 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816bf78-9e27-4ba4-8e79-0e72acce0ee8 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.405859 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 562/1132] 10.222.0.96 () {56 vars in 1124 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:09.412487 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a159fe1-ef4d-4057-99f5-47da11d368cc admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.424368 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a159fe1-ef4d-4057-99f5-47da11d368cc admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.428965 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ba57e-08c7-4b9b-804c-6489e12cbd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.429800 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ba57e-08c7-4b9b-804c-6489e12cbd13 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.430008 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ba57e-08c7-4b9b-804c-6489e12cbd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.430274 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ba57e-08c7-4b9b-804c-6489e12cbd13 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.441089 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ba57e-08c7-4b9b-804c-6489e12cbd13 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.443031 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ba57e-08c7-4b9b-804c-6489e12cbd13 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.462044 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-cb3ba57e-08c7-4b9b-804c-6489e12cbd13 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:09.463328 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 571/1133] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:09.469916 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816bf78-9e27-4ba4-8e79-0e72acce0ee8 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.480952 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816bf78-9e27-4ba4-8e79-0e72acce0ee8 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.485950 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40851a13-b344-4b9f-bae8-c9166435f7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.486624 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40851a13-b344-4b9f-bae8-c9166435f7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.486889 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40851a13-b344-4b9f-bae8-c9166435f7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.487166 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40851a13-b344-4b9f-bae8-c9166435f7a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.487981 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40851a13-b344-4b9f-bae8-c9166435f7a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:09.488299 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40851a13-b344-4b9f-bae8-c9166435f7a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.490155 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40851a13-b344-4b9f-bae8-c9166435f7a1 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.506382 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 563/1134] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:09.516337 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ba57e-08c7-4b9b-804c-6489e12cbd13 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.530349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ba57e-08c7-4b9b-804c-6489e12cbd13 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.535908 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce7a19-549b-4d9b-9157-d606196dd65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.536764 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce7a19-549b-4d9b-9157-d606196dd65c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.537153 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce7a19-549b-4d9b-9157-d606196dd65c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.537452 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce7a19-549b-4d9b-9157-d606196dd65c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.545750 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce7a19-549b-4d9b-9157-d606196dd65c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.547780 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce7a19-549b-4d9b-9157-d606196dd65c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.565609 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-f3ce7a19-549b-4d9b-9157-d606196dd65c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:47:09.567050 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 572/1135] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:09.575192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40851a13-b344-4b9f-bae8-c9166435f7a1 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.587363 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40851a13-b344-4b9f-bae8-c9166435f7a1 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.592962 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e798d45-68b2-4b57-87c3-1f8437f09e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.593674 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e798d45-68b2-4b57-87c3-1f8437f09e09 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.593963 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e798d45-68b2-4b57-87c3-1f8437f09e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.594265 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e798d45-68b2-4b57-87c3-1f8437f09e09 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.595206 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e798d45-68b2-4b57-87c3-1f8437f09e09 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:09.595525 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e798d45-68b2-4b57-87c3-1f8437f09e09 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.597588 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e798d45-68b2-4b57-87c3-1f8437f09e09 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.619836 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 564/1136] 10.222.0.96 () {56 vars in 1164 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:09.627314 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce7a19-549b-4d9b-9157-d606196dd65c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.641904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce7a19-549b-4d9b-9157-d606196dd65c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.648612 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87635a-ac8c-4ba4-a940-349d8d503d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.650005 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87635a-ac8c-4ba4-a940-349d8d503d6b admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.650307 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87635a-ac8c-4ba4-a940-349d8d503d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.651190 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87635a-ac8c-4ba4-a940-349d8d503d6b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.659523 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87635a-ac8c-4ba4-a940-349d8d503d6b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.661457 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87635a-ac8c-4ba4-a940-349d8d503d6b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.672136 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 573/1137] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:09.684307 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e798d45-68b2-4b57-87c3-1f8437f09e09 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.701650 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e798d45-68b2-4b57-87c3-1f8437f09e09 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.707765 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa349c4-1d53-4e2c-841f-600396dfc0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.708788 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa349c4-1d53-4e2c-841f-600396dfc0ea admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.709109 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa349c4-1d53-4e2c-841f-600396dfc0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.709668 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa349c4-1d53-4e2c-841f-600396dfc0ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.723305 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa349c4-1d53-4e2c-841f-600396dfc0ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.725177 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa349c4-1d53-4e2c-841f-600396dfc0ea admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.745584 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-9fa349c4-1d53-4e2c-841f-600396dfc0ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:09.747022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 565/1138] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:09.754244 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87635a-ac8c-4ba4-a940-349d8d503d6b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.765641 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87635a-ac8c-4ba4-a940-349d8d503d6b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.771497 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19650d4-3df6-4154-adbb-782d7ecccba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.772514 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19650d4-3df6-4154-adbb-782d7ecccba6 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.772626 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19650d4-3df6-4154-adbb-782d7ecccba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.773554 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19650d4-3df6-4154-adbb-782d7ecccba6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.774523 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19650d4-3df6-4154-adbb-782d7ecccba6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:09.774978 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19650d4-3df6-4154-adbb-782d7ecccba6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.776784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19650d4-3df6-4154-adbb-782d7ecccba6 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.790698 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 574/1139] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:09.797879 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa349c4-1d53-4e2c-841f-600396dfc0ea admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.808267 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa349c4-1d53-4e2c-841f-600396dfc0ea admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.814190 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965d319-f4f1-4c8c-9f8a-d4704902dfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.815137 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965d319-f4f1-4c8c-9f8a-d4704902dfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.815498 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965d319-f4f1-4c8c-9f8a-d4704902dfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.815851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965d319-f4f1-4c8c-9f8a-d4704902dfa9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.826017 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965d319-f4f1-4c8c-9f8a-d4704902dfa9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.828164 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965d319-f4f1-4c8c-9f8a-d4704902dfa9 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.843861 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-2965d319-f4f1-4c8c-9f8a-d4704902dfa9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:09.845096 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 566/1140] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:09.854004 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19650d4-3df6-4154-adbb-782d7ecccba6 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.864210 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19650d4-3df6-4154-adbb-782d7ecccba6 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.870573 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5404dc-087f-44fa-a86f-49ac2fce730e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.870573 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5404dc-087f-44fa-a86f-49ac2fce730e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.870573 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5404dc-087f-44fa-a86f-49ac2fce730e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.870914 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5404dc-087f-44fa-a86f-49ac2fce730e admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.871570 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5404dc-087f-44fa-a86f-49ac2fce730e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:09.871872 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5404dc-087f-44fa-a86f-49ac2fce730e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.873724 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5404dc-087f-44fa-a86f-49ac2fce730e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.889506 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 575/1141] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:09.896272 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965d319-f4f1-4c8c-9f8a-d4704902dfa9 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.909361 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965d319-f4f1-4c8c-9f8a-d4704902dfa9 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.918886 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ec0bf-e174-47eb-afd3-b21214182b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.919549 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ec0bf-e174-47eb-afd3-b21214182b5d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.919828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ec0bf-e174-47eb-afd3-b21214182b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.920094 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ec0bf-e174-47eb-afd3-b21214182b5d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.920970 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ec0bf-e174-47eb-afd3-b21214182b5d admin admin] RBAC: Adding query filter params (role.id=4d7fce301eec49a7a54390167747fe24, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=88a16f0ecf3448428e969359be57dda8) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:09.921280 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ec0bf-e174-47eb-afd3-b21214182b5d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.923115 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ec0bf-e174-47eb-afd3-b21214182b5d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.929896 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 567/1142] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/role_assignments?user.id=88a16f0ecf3448428e969359be57dda8&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=4d7fce301eec49a7a54390167747fe24 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:12.403850 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330a5b-288a-4fd0-b2f2-5c269ce6ccbe None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.404419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330a5b-288a-4fd0-b2f2-5c269ce6ccbe None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.404419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330a5b-288a-4fd0-b2f2-5c269ce6ccbe None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.406683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 576/1143] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:47:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:12.414720 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b43bcb-3ef6-4e34-98fe-7e0ce0da3ab5 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.415238 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b43bcb-3ef6-4e34-98fe-7e0ce0da3ab5 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.415486 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b43bcb-3ef6-4e34-98fe-7e0ce0da3ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.438349 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-10b43bcb-3ef6-4e34-98fe-7e0ce0da3ab5 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:12.439547 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-10b43bcb-3ef6-4e34-98fe-7e0ce0da3ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:12.448074 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 568/1144] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:12 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:12.472959 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de330a5b-288a-4fd0-b2f2-5c269ce6ccbe None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.485687 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de330a5b-288a-4fd0-b2f2-5c269ce6ccbe None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.493670 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13762547-41b7-4b9f-b8fb-82e5b7a5c6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.495002 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13762547-41b7-4b9f-b8fb-82e5b7a5c6cc admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.495478 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13762547-41b7-4b9f-b8fb-82e5b7a5c6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.495879 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13762547-41b7-4b9f-b8fb-82e5b7a5c6cc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.509827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13762547-41b7-4b9f-b8fb-82e5b7a5c6cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:12.517186 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-13762547-41b7-4b9f-b8fb-82e5b7a5c6cc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:47:12.520843 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 577/1145] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:12.525331 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b43bcb-3ef6-4e34-98fe-7e0ce0da3ab5 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.534871 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b43bcb-3ef6-4e34-98fe-7e0ce0da3ab5 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.541167 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b93963-4ced-4c95-8381-81638241c890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.541989 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b93963-4ced-4c95-8381-81638241c890 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.542318 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b93963-4ced-4c95-8381-81638241c890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.542614 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b93963-4ced-4c95-8381-81638241c890 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.543592 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b93963-4ced-4c95-8381-81638241c890 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:12.545211 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b93963-4ced-4c95-8381-81638241c890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.546032 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b93963-4ced-4c95-8381-81638241c890 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.557661 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 569/1146] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:12.565844 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13762547-41b7-4b9f-b8fb-82e5b7a5c6cc admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.578433 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13762547-41b7-4b9f-b8fb-82e5b7a5c6cc admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.584136 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb6c49-ea5f-412a-8fdd-81918edac3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.585100 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb6c49-ea5f-412a-8fdd-81918edac3ac admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.585402 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb6c49-ea5f-412a-8fdd-81918edac3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.585683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb6c49-ea5f-412a-8fdd-81918edac3ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.598409 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb6c49-ea5f-412a-8fdd-81918edac3ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.600336 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb6c49-ea5f-412a-8fdd-81918edac3ac admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.619693 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-fddb6c49-ea5f-412a-8fdd-81918edac3ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:12.620951 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 578/1147] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:12.628262 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b93963-4ced-4c95-8381-81638241c890 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.638816 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b93963-4ced-4c95-8381-81638241c890 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.643594 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879c2c8-1517-4bf0-88bd-26ac2b2d9ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.644255 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879c2c8-1517-4bf0-88bd-26ac2b2d9ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.644529 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879c2c8-1517-4bf0-88bd-26ac2b2d9ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.644809 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879c2c8-1517-4bf0-88bd-26ac2b2d9ac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.645571 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879c2c8-1517-4bf0-88bd-26ac2b2d9ac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:12.645825 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879c2c8-1517-4bf0-88bd-26ac2b2d9ac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.647418 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879c2c8-1517-4bf0-88bd-26ac2b2d9ac0 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.660898 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 570/1148] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:12.667158 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb6c49-ea5f-412a-8fdd-81918edac3ac admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.677116 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb6c49-ea5f-412a-8fdd-81918edac3ac admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.681803 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dffabc-942d-4321-9412-b0a9a1f378a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.682594 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dffabc-942d-4321-9412-b0a9a1f378a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.682867 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dffabc-942d-4321-9412-b0a9a1f378a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.683130 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dffabc-942d-4321-9412-b0a9a1f378a4 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.700486 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dffabc-942d-4321-9412-b0a9a1f378a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.702772 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dffabc-942d-4321-9412-b0a9a1f378a4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.727336 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-a8dffabc-942d-4321-9412-b0a9a1f378a4 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:47:12.728882 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 579/1149] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:12.738202 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879c2c8-1517-4bf0-88bd-26ac2b2d9ac0 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.752828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879c2c8-1517-4bf0-88bd-26ac2b2d9ac0 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.758659 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe33dff-d7b5-4ed3-a32f-51ad6a5dd551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.759527 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe33dff-d7b5-4ed3-a32f-51ad6a5dd551 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.760286 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe33dff-d7b5-4ed3-a32f-51ad6a5dd551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.760286 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe33dff-d7b5-4ed3-a32f-51ad6a5dd551 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.761158 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe33dff-d7b5-4ed3-a32f-51ad6a5dd551 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:12.761543 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe33dff-d7b5-4ed3-a32f-51ad6a5dd551 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.763714 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe33dff-d7b5-4ed3-a32f-51ad6a5dd551 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.784767 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 571/1150] 10.222.0.96 () {56 vars in 1164 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:12.794000 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dffabc-942d-4321-9412-b0a9a1f378a4 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.807321 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dffabc-942d-4321-9412-b0a9a1f378a4 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.812752 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c29c35-fce9-4341-b8bd-c4f1a58f09ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.813442 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c29c35-fce9-4341-b8bd-c4f1a58f09ac admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.813719 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c29c35-fce9-4341-b8bd-c4f1a58f09ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.814040 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c29c35-fce9-4341-b8bd-c4f1a58f09ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.823849 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c29c35-fce9-4341-b8bd-c4f1a58f09ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.825861 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c29c35-fce9-4341-b8bd-c4f1a58f09ac admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.836634 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 580/1151] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:47:12.843465 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe33dff-d7b5-4ed3-a32f-51ad6a5dd551 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.853771 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe33dff-d7b5-4ed3-a32f-51ad6a5dd551 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.858413 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47b603-3ddc-49bd-8064-68dbefcc641c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.859202 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47b603-3ddc-49bd-8064-68dbefcc641c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.859482 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47b603-3ddc-49bd-8064-68dbefcc641c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.859752 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47b603-3ddc-49bd-8064-68dbefcc641c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.870516 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47b603-3ddc-49bd-8064-68dbefcc641c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.872533 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47b603-3ddc-49bd-8064-68dbefcc641c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.891318 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-2d47b603-3ddc-49bd-8064-68dbefcc641c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:12.892820 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 572/1152] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:12.900195 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c29c35-fce9-4341-b8bd-c4f1a58f09ac admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.909643 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c29c35-fce9-4341-b8bd-c4f1a58f09ac admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.915681 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be738ed9-55af-4658-8efa-c1e025bb8c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.916276 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be738ed9-55af-4658-8efa-c1e025bb8c76 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.916550 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be738ed9-55af-4658-8efa-c1e025bb8c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.916842 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be738ed9-55af-4658-8efa-c1e025bb8c76 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.917560 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be738ed9-55af-4658-8efa-c1e025bb8c76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:12.917857 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be738ed9-55af-4658-8efa-c1e025bb8c76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.919581 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be738ed9-55af-4658-8efa-c1e025bb8c76 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.933675 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 581/1153] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:12.940285 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47b603-3ddc-49bd-8064-68dbefcc641c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.951321 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47b603-3ddc-49bd-8064-68dbefcc641c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.956141 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c165d55-770f-48ee-ab3a-2499f1999949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.956964 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c165d55-770f-48ee-ab3a-2499f1999949 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.957248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c165d55-770f-48ee-ab3a-2499f1999949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.957518 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c165d55-770f-48ee-ab3a-2499f1999949 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.965485 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c165d55-770f-48ee-ab3a-2499f1999949 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.967759 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c165d55-770f-48ee-ab3a-2499f1999949 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.981942 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-4c165d55-770f-48ee-ab3a-2499f1999949 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:12.983278 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 573/1154] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:12.990827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be738ed9-55af-4658-8efa-c1e025bb8c76 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:13.003325 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be738ed9-55af-4658-8efa-c1e025bb8c76 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:13.009700 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594fd50-2be0-41c4-a929-5458a1e05244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:13.010364 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594fd50-2be0-41c4-a929-5458a1e05244 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:13.010627 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594fd50-2be0-41c4-a929-5458a1e05244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:13.010896 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594fd50-2be0-41c4-a929-5458a1e05244 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:13.011675 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594fd50-2be0-41c4-a929-5458a1e05244 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:13.011978 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594fd50-2be0-41c4-a929-5458a1e05244 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:13.013864 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594fd50-2be0-41c4-a929-5458a1e05244 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:13.027342 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 582/1155] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:13.035170 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c165d55-770f-48ee-ab3a-2499f1999949 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:13.047530 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c165d55-770f-48ee-ab3a-2499f1999949 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:13.052866 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef84e4-4583-4f1c-9981-6b7e10f9c9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:13.053607 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef84e4-4583-4f1c-9981-6b7e10f9c9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:13.054710 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef84e4-4583-4f1c-9981-6b7e10f9c9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:13.055409 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef84e4-4583-4f1c-9981-6b7e10f9c9d9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:13.055914 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef84e4-4583-4f1c-9981-6b7e10f9c9d9 admin admin] RBAC: Adding query filter params (role.id=253c0a1dc8d6421298a7987caaa55676, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=88a16f0ecf3448428e969359be57dda8) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:13.056222 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef84e4-4583-4f1c-9981-6b7e10f9c9d9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:13.058059 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef84e4-4583-4f1c-9981-6b7e10f9c9d9 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:13.078741 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 574/1156] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:13 2022] GET /identity/v3/role_assignments?user.id=88a16f0ecf3448428e969359be57dda8&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:15.356256 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd3d0b-504b-491b-8b46-4e2a2e27ba04 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:15.356865 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd3d0b-504b-491b-8b46-4e2a2e27ba04 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:15.356865 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd3d0b-504b-491b-8b46-4e2a2e27ba04 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:15.358797 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 583/1157] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:15.366647 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43592b8-e01c-48dd-8861-a441f1746b95 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:15.367566 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43592b8-e01c-48dd-8861-a441f1746b95 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:15.367880 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43592b8-e01c-48dd-8861-a441f1746b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:15.385772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-b43592b8-e01c-48dd-8861-a441f1746b95 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:15.386956 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b43592b8-e01c-48dd-8861-a441f1746b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:15.394836 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 575/1158] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:15 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:15.420272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd3d0b-504b-491b-8b46-4e2a2e27ba04 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:15.433584 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd3d0b-504b-491b-8b46-4e2a2e27ba04 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:15.438569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63b250-203b-42f5-a315-f97d6a6b32ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:15.439453 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63b250-203b-42f5-a315-f97d6a6b32ce admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:15.439772 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63b250-203b-42f5-a315-f97d6a6b32ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:15.440096 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63b250-203b-42f5-a315-f97d6a6b32ce admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:15.451131 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63b250-203b-42f5-a315-f97d6a6b32ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:15.457863 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-0f63b250-203b-42f5-a315-f97d6a6b32ce admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:47:15.459169 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 584/1159] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:47:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:15.466897 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43592b8-e01c-48dd-8861-a441f1746b95 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:15.477054 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43592b8-e01c-48dd-8861-a441f1746b95 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:15.482123 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd7ca0-3c2f-49f4-9b84-1343ceff0a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:15.482800 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd7ca0-3c2f-49f4-9b84-1343ceff0a4f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:15.483105 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd7ca0-3c2f-49f4-9b84-1343ceff0a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:15.483353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd7ca0-3c2f-49f4-9b84-1343ceff0a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:15.484171 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd7ca0-3c2f-49f4-9b84-1343ceff0a4f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:15.484479 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd7ca0-3c2f-49f4-9b84-1343ceff0a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:15.486213 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd7ca0-3c2f-49f4-9b84-1343ceff0a4f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:15.496237 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 576/1160] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:47:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:15.503694 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63b250-203b-42f5-a315-f97d6a6b32ce admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:15.515926 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63b250-203b-42f5-a315-f97d6a6b32ce admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:15.520753 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde948d6-7b37-4b7d-92b1-dc1f77b2f601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:15.521563 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde948d6-7b37-4b7d-92b1-dc1f77b2f601 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:15.521842 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde948d6-7b37-4b7d-92b1-dc1f77b2f601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:15.522111 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde948d6-7b37-4b7d-92b1-dc1f77b2f601 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:15.535623 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde948d6-7b37-4b7d-92b1-dc1f77b2f601 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:15.538924 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde948d6-7b37-4b7d-92b1-dc1f77b2f601 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:15.558434 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-bde948d6-7b37-4b7d-92b1-dc1f77b2f601 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:15.559662 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 585/1161] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:15.566631 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd7ca0-3c2f-49f4-9b84-1343ceff0a4f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:15.577862 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd7ca0-3c2f-49f4-9b84-1343ceff0a4f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:15.582909 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3d491-6bed-4390-b6ef-324595fdba01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:15.583590 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3d491-6bed-4390-b6ef-324595fdba01 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:15.583868 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3d491-6bed-4390-b6ef-324595fdba01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:15.584139 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3d491-6bed-4390-b6ef-324595fdba01 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:15.584887 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3d491-6bed-4390-b6ef-324595fdba01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:15.585833 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3d491-6bed-4390-b6ef-324595fdba01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:15.587948 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3d491-6bed-4390-b6ef-324595fdba01 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:15.602275 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 577/1162] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:15.609211 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde948d6-7b37-4b7d-92b1-dc1f77b2f601 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:15.620664 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde948d6-7b37-4b7d-92b1-dc1f77b2f601 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:15.625960 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bec25a-7bb0-4803-a19e-713d6effd563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:15.626915 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bec25a-7bb0-4803-a19e-713d6effd563 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:15.627245 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bec25a-7bb0-4803-a19e-713d6effd563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:15.627561 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bec25a-7bb0-4803-a19e-713d6effd563 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:15.639332 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bec25a-7bb0-4803-a19e-713d6effd563 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:15.644052 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bec25a-7bb0-4803-a19e-713d6effd563 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:15.662513 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-29bec25a-7bb0-4803-a19e-713d6effd563 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:47:15.664974 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 586/1163] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:15.669595 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3d491-6bed-4390-b6ef-324595fdba01 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:15.679346 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3d491-6bed-4390-b6ef-324595fdba01 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:15.684021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac67abb-f156-4c15-b5d7-ce7e3d726671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:15.684676 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac67abb-f156-4c15-b5d7-ce7e3d726671 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:15.684985 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac67abb-f156-4c15-b5d7-ce7e3d726671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:15.685257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac67abb-f156-4c15-b5d7-ce7e3d726671 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:15.686083 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac67abb-f156-4c15-b5d7-ce7e3d726671 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:15.686383 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac67abb-f156-4c15-b5d7-ce7e3d726671 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:15.688230 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac67abb-f156-4c15-b5d7-ce7e3d726671 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:15.707669 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 578/1164] 10.222.0.96 () {56 vars in 1164 bytes} [Fri Jan 28 01:47:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:15.715420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bec25a-7bb0-4803-a19e-713d6effd563 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:15.725409 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bec25a-7bb0-4803-a19e-713d6effd563 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:15.730916 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762297f-683a-437f-a9f1-f15586b707fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:15.731701 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762297f-683a-437f-a9f1-f15586b707fc admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:15.731979 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762297f-683a-437f-a9f1-f15586b707fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:15.732253 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762297f-683a-437f-a9f1-f15586b707fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:15.745417 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762297f-683a-437f-a9f1-f15586b707fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:15.747292 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762297f-683a-437f-a9f1-f15586b707fc admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:15.765552 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-1762297f-683a-437f-a9f1-f15586b707fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:15.766753 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 587/1165] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:15.774353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac67abb-f156-4c15-b5d7-ce7e3d726671 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:15.786431 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac67abb-f156-4c15-b5d7-ce7e3d726671 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:15.791894 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c83fd-ced3-41b3-835c-5166057d72a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:15.792559 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c83fd-ced3-41b3-835c-5166057d72a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:15.792868 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c83fd-ced3-41b3-835c-5166057d72a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:15.793139 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c83fd-ced3-41b3-835c-5166057d72a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:15.793936 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c83fd-ced3-41b3-835c-5166057d72a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:15.794261 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c83fd-ced3-41b3-835c-5166057d72a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:15.796069 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c83fd-ced3-41b3-835c-5166057d72a2 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:15.809355 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 579/1166] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:15.816386 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762297f-683a-437f-a9f1-f15586b707fc admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:15.828346 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762297f-683a-437f-a9f1-f15586b707fc admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:15.833869 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c70f30-444b-405c-9478-8c28e91ec944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:15.834656 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c70f30-444b-405c-9478-8c28e91ec944 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:15.834934 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c70f30-444b-405c-9478-8c28e91ec944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:15.835843 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c70f30-444b-405c-9478-8c28e91ec944 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:15.843113 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c70f30-444b-405c-9478-8c28e91ec944 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:15.845076 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c70f30-444b-405c-9478-8c28e91ec944 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:15.858131 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-d9c70f30-444b-405c-9478-8c28e91ec944 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:15.859403 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 588/1167] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:15.866871 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c83fd-ced3-41b3-835c-5166057d72a2 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:15.876969 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c83fd-ced3-41b3-835c-5166057d72a2 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:15.882531 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3a507-9bc4-4d45-86bc-f9e9bbf5fc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:15.883214 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3a507-9bc4-4d45-86bc-f9e9bbf5fc96 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:15.883644 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3a507-9bc4-4d45-86bc-f9e9bbf5fc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:15.883924 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3a507-9bc4-4d45-86bc-f9e9bbf5fc96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:15.884692 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b3a507-9bc4-4d45-86bc-f9e9bbf5fc96 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:15.885035 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b3a507-9bc4-4d45-86bc-f9e9bbf5fc96 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:15.886868 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b3a507-9bc4-4d45-86bc-f9e9bbf5fc96 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:15.901776 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 580/1168] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:15.908649 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c70f30-444b-405c-9478-8c28e91ec944 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:15.919372 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c70f30-444b-405c-9478-8c28e91ec944 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:15.924345 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23b987-313d-43a8-9bb7-b406b9b6e36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:15.925255 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23b987-313d-43a8-9bb7-b406b9b6e36a admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:15.925528 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23b987-313d-43a8-9bb7-b406b9b6e36a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:15.925794 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23b987-313d-43a8-9bb7-b406b9b6e36a admin admin] PATH_INFO: `/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/88a16f0ecf3448428e969359be57dda8/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:15.927762 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23b987-313d-43a8-9bb7-b406b9b6e36a admin admin] RBAC: Authorizing `identity:create_grant(project_id=356ecb479ba24136a7c38cb5a58a0a18, user_id=88a16f0ecf3448428e969359be57dda8, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:15.930984 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23b987-313d-43a8-9bb7-b406b9b6e36a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:15.946905 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 589/1169] 10.222.0.96 () {58 vars in 1460 bytes} [Fri Jan 28 01:47:15 2022] PUT /identity/v3/projects/356ecb479ba24136a7c38cb5a58a0a18/users/88a16f0ecf3448428e969359be57dda8/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:47:18.142690 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8779b6e-f63f-446f-8960-1f75cbcb1886 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.143218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8779b6e-f63f-446f-8960-1f75cbcb1886 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.143218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8779b6e-f63f-446f-8960-1f75cbcb1886 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.145036 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 581/1170] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:18.152693 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d15b1-3be0-4be4-bd89-d44e67ce30b8 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.153156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d15b1-3be0-4be4-bd89-d44e67ce30b8 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.153268 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d15b1-3be0-4be4-bd89-d44e67ce30b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.171282 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-305d15b1-3be0-4be4-bd89-d44e67ce30b8 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:18.172471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-305d15b1-3be0-4be4-bd89-d44e67ce30b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:18.228391 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 590/1171] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:18 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:18.252662 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8779b6e-f63f-446f-8960-1f75cbcb1886 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.265299 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8779b6e-f63f-446f-8960-1f75cbcb1886 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.269642 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9b41a-e90c-415a-91da-55901eafe2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.270415 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9b41a-e90c-415a-91da-55901eafe2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.270693 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9b41a-e90c-415a-91da-55901eafe2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.270962 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9b41a-e90c-415a-91da-55901eafe2f8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.282386 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9b41a-e90c-415a-91da-55901eafe2f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:18.290155 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-f9d9b41a-e90c-415a-91da-55901eafe2f8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:47:18.291316 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 582/1172] 10.222.0.96 () {56 vars in 1117 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:18.297868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d15b1-3be0-4be4-bd89-d44e67ce30b8 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.307490 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d15b1-3be0-4be4-bd89-d44e67ce30b8 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.311948 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bb225-14af-4e07-89b7-f3e2798d593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.312596 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bb225-14af-4e07-89b7-f3e2798d593a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.312908 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bb225-14af-4e07-89b7-f3e2798d593a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.313177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bb225-14af-4e07-89b7-f3e2798d593a admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.313915 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bb225-14af-4e07-89b7-f3e2798d593a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:18.314216 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bb225-14af-4e07-89b7-f3e2798d593a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.315798 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bb225-14af-4e07-89b7-f3e2798d593a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.325164 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 591/1173] 10.222.0.96 () {56 vars in 1120 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:18.331435 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9b41a-e90c-415a-91da-55901eafe2f8 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.342402 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9b41a-e90c-415a-91da-55901eafe2f8 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.346909 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805a6ba-3ff2-4a52-8c34-1aa4ae08b68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.347671 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805a6ba-3ff2-4a52-8c34-1aa4ae08b68c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.347947 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805a6ba-3ff2-4a52-8c34-1aa4ae08b68c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.348214 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805a6ba-3ff2-4a52-8c34-1aa4ae08b68c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.358807 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805a6ba-3ff2-4a52-8c34-1aa4ae08b68c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.360620 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805a6ba-3ff2-4a52-8c34-1aa4ae08b68c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.377657 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-c805a6ba-3ff2-4a52-8c34-1aa4ae08b68c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:18.378827 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 583/1174] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:18.386051 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bb225-14af-4e07-89b7-f3e2798d593a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.395759 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bb225-14af-4e07-89b7-f3e2798d593a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.400384 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed635ab-88bd-4ec1-90a4-c86af0c4705a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.401055 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed635ab-88bd-4ec1-90a4-c86af0c4705a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.401339 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed635ab-88bd-4ec1-90a4-c86af0c4705a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.401611 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed635ab-88bd-4ec1-90a4-c86af0c4705a admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.402594 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed635ab-88bd-4ec1-90a4-c86af0c4705a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:18.402908 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed635ab-88bd-4ec1-90a4-c86af0c4705a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.404488 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed635ab-88bd-4ec1-90a4-c86af0c4705a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.416694 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 592/1175] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:18.422984 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805a6ba-3ff2-4a52-8c34-1aa4ae08b68c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.433110 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805a6ba-3ff2-4a52-8c34-1aa4ae08b68c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.437588 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c85f2-31aa-4c14-9cfe-cb97a7d4e337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.438376 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c85f2-31aa-4c14-9cfe-cb97a7d4e337 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.438658 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c85f2-31aa-4c14-9cfe-cb97a7d4e337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.438932 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c85f2-31aa-4c14-9cfe-cb97a7d4e337 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.446764 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c85f2-31aa-4c14-9cfe-cb97a7d4e337 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.448759 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c85f2-31aa-4c14-9cfe-cb97a7d4e337 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.463745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-c83c85f2-31aa-4c14-9cfe-cb97a7d4e337 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:47:18.464959 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 584/1176] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:18.471355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed635ab-88bd-4ec1-90a4-c86af0c4705a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.481215 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed635ab-88bd-4ec1-90a4-c86af0c4705a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.485705 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b9026-a347-4709-90da-59f664cd6ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.486355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b9026-a347-4709-90da-59f664cd6ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.486633 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b9026-a347-4709-90da-59f664cd6ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.486905 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b9026-a347-4709-90da-59f664cd6ae6 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.487720 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b9026-a347-4709-90da-59f664cd6ae6 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:18.488026 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b9026-a347-4709-90da-59f664cd6ae6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.489901 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b9026-a347-4709-90da-59f664cd6ae6 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.511855 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 593/1177] 10.222.0.96 () {56 vars in 1164 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:18.518609 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c85f2-31aa-4c14-9cfe-cb97a7d4e337 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.531486 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c85f2-31aa-4c14-9cfe-cb97a7d4e337 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.536473 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa4f63-cf7b-44e1-9d89-af4fa9f4f160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.537200 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa4f63-cf7b-44e1-9d89-af4fa9f4f160 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.537485 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa4f63-cf7b-44e1-9d89-af4fa9f4f160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.537756 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa4f63-cf7b-44e1-9d89-af4fa9f4f160 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.547897 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa4f63-cf7b-44e1-9d89-af4fa9f4f160 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.549696 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa4f63-cf7b-44e1-9d89-af4fa9f4f160 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.559949 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 585/1178] 10.222.0.96 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:18.566822 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b9026-a347-4709-90da-59f664cd6ae6 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.576439 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b9026-a347-4709-90da-59f664cd6ae6 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.580986 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fd7c5-459b-4e23-bd1a-93f5e4316240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.581760 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fd7c5-459b-4e23-bd1a-93f5e4316240 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.582040 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fd7c5-459b-4e23-bd1a-93f5e4316240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.582310 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fd7c5-459b-4e23-bd1a-93f5e4316240 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.592224 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fd7c5-459b-4e23-bd1a-93f5e4316240 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.594077 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fd7c5-459b-4e23-bd1a-93f5e4316240 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.611616 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-c97fd7c5-459b-4e23-bd1a-93f5e4316240 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:18.612824 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 594/1179] 10.222.0.96 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:18.620056 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa4f63-cf7b-44e1-9d89-af4fa9f4f160 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.628935 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa4f63-cf7b-44e1-9d89-af4fa9f4f160 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.633764 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44752ea5-d613-43f8-be64-a487117575e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.634403 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44752ea5-d613-43f8-be64-a487117575e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.634684 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44752ea5-d613-43f8-be64-a487117575e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.634960 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44752ea5-d613-43f8-be64-a487117575e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.635670 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44752ea5-d613-43f8-be64-a487117575e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:18.635971 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44752ea5-d613-43f8-be64-a487117575e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.637557 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44752ea5-d613-43f8-be64-a487117575e4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.649072 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 586/1180] 10.222.0.96 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:18.655421 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fd7c5-459b-4e23-bd1a-93f5e4316240 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.666008 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fd7c5-459b-4e23-bd1a-93f5e4316240 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.670500 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683f6b4-6db4-4d5a-895c-392f28ec56d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.671266 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683f6b4-6db4-4d5a-895c-392f28ec56d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.671540 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683f6b4-6db4-4d5a-895c-392f28ec56d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.671804 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683f6b4-6db4-4d5a-895c-392f28ec56d2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.678893 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683f6b4-6db4-4d5a-895c-392f28ec56d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.681511 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683f6b4-6db4-4d5a-895c-392f28ec56d2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.694013 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING keystone.server.flask.application [None req-2683f6b4-6db4-4d5a-895c-392f28ec56d2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:18.695191 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 595/1181] 10.222.0.96 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:18.701717 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44752ea5-d613-43f8-be64-a487117575e4 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.711268 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44752ea5-d613-43f8-be64-a487117575e4 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.715811 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c454f9-f3fa-4f50-b6ca-29f38db03dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.716451 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c454f9-f3fa-4f50-b6ca-29f38db03dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.716734 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c454f9-f3fa-4f50-b6ca-29f38db03dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.717040 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c454f9-f3fa-4f50-b6ca-29f38db03dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.717814 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c454f9-f3fa-4f50-b6ca-29f38db03dd9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:18.718123 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c454f9-f3fa-4f50-b6ca-29f38db03dd9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.720000 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c454f9-f3fa-4f50-b6ca-29f38db03dd9 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.732860 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 587/1182] 10.222.0.96 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:18.739467 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683f6b4-6db4-4d5a-895c-392f28ec56d2 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.750751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683f6b4-6db4-4d5a-895c-392f28ec56d2 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.755202 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bb1a7-944d-48db-a451-525d9d146763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.755829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bb1a7-944d-48db-a451-525d9d146763 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.756102 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bb1a7-944d-48db-a451-525d9d146763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.756369 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bb1a7-944d-48db-a451-525d9d146763 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.757569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bb1a7-944d-48db-a451-525d9d146763 admin admin] RBAC: Adding query filter params (role.id=253c0a1dc8d6421298a7987caaa55676, scope.project.id=356ecb479ba24136a7c38cb5a58a0a18, user.id=88a16f0ecf3448428e969359be57dda8) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:18.757876 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bb1a7-944d-48db-a451-525d9d146763 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.759689 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bb1a7-944d-48db-a451-525d9d146763 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.765435 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 596/1183] 10.222.0.96 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/role_assignments?user.id=88a16f0ecf3448428e969359be57dda8&scope.project.id=356ecb479ba24136a7c38cb5a58a0a18&role.id=253c0a1dc8d6421298a7987caaa55676 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:20.957590 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be22c75-7435-46ba-bff4-11d43f8472f9 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.958113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be22c75-7435-46ba-bff4-11d43f8472f9 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.958113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be22c75-7435-46ba-bff4-11d43f8472f9 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.959828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 588/1184] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:20.968251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fa93e-a768-4bd3-8448-5d76deed6c85 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.968827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fa93e-a768-4bd3-8448-5d76deed6c85 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.968827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fa93e-a768-4bd3-8448-5d76deed6c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.985865 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-950fa93e-a768-4bd3-8448-5d76deed6c85 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:20.987044 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-950fa93e-a768-4bd3-8448-5d76deed6c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:20.994676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 597/1185] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:20 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:21.017921 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be22c75-7435-46ba-bff4-11d43f8472f9 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:21.030726 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be22c75-7435-46ba-bff4-11d43f8472f9 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:21.035346 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82420c42-23d9-4165-a143-750cbd4fab6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:21.036125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420c42-23d9-4165-a143-750cbd4fab6a admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:21.036402 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420c42-23d9-4165-a143-750cbd4fab6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:21.036674 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420c42-23d9-4165-a143-750cbd4fab6a admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:21.037350 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82420c42-23d9-4165-a143-750cbd4fab6a admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:21.038996 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82420c42-23d9-4165-a143-750cbd4fab6a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:21.050004 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-82420c42-23d9-4165-a143-750cbd4fab6a admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 28 01:47:21.051193 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 589/1186] 10.222.0.96 () {56 vars in 1138 bytes} [Fri Jan 28 01:47:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:21.058272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fa93e-a768-4bd3-8448-5d76deed6c85 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:21.067066 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fa93e-a768-4bd3-8448-5d76deed6c85 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:21.072091 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b45f75-3dd8-4cfc-bc18-7c0ba3a17425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:21.072730 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b45f75-3dd8-4cfc-bc18-7c0ba3a17425 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:21.073234 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b45f75-3dd8-4cfc-bc18-7c0ba3a17425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:21.073505 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b45f75-3dd8-4cfc-bc18-7c0ba3a17425 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:21.074197 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b45f75-3dd8-4cfc-bc18-7c0ba3a17425 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:21.074499 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b45f75-3dd8-4cfc-bc18-7c0ba3a17425 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:21.076071 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b45f75-3dd8-4cfc-bc18-7c0ba3a17425 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:21.081003 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 598/1187] 10.222.0.96 () {56 vars in 1137 bytes} [Fri Jan 28 01:47:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:21.088077 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82420c42-23d9-4165-a143-750cbd4fab6a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:21.097911 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82420c42-23d9-4165-a143-750cbd4fab6a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:21.102596 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae555f-b7d4-41a0-9923-90cb1a00511a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:21.103253 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae555f-b7d4-41a0-9923-90cb1a00511a admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:21.103533 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae555f-b7d4-41a0-9923-90cb1a00511a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:21.103807 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae555f-b7d4-41a0-9923-90cb1a00511a admin admin] PATH_INFO: `/v3/services` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:21.104510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae555f-b7d4-41a0-9923-90cb1a00511a admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:21.104826 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae555f-b7d4-41a0-9923-90cb1a00511a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:21.106415 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae555f-b7d4-41a0-9923-90cb1a00511a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:21.111315 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 590/1188] 10.222.0.96 () {56 vars in 1137 bytes} [Fri Jan 28 01:47:21 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:23.305652 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9276ec-edb8-4b6b-b111-ce9b0555c250 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:23.306174 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9276ec-edb8-4b6b-b111-ce9b0555c250 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:23.306174 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9276ec-edb8-4b6b-b111-ce9b0555c250 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:23.307946 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 599/1189] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:47:23.315042 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856a0cd-7a7a-43ce-a93a-0cb88437febf None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:23.315487 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856a0cd-7a7a-43ce-a93a-0cb88437febf None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:23.315582 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856a0cd-7a7a-43ce-a93a-0cb88437febf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:23.333139 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-b856a0cd-7a7a-43ce-a93a-0cb88437febf None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:23.334297 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b856a0cd-7a7a-43ce-a93a-0cb88437febf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:23.342707 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 591/1190] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:23 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:23.366755 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9276ec-edb8-4b6b-b111-ce9b0555c250 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:23.378615 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9276ec-edb8-4b6b-b111-ce9b0555c250 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:23.383803 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1ab3d-821e-457f-a795-a9a2f73ee38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:23.384497 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1ab3d-821e-457f-a795-a9a2f73ee38a admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:23.384773 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1ab3d-821e-457f-a795-a9a2f73ee38a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:23.385086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1ab3d-821e-457f-a795-a9a2f73ee38a admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:23.385891 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1ab3d-821e-457f-a795-a9a2f73ee38a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:23.387546 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1ab3d-821e-457f-a795-a9a2f73ee38a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:23.404561 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 600/1191] 10.222.0.96 () {60 vars in 1162 bytes} [Fri Jan 28 01:47:23 2022] POST /identity/v3/services => generated 246 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:47:25.650004 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6b167-745c-4d74-946b-2e5523ef8ecd None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:25.650528 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6b167-745c-4d74-946b-2e5523ef8ecd None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:25.650528 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6b167-745c-4d74-946b-2e5523ef8ecd None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:25.652315 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 592/1192] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:47:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:25.660006 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e83b78-cf7c-455e-a611-d92b995d8bce None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:25.660504 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e83b78-cf7c-455e-a611-d92b995d8bce None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:25.660595 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e83b78-cf7c-455e-a611-d92b995d8bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:25.678582 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-76e83b78-cf7c-455e-a611-d92b995d8bce None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:25.680609 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-76e83b78-cf7c-455e-a611-d92b995d8bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:25.703905 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 601/1193] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:25.728435 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6b167-745c-4d74-946b-2e5523ef8ecd None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:25.740515 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6b167-745c-4d74-946b-2e5523ef8ecd None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:25.745568 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19b993-8890-4fd4-9894-26a258bf8c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:25.746341 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19b993-8890-4fd4-9894-26a258bf8c41 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:25.746617 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19b993-8890-4fd4-9894-26a258bf8c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:25.746884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19b993-8890-4fd4-9894-26a258bf8c41 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:25.747518 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19b993-8890-4fd4-9894-26a258bf8c41 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:25.749115 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19b993-8890-4fd4-9894-26a258bf8c41 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:25.760138 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-8e19b993-8890-4fd4-9894-26a258bf8c41 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 28 01:47:25.761333 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 593/1194] 10.222.0.96 () {56 vars in 1138 bytes} [Fri Jan 28 01:47:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:25.767836 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e83b78-cf7c-455e-a611-d92b995d8bce None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:25.777149 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e83b78-cf7c-455e-a611-d92b995d8bce None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:25.781926 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd9a6a-7458-40fb-8701-26f8f722e5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:25.782571 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd9a6a-7458-40fb-8701-26f8f722e5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:25.782849 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd9a6a-7458-40fb-8701-26f8f722e5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:25.783120 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd9a6a-7458-40fb-8701-26f8f722e5d5 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:25.783818 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd9a6a-7458-40fb-8701-26f8f722e5d5 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:25.784120 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd9a6a-7458-40fb-8701-26f8f722e5d5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:25.785754 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd9a6a-7458-40fb-8701-26f8f722e5d5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:25.792152 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 602/1195] 10.222.0.96 () {56 vars in 1137 bytes} [Fri Jan 28 01:47:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:25.799094 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19b993-8890-4fd4-9894-26a258bf8c41 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:25.808852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19b993-8890-4fd4-9894-26a258bf8c41 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:25.813209 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65c480-b6d7-4179-83ee-dc4580dde0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:25.813846 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65c480-b6d7-4179-83ee-dc4580dde0ac admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:25.814126 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65c480-b6d7-4179-83ee-dc4580dde0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:25.814402 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65c480-b6d7-4179-83ee-dc4580dde0ac admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:25.815176 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65c480-b6d7-4179-83ee-dc4580dde0ac admin admin] RBAC: Adding query filter params (interface=public, service_id=7ab0b37a08d14dd6932db52f6c74e79d, region_id=RegionOne) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:25.815485 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65c480-b6d7-4179-83ee-dc4580dde0ac admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:25.817076 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65c480-b6d7-4179-83ee-dc4580dde0ac admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:25.822099 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 594/1196] 10.222.0.96 () {56 vars in 1272 bytes} [Fri Jan 28 01:47:25 2022] GET /identity/v3/endpoints?service_id=7ab0b37a08d14dd6932db52f6c74e79d&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:25.828282 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd9a6a-7458-40fb-8701-26f8f722e5d5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:25.838180 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd9a6a-7458-40fb-8701-26f8f722e5d5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:25.842575 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035769ce-4364-492b-92af-4d4b92843a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:25.843209 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035769ce-4364-492b-92af-4d4b92843a70 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:25.843484 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035769ce-4364-492b-92af-4d4b92843a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:25.843750 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035769ce-4364-492b-92af-4d4b92843a70 admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:25.844409 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035769ce-4364-492b-92af-4d4b92843a70 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:25.846005 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035769ce-4364-492b-92af-4d4b92843a70 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:25.853988 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 603/1197] 10.222.0.96 () {56 vars in 1108 bytes} [Fri Jan 28 01:47:25 2022] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:47:28.020737 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b17cc3-84e6-413c-b8b0-eae1fff98d36 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:28.021284 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b17cc3-84e6-413c-b8b0-eae1fff98d36 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:28.021284 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b17cc3-84e6-413c-b8b0-eae1fff98d36 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:28.023233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 595/1198] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:47:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:28.030344 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d7ffe-97f9-4703-94eb-eeabc302dd69 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:28.030763 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d7ffe-97f9-4703-94eb-eeabc302dd69 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:28.030900 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d7ffe-97f9-4703-94eb-eeabc302dd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:28.048433 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-8f4d7ffe-97f9-4703-94eb-eeabc302dd69 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:28.049636 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-8f4d7ffe-97f9-4703-94eb-eeabc302dd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:28.058202 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 604/1199] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:28.082184 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b17cc3-84e6-413c-b8b0-eae1fff98d36 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:28.093943 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b17cc3-84e6-413c-b8b0-eae1fff98d36 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:28.098167 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6897e-9855-401f-a9bd-720490043b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:28.099222 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6897e-9855-401f-a9bd-720490043b34 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:28.099497 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6897e-9855-401f-a9bd-720490043b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:28.099765 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6897e-9855-401f-a9bd-720490043b34 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:28.100891 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6897e-9855-401f-a9bd-720490043b34 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:28.102449 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6897e-9855-401f-a9bd-720490043b34 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:28.112872 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING keystone.server.flask.application [None req-c7e6897e-9855-401f-a9bd-720490043b34 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 28 01:47:28.113965 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 596/1200] 10.222.0.96 () {56 vars in 1138 bytes} [Fri Jan 28 01:47:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:28.121027 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d7ffe-97f9-4703-94eb-eeabc302dd69 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:28.129826 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d7ffe-97f9-4703-94eb-eeabc302dd69 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:28.134962 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a9854-61d6-4c5e-b26f-1bba6ea7c8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:28.135603 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a9854-61d6-4c5e-b26f-1bba6ea7c8ae admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:28.135884 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a9854-61d6-4c5e-b26f-1bba6ea7c8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:28.136155 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a9854-61d6-4c5e-b26f-1bba6ea7c8ae admin admin] PATH_INFO: `/v3/services` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:28.136880 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a9854-61d6-4c5e-b26f-1bba6ea7c8ae admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:28.137184 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a9854-61d6-4c5e-b26f-1bba6ea7c8ae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:28.138754 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a9854-61d6-4c5e-b26f-1bba6ea7c8ae admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:28.143722 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 605/1201] 10.222.0.96 () {56 vars in 1137 bytes} [Fri Jan 28 01:47:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:28.149641 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6897e-9855-401f-a9bd-720490043b34 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:28.159564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6897e-9855-401f-a9bd-720490043b34 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:28.164216 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a16350-9c83-4d8d-bcff-777da146089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:28.164851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a16350-9c83-4d8d-bcff-777da146089b admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:28.165134 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a16350-9c83-4d8d-bcff-777da146089b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:28.165404 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a16350-9c83-4d8d-bcff-777da146089b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:28.166113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a16350-9c83-4d8d-bcff-777da146089b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:28.167632 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a16350-9c83-4d8d-bcff-777da146089b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:28.185691 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 597/1202] 10.222.0.96 () {60 vars in 1165 bytes} [Fri Jan 28 01:47:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:48:32.386272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bb2eb-8092-48ac-86da-1f13d6c3de96 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:32.387414 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bb2eb-8092-48ac-86da-1f13d6c3de96 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:32.387930 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bb2eb-8092-48ac-86da-1f13d6c3de96 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:32.399698 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6775e-13a0-4c77-9eb0-8634d1ad270c None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:32.400745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6775e-13a0-4c77-9eb0-8634d1ad270c None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:32.401306 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6775e-13a0-4c77-9eb0-8634d1ad270c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:32.405182 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 606/1203] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:48:32 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:48:32.492278 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-b4a6775e-13a0-4c77-9eb0-8634d1ad270c None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:32.493948 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b4a6775e-13a0-4c77-9eb0-8634d1ad270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:32.633865 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 598/1204] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:32.666187 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bb2eb-8092-48ac-86da-1f13d6c3de96 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:32.668247 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-289bb2eb-8092-48ac-86da-1f13d6c3de96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:32.934781 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bb2eb-8092-48ac-86da-1f13d6c3de96 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:33.157604 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b360f-8c82-47a3-84dd-99b134668d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:33.158283 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b360f-8c82-47a3-84dd-99b134668d61 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:33.159014 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b360f-8c82-47a3-84dd-99b134668d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:33.161518 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b360f-8c82-47a3-84dd-99b134668d61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:33.162802 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b360f-8c82-47a3-84dd-99b134668d61 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:33.164905 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b360f-8c82-47a3-84dd-99b134668d61 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:33.196093 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 607/1205] 10.222.0.96 () {56 vars in 1108 bytes} [Fri Jan 28 01:48:32 2022] GET /identity/v3/projects => generated 2553 bytes in 530 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:48:35.547480 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491eaf0d-02ef-4ebb-8f81-da49efc16c6f None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:35.548028 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491eaf0d-02ef-4ebb-8f81-da49efc16c6f None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:35.548028 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491eaf0d-02ef-4ebb-8f81-da49efc16c6f None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:35.549864 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 599/1206] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:48:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:35.558446 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c2592-bb49-4036-93da-4f81d28ba915 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:35.559004 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c2592-bb49-4036-93da-4f81d28ba915 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:35.559004 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c2592-bb49-4036-93da-4f81d28ba915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:35.629699 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-226c2592-bb49-4036-93da-4f81d28ba915 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:35.630911 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-226c2592-bb49-4036-93da-4f81d28ba915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:35.725756 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 608/1207] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:35 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:35.777301 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0288ee7-1288-42ad-9142-498587bda877 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:35.777577 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0288ee7-1288-42ad-9142-498587bda877 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:35.777850 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0288ee7-1288-42ad-9142-498587bda877 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:35.779644 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 600/1208] 10.222.0.96 () {54 vars in 963 bytes} [Fri Jan 28 01:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:35.786271 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636d235-c686-408f-be11-2dc57e4e0120 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:35.786632 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636d235-c686-408f-be11-2dc57e4e0120 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:35.786984 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636d235-c686-408f-be11-2dc57e4e0120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:35.878683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-5636d235-c686-408f-be11-2dc57e4e0120 None None] MFA Rules not processed for user `4acc32735f0a418ba5620f6225500402`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:35.879945 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-5636d235-c686-408f-be11-2dc57e4e0120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:35.964998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 609/1209] 10.222.0.96 () {58 vars in 1060 bytes} [Fri Jan 28 01:48:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:35.974294 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0288ee7-1288-42ad-9142-498587bda877 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:35.975811 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-f0288ee7-1288-42ad-9142-498587bda877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:36.075396 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0288ee7-1288-42ad-9142-498587bda877 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:36.149755 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c73405-d632-4b28-872d-b1f8991b3c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:36.150403 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c73405-d632-4b28-872d-b1f8991b3c8a service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:36.150757 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c73405-d632-4b28-872d-b1f8991b3c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:36.150945 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c73405-d632-4b28-872d-b1f8991b3c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:36.152614 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-53c73405-d632-4b28-872d-b1f8991b3c8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:36.256370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c73405-d632-4b28-872d-b1f8991b3c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:36.258510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c73405-d632-4b28-872d-b1f8991b3c8a service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:36.275406 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 601/1210] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:48:35 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:38.748353 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01613a-43ee-4a19-9db1-eef07df9be2f None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:38.748965 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01613a-43ee-4a19-9db1-eef07df9be2f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:38.748965 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01613a-43ee-4a19-9db1-eef07df9be2f None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:38.750717 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 610/1211] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:48:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:38.758628 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad227ef1-1e0a-49ea-8b22-15fa965d2212 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:38.759105 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad227ef1-1e0a-49ea-8b22-15fa965d2212 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:38.759204 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad227ef1-1e0a-49ea-8b22-15fa965d2212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:38.823539 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-ad227ef1-1e0a-49ea-8b22-15fa965d2212 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:38.824692 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ad227ef1-1e0a-49ea-8b22-15fa965d2212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:38.917297 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 602/1212] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:38 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:38.958070 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01613a-43ee-4a19-9db1-eef07df9be2f None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:38.959614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-4f01613a-43ee-4a19-9db1-eef07df9be2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:39.064472 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01613a-43ee-4a19-9db1-eef07df9be2f None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:39.134988 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feba612-eae3-44e3-9594-c510a164a696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:39.135538 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feba612-eae3-44e3-9594-c510a164a696 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:39.135813 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feba612-eae3-44e3-9594-c510a164a696 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:39.136077 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feba612-eae3-44e3-9594-c510a164a696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:39.137708 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-4feba612-eae3-44e3-9594-c510a164a696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:39.243754 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feba612-eae3-44e3-9594-c510a164a696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:39.245219 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feba612-eae3-44e3-9594-c510a164a696 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:39.270996 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 611/1213] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:48:38 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:41.778480 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a4a55-d0a6-4dab-981f-665ccc91c69b None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:41.779034 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a4a55-d0a6-4dab-981f-665ccc91c69b None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:41.779034 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a4a55-d0a6-4dab-981f-665ccc91c69b None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:41.780847 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 603/1214] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:48:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:41.788297 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649224dc-8cc4-4bb3-9541-f88fd68104b2 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:41.789241 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649224dc-8cc4-4bb3-9541-f88fd68104b2 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:41.789427 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649224dc-8cc4-4bb3-9541-f88fd68104b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:41.854840 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-649224dc-8cc4-4bb3-9541-f88fd68104b2 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:41.856015 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-649224dc-8cc4-4bb3-9541-f88fd68104b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:41.951281 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 612/1215] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:41 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:41.987004 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a4a55-d0a6-4dab-981f-665ccc91c69b None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:41.988640 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-8f2a4a55-d0a6-4dab-981f-665ccc91c69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:42.112172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a4a55-d0a6-4dab-981f-665ccc91c69b None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:42.200351 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adead4ea-1b7e-4cf9-b9f2-f0ede9dc72cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:42.201220 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adead4ea-1b7e-4cf9-b9f2-f0ede9dc72cc admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:42.201495 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adead4ea-1b7e-4cf9-b9f2-f0ede9dc72cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:42.201761 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adead4ea-1b7e-4cf9-b9f2-f0ede9dc72cc admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:42.211602 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adead4ea-1b7e-4cf9-b9f2-f0ede9dc72cc admin admin] RBAC: Authorizing `identity:get_project(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:42.213635 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adead4ea-1b7e-4cf9-b9f2-f0ede9dc72cc admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:42.215314 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 604/1216] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:41 2022] GET /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:42.229056 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649224dc-8cc4-4bb3-9541-f88fd68104b2 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:42.230372 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-649224dc-8cc4-4bb3-9541-f88fd68104b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:42.319022 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649224dc-8cc4-4bb3-9541-f88fd68104b2 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:42.390989 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04f3ec-e3db-4292-8c5b-c9caa7d6c829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:42.391540 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04f3ec-e3db-4292-8c5b-c9caa7d6c829 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:42.391816 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04f3ec-e3db-4292-8c5b-c9caa7d6c829 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:42.392083 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04f3ec-e3db-4292-8c5b-c9caa7d6c829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:42.393745 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-bf04f3ec-e3db-4292-8c5b-c9caa7d6c829 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:42.498094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04f3ec-e3db-4292-8c5b-c9caa7d6c829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:42.499524 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04f3ec-e3db-4292-8c5b-c9caa7d6c829 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:42.519852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 613/1217] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:48:42 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:45.231114 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48efa9-e73a-4eb5-8904-62c2ab5ff808 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:45.231685 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48efa9-e73a-4eb5-8904-62c2ab5ff808 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:45.231685 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48efa9-e73a-4eb5-8904-62c2ab5ff808 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:45.233473 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 605/1218] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:48:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:45.240497 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db1a6d-3e5e-449d-b565-c29ec9c20708 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:45.240971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db1a6d-3e5e-449d-b565-c29ec9c20708 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:45.241080 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db1a6d-3e5e-449d-b565-c29ec9c20708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:45.307616 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-d8db1a6d-3e5e-449d-b565-c29ec9c20708 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:45.308861 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-d8db1a6d-3e5e-449d-b565-c29ec9c20708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:45.402564 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 614/1219] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:45 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:48:45.437505 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48efa9-e73a-4eb5-8904-62c2ab5ff808 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:45.439030 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-8f48efa9-e73a-4eb5-8904-62c2ab5ff808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:45.560719 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48efa9-e73a-4eb5-8904-62c2ab5ff808 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:45.649260 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862fabd-b75a-4918-8427-80b676f03704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:45.650121 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862fabd-b75a-4918-8427-80b676f03704 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:45.650383 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862fabd-b75a-4918-8427-80b676f03704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:45.650650 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862fabd-b75a-4918-8427-80b676f03704 admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:45.660297 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862fabd-b75a-4918-8427-80b676f03704 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:45.662334 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862fabd-b75a-4918-8427-80b676f03704 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:45.664851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 606/1220] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:45 2022] GET /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:45.695727 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414691c7-41a5-4c02-b84f-f1b6c5730784 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:45.696022 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414691c7-41a5-4c02-b84f-f1b6c5730784 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:45.696302 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414691c7-41a5-4c02-b84f-f1b6c5730784 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:45.698112 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 615/1221] 10.222.0.96 () {54 vars in 963 bytes} [Fri Jan 28 01:48:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:45.704667 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb4068-639a-43f0-b2e8-0cfca3c222b0 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:45.704993 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb4068-639a-43f0-b2e8-0cfca3c222b0 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:45.705267 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb4068-639a-43f0-b2e8-0cfca3c222b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:45.778127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-05fb4068-639a-43f0-b2e8-0cfca3c222b0 None None] MFA Rules not processed for user `4acc32735f0a418ba5620f6225500402`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:45.779338 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-05fb4068-639a-43f0-b2e8-0cfca3c222b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:45.851107 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 607/1222] 10.222.0.96 () {58 vars in 1060 bytes} [Fri Jan 28 01:48:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:45.860247 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414691c7-41a5-4c02-b84f-f1b6c5730784 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:45.861783 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-414691c7-41a5-4c02-b84f-f1b6c5730784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:45.962254 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414691c7-41a5-4c02-b84f-f1b6c5730784 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:46.033124 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7911fc-2856-4f1c-bd31-09bea2af9a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:46.034046 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7911fc-2856-4f1c-bd31-09bea2af9a5b service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:46.034346 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7911fc-2856-4f1c-bd31-09bea2af9a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:46.034618 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7911fc-2856-4f1c-bd31-09bea2af9a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:46.036243 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-3d7911fc-2856-4f1c-bd31-09bea2af9a5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:46.141929 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7911fc-2856-4f1c-bd31-09bea2af9a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:46.143390 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7911fc-2856-4f1c-bd31-09bea2af9a5b service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:46.162270 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 616/1223] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:48:45 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:49.507920 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff118156-d4d1-4c79-b87e-2469bae74292 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:49.508447 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff118156-d4d1-4c79-b87e-2469bae74292 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:49.508447 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff118156-d4d1-4c79-b87e-2469bae74292 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:49.510294 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 608/1224] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:48:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:49.517774 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2e06c-cc57-473a-a221-1474508e7460 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:49.518264 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2e06c-cc57-473a-a221-1474508e7460 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:49.518365 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2e06c-cc57-473a-a221-1474508e7460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:49.583536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-fee2e06c-cc57-473a-a221-1474508e7460 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:49.584733 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-fee2e06c-cc57-473a-a221-1474508e7460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:49.679614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 617/1225] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:49 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:49.716723 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff118156-d4d1-4c79-b87e-2469bae74292 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:49.718288 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ff118156-d4d1-4c79-b87e-2469bae74292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:49.820360 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff118156-d4d1-4c79-b87e-2469bae74292 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:49.897048 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568952b-3efa-40dd-8a2c-e153efe50c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:49.897701 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568952b-3efa-40dd-8a2c-e153efe50c6c service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:49.898510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568952b-3efa-40dd-8a2c-e153efe50c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:49.898787 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568952b-3efa-40dd-8a2c-e153efe50c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:49.900412 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2568952b-3efa-40dd-8a2c-e153efe50c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:50.008779 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568952b-3efa-40dd-8a2c-e153efe50c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:50.010531 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568952b-3efa-40dd-8a2c-e153efe50c6c service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:50.028992 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 609/1226] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:48:49 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:52.315491 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9599d-ce60-430c-9bf3-8b7939ceeca6 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:52.316041 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9599d-ce60-430c-9bf3-8b7939ceeca6 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:52.316041 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9599d-ce60-430c-9bf3-8b7939ceeca6 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:52.317858 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 618/1227] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:52.326541 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d18b9d-05fd-4dc7-b8cf-15200692c279 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:52.327026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d18b9d-05fd-4dc7-b8cf-15200692c279 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:52.327160 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d18b9d-05fd-4dc7-b8cf-15200692c279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:52.392210 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-a1d18b9d-05fd-4dc7-b8cf-15200692c279 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:52.393455 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-a1d18b9d-05fd-4dc7-b8cf-15200692c279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:52.488132 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 610/1228] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:52 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:52.527289 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9599d-ce60-430c-9bf3-8b7939ceeca6 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:52.529007 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-05f9599d-ce60-430c-9bf3-8b7939ceeca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:52.636063 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9599d-ce60-430c-9bf3-8b7939ceeca6 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:52.711495 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9575c-1391-440a-9850-a1e95e7923ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:52.712050 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9575c-1391-440a-9850-a1e95e7923ff service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:52.712332 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9575c-1391-440a-9850-a1e95e7923ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:52.712603 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9575c-1391-440a-9850-a1e95e7923ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:52.714252 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-afb9575c-1391-440a-9850-a1e95e7923ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:52.822599 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9575c-1391-440a-9850-a1e95e7923ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:52.824168 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9575c-1391-440a-9850-a1e95e7923ff service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:52.841946 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 619/1229] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:48:52 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:48:55.177363 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9108103-99cb-42da-8f3c-60632573b65b None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:55.177917 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9108103-99cb-42da-8f3c-60632573b65b None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:55.178274 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9108103-99cb-42da-8f3c-60632573b65b None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:55.180352 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 611/1230] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:48:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:55.187693 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f299dc-94e7-44e3-85db-b979aab37f71 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:55.188160 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f299dc-94e7-44e3-85db-b979aab37f71 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:55.188394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f299dc-94e7-44e3-85db-b979aab37f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:55.254056 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-c9f299dc-94e7-44e3-85db-b979aab37f71 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:55.255254 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c9f299dc-94e7-44e3-85db-b979aab37f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:55.348913 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 620/1231] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:55 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:55.383485 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9108103-99cb-42da-8f3c-60632573b65b None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:55.385066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b9108103-99cb-42da-8f3c-60632573b65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:55.514248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9108103-99cb-42da-8f3c-60632573b65b None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:55.607500 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c40881-4d4f-49f1-9745-57e75c3f9e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:55.608406 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c40881-4d4f-49f1-9745-57e75c3f9e8d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:55.608674 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c40881-4d4f-49f1-9745-57e75c3f9e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:55.608969 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c40881-4d4f-49f1-9745-57e75c3f9e8d admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:55.619213 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c40881-4d4f-49f1-9745-57e75c3f9e8d admin admin] RBAC: Authorizing `identity:get_project(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:55.621308 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c40881-4d4f-49f1-9745-57e75c3f9e8d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:55.623184 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 612/1232] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:55 2022] GET /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:55.636751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f299dc-94e7-44e3-85db-b979aab37f71 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:55.637994 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c9f299dc-94e7-44e3-85db-b979aab37f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:55.734905 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f299dc-94e7-44e3-85db-b979aab37f71 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:55.811757 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b86d3a-619d-4aad-93f2-3cbb6bb1c406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:55.812399 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b86d3a-619d-4aad-93f2-3cbb6bb1c406 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:55.812680 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b86d3a-619d-4aad-93f2-3cbb6bb1c406 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:55.812979 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b86d3a-619d-4aad-93f2-3cbb6bb1c406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:55.814612 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-40b86d3a-619d-4aad-93f2-3cbb6bb1c406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:55.926869 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b86d3a-619d-4aad-93f2-3cbb6bb1c406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:55.928313 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b86d3a-619d-4aad-93f2-3cbb6bb1c406 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:55.968537 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 621/1233] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:48:55 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:58.510565 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea65747-34ca-4988-a56f-c6334f59f443 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:58.511131 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea65747-34ca-4988-a56f-c6334f59f443 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:58.511131 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea65747-34ca-4988-a56f-c6334f59f443 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:58.512914 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 613/1234] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:48:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:48:58.520373 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544890c5-e28e-4193-ad42-0ee11fb2115e None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:58.520823 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544890c5-e28e-4193-ad42-0ee11fb2115e None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:58.520968 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544890c5-e28e-4193-ad42-0ee11fb2115e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:58.587614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-544890c5-e28e-4193-ad42-0ee11fb2115e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:58.588874 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-544890c5-e28e-4193-ad42-0ee11fb2115e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:58.687572 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 622/1235] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:58 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:58.725817 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea65747-34ca-4988-a56f-c6334f59f443 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:58.727646 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-9ea65747-34ca-4988-a56f-c6334f59f443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:58.853153 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea65747-34ca-4988-a56f-c6334f59f443 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:58.964858 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e7ab9-513d-4075-acc3-9abe2d7c9457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:58.965513 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e7ab9-513d-4075-acc3-9abe2d7c9457 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:58.965794 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e7ab9-513d-4075-acc3-9abe2d7c9457 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:58.966070 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e7ab9-513d-4075-acc3-9abe2d7c9457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:58.967715 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-888e7ab9-513d-4075-acc3-9abe2d7c9457 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:59.078267 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e7ab9-513d-4075-acc3-9abe2d7c9457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:59.079703 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e7ab9-513d-4075-acc3-9abe2d7c9457 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:59.098126 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 614/1236] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:48:58 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:01.390649 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a4416-73c0-4378-84f6-b3734a45e254 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.391180 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a4416-73c0-4378-84f6-b3734a45e254 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.391180 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a4416-73c0-4378-84f6-b3734a45e254 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.393037 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 623/1237] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:49:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:01.400394 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68156e3f-4509-410a-8226-617d477919cc None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.400842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68156e3f-4509-410a-8226-617d477919cc None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.401000 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68156e3f-4509-410a-8226-617d477919cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.464787 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-68156e3f-4509-410a-8226-617d477919cc None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:01.466011 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-68156e3f-4509-410a-8226-617d477919cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:01.561387 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 615/1238] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:01 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:01.602782 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a4416-73c0-4378-84f6-b3734a45e254 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:01.604288 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-e25a4416-73c0-4378-84f6-b3734a45e254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:01.703289 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a4416-73c0-4378-84f6-b3734a45e254 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:01.772338 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e075c8-a0da-4d67-8fff-2066937dfc91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:01.773077 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e075c8-a0da-4d67-8fff-2066937dfc91 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:01.773416 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e075c8-a0da-4d67-8fff-2066937dfc91 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:01.773786 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e075c8-a0da-4d67-8fff-2066937dfc91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:01.775395 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b7e075c8-a0da-4d67-8fff-2066937dfc91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:01.884092 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e075c8-a0da-4d67-8fff-2066937dfc91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:01.885663 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e075c8-a0da-4d67-8fff-2066937dfc91 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:01.905010 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 624/1239] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:49:01 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:04.434892 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa64cbb-0f9a-4a8a-8858-07ee6308f9d9 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:04.435328 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa64cbb-0f9a-4a8a-8858-07ee6308f9d9 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:04.435444 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa64cbb-0f9a-4a8a-8858-07ee6308f9d9 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:04.437612 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 616/1240] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:49:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:04.445423 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ec93c-e82b-4410-ac94-894e64a66549 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:04.446559 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ec93c-e82b-4410-ac94-894e64a66549 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:04.446559 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ec93c-e82b-4410-ac94-894e64a66549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:04.517495 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-a59ec93c-e82b-4410-ac94-894e64a66549 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:04.518699 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a59ec93c-e82b-4410-ac94-894e64a66549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:04.623617 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 625/1241] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:04 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:04.662120 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa64cbb-0f9a-4a8a-8858-07ee6308f9d9 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:04.665449 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-8aa64cbb-0f9a-4a8a-8858-07ee6308f9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:04.759238 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa64cbb-0f9a-4a8a-8858-07ee6308f9d9 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:04.762826 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1fda8-cfea-4e36-a3f2-e693d129cf48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:04.763465 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1fda8-cfea-4e36-a3f2-e693d129cf48 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:04.763744 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1fda8-cfea-4e36-a3f2-e693d129cf48 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:04.764018 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1fda8-cfea-4e36-a3f2-e693d129cf48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:04.772901 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1fda8-cfea-4e36-a3f2-e693d129cf48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:04.774846 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1fda8-cfea-4e36-a3f2-e693d129cf48 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:04.783990 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 617/1242] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:49:04 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:09.052600 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85564dc-b0f4-4c7e-aabe-c9c782fe427f None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:09.053231 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85564dc-b0f4-4c7e-aabe-c9c782fe427f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:09.053231 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85564dc-b0f4-4c7e-aabe-c9c782fe427f None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:09.055640 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 626/1243] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:09.063172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30e609-ac86-4997-a4d2-8f2b5dcbf937 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:09.063649 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30e609-ac86-4997-a4d2-8f2b5dcbf937 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:09.063750 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30e609-ac86-4997-a4d2-8f2b5dcbf937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:09.081366 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-de30e609-ac86-4997-a4d2-8f2b5dcbf937 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:09.082594 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-de30e609-ac86-4997-a4d2-8f2b5dcbf937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:09.090514 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 618/1244] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:09 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:09.129451 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85564dc-b0f4-4c7e-aabe-c9c782fe427f None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:09.131200 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-f85564dc-b0f4-4c7e-aabe-c9c782fe427f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:09.144278 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85564dc-b0f4-4c7e-aabe-c9c782fe427f None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:09.147861 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f690d-eabf-40f3-a412-2fc34c5535e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:09.148667 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f690d-eabf-40f3-a412-2fc34c5535e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:09.148995 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f690d-eabf-40f3-a412-2fc34c5535e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:09.149326 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f690d-eabf-40f3-a412-2fc34c5535e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:09.158234 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f690d-eabf-40f3-a412-2fc34c5535e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:09.159909 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f690d-eabf-40f3-a412-2fc34c5535e5 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:09.169708 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 627/1245] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:49:09 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:12.004376 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a41ae-0ddb-4b34-a872-a4b6cab98816 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:12.004928 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a41ae-0ddb-4b34-a872-a4b6cab98816 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:12.004928 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a41ae-0ddb-4b34-a872-a4b6cab98816 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:12.006731 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 619/1246] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:49:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:12.014612 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23434b37-0002-43ab-8d5e-490be3abfe74 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:12.015184 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23434b37-0002-43ab-8d5e-490be3abfe74 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:12.015184 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23434b37-0002-43ab-8d5e-490be3abfe74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:12.034220 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-23434b37-0002-43ab-8d5e-490be3abfe74 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:12.035703 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-23434b37-0002-43ab-8d5e-490be3abfe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:12.044345 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 628/1247] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:12.083777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a41ae-0ddb-4b34-a872-a4b6cab98816 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:12.094297 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a41ae-0ddb-4b34-a872-a4b6cab98816 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:12.097776 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93237362-0938-44ae-bd08-9766ff13c3ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:12.098403 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93237362-0938-44ae-bd08-9766ff13c3ab service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:12.098679 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93237362-0938-44ae-bd08-9766ff13c3ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:12.098944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93237362-0938-44ae-bd08-9766ff13c3ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:12.108387 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93237362-0938-44ae-bd08-9766ff13c3ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:12.109830 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93237362-0938-44ae-bd08-9766ff13c3ab service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:12.119946 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 620/1248] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:49:12 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:49:16.601855 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eccf0-16d4-4cb0-93af-a40e2bd4c5db None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:16.601855 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eccf0-16d4-4cb0-93af-a40e2bd4c5db None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:16.602534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eccf0-16d4-4cb0-93af-a40e2bd4c5db None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:16.603885 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 629/1249] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:49:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:16.612195 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8af27-7697-4c96-9ec6-7a45175dbd0c None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:16.612700 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8af27-7697-4c96-9ec6-7a45175dbd0c None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:16.612841 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8af27-7697-4c96-9ec6-7a45175dbd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:16.632092 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-5ee8af27-7697-4c96-9ec6-7a45175dbd0c None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:16.633973 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-5ee8af27-7697-4c96-9ec6-7a45175dbd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:16.641838 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 621/1250] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:16 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:16.682379 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56eccf0-16d4-4cb0-93af-a40e2bd4c5db None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:16.692750 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56eccf0-16d4-4cb0-93af-a40e2bd4c5db None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:16.696316 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec221a-6b82-4fc8-8349-7804bd2f778a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:16.697115 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec221a-6b82-4fc8-8349-7804bd2f778a service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:16.697398 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec221a-6b82-4fc8-8349-7804bd2f778a service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:16.697670 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec221a-6b82-4fc8-8349-7804bd2f778a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:16.706922 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec221a-6b82-4fc8-8349-7804bd2f778a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:16.708439 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec221a-6b82-4fc8-8349-7804bd2f778a service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:16.718227 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 630/1251] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:49:16 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:21.899734 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4391f7d-7ae7-4a0c-94c2-609e252b440f None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.900667 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4391f7d-7ae7-4a0c-94c2-609e252b440f None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.901190 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4391f7d-7ae7-4a0c-94c2-609e252b440f None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.903175 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 622/1252] 10.222.0.96 () {54 vars in 921 bytes} [Fri Jan 28 01:49:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:21.908783 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213020f-0284-4dfa-83b5-eaaf4193fd8c None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:21.909269 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213020f-0284-4dfa-83b5-eaaf4193fd8c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:21.909349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213020f-0284-4dfa-83b5-eaaf4193fd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:21.983093 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-c213020f-0284-4dfa-83b5-eaaf4193fd8c None None] MFA Rules not processed for user `88a16f0ecf3448428e969359be57dda8`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:21.984293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c213020f-0284-4dfa-83b5-eaaf4193fd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:22.065400 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 631/1253] 10.222.0.96 () {58 vars in 1018 bytes} [Fri Jan 28 01:49:21 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:26.415456 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f369f-50dc-4a69-979c-2f98416e7b5c None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.415960 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f369f-50dc-4a69-979c-2f98416e7b5c None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.415960 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f369f-50dc-4a69-979c-2f98416e7b5c None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.417953 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 623/1254] 10.222.0.96 () {54 vars in 921 bytes} [Fri Jan 28 01:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:26.423385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a98dc-9c02-4915-a581-2831f4b023c6 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:26.424241 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a98dc-9c02-4915-a581-2831f4b023c6 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:26.424510 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a98dc-9c02-4915-a581-2831f4b023c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:26.444149 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-f49a98dc-9c02-4915-a581-2831f4b023c6 None None] MFA Rules not processed for user `88a16f0ecf3448428e969359be57dda8`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:26.445570 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-f49a98dc-9c02-4915-a581-2831f4b023c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:26.454319 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 632/1255] 10.222.0.96 () {58 vars in 1018 bytes} [Fri Jan 28 01:49:26 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:28.186516 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921e1a4-c5c8-46e4-8be3-4b33ea79caed None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.187013 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921e1a4-c5c8-46e4-8be3-4b33ea79caed None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.187099 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921e1a4-c5c8-46e4-8be3-4b33ea79caed None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.188868 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 624/1256] 10.222.0.96 () {54 vars in 921 bytes} [Fri Jan 28 01:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:28.194534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663ca9d-bbe0-4f52-88e6-876c90396c2f None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:28.195473 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663ca9d-bbe0-4f52-88e6-876c90396c2f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:28.195784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663ca9d-bbe0-4f52-88e6-876c90396c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:28.214471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-c663ca9d-bbe0-4f52-88e6-876c90396c2f None None] MFA Rules not processed for user `88a16f0ecf3448428e969359be57dda8`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:28.215660 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c663ca9d-bbe0-4f52-88e6-876c90396c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:28.224716 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 633/1257] 10.222.0.96 () {58 vars in 1018 bytes} [Fri Jan 28 01:49:28 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:31.999604 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b58c30-1f31-44eb-b809-4bdd1116c9f7 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.000157 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b58c30-1f31-44eb-b809-4bdd1116c9f7 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.000248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b58c30-1f31-44eb-b809-4bdd1116c9f7 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.002168 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 625/1258] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:32.013532 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25ba6b-1e6d-479f-9d2c-8793eb734116 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.014017 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25ba6b-1e6d-479f-9d2c-8793eb734116 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.014490 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25ba6b-1e6d-479f-9d2c-8793eb734116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.035062 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-0e25ba6b-1e6d-479f-9d2c-8793eb734116 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:32.036528 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-0e25ba6b-1e6d-479f-9d2c-8793eb734116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:32.045043 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 634/1259] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:32.103346 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b0380-a173-4129-8747-899d3235b7f6 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.103627 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b0380-a173-4129-8747-899d3235b7f6 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.104090 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b0380-a173-4129-8747-899d3235b7f6 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.106425 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 626/1260] 10.222.0.96 () {54 vars in 960 bytes} [Fri Jan 28 01:49:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:49:32.114379 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b5f08-eca0-4204-9840-ae9e0a9d49ea None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.115028 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b5f08-eca0-4204-9840-ae9e0a9d49ea None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.115637 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b5f08-eca0-4204-9840-ae9e0a9d49ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.172279 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-6b7b5f08-eca0-4204-9840-ae9e0a9d49ea None None] MFA Rules not processed for user `cc85f5db9c3c47fca68ebab33b0bb73c`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:32.173516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-6b7b5f08-eca0-4204-9840-ae9e0a9d49ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:32.258656 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 635/1261] 10.222.0.96 () {58 vars in 1057 bytes} [Fri Jan 28 01:49:32 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:32.267115 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b0380-a173-4129-8747-899d3235b7f6 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:32.282487 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b0380-a173-4129-8747-899d3235b7f6 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:32.289217 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cba88a-1dd8-4eda-80e8-c1f108d06425 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:32.289857 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cba88a-1dd8-4eda-80e8-c1f108d06425 service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:32.290143 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cba88a-1dd8-4eda-80e8-c1f108d06425 service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:32.290409 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cba88a-1dd8-4eda-80e8-c1f108d06425 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:32.299818 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cba88a-1dd8-4eda-80e8-c1f108d06425 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:32.301832 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cba88a-1dd8-4eda-80e8-c1f108d06425 service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:32.313240 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 627/1262] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:49:32 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:34.750403 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fed879-91e7-4ae5-8e53-422140526fc1 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:34.750947 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fed879-91e7-4ae5-8e53-422140526fc1 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:34.750947 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fed879-91e7-4ae5-8e53-422140526fc1 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:34.752829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 636/1263] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:34.760716 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d2153-329a-4cc8-929e-031bf66c46e8 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:34.761202 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d2153-329a-4cc8-929e-031bf66c46e8 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:34.761292 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d2153-329a-4cc8-929e-031bf66c46e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:34.779280 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-402d2153-329a-4cc8-929e-031bf66c46e8 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:34.780447 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-402d2153-329a-4cc8-929e-031bf66c46e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:34.788591 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 628/1264] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:34.834740 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fed879-91e7-4ae5-8e53-422140526fc1 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:34.861998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fed879-91e7-4ae5-8e53-422140526fc1 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:34.871649 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106961a7-a37b-4a37-86e3-064dc390e18e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:34.872785 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106961a7-a37b-4a37-86e3-064dc390e18e service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:34.873093 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106961a7-a37b-4a37-86e3-064dc390e18e service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:34.873409 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106961a7-a37b-4a37-86e3-064dc390e18e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:34.882617 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106961a7-a37b-4a37-86e3-064dc390e18e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:34.884237 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106961a7-a37b-4a37-86e3-064dc390e18e service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:34.897212 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 637/1265] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:49:34 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:37.450068 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3409e0-5896-4cdb-866b-7f312a424550 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:37.450554 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3409e0-5896-4cdb-866b-7f312a424550 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:37.450554 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3409e0-5896-4cdb-866b-7f312a424550 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:37.452329 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 629/1266] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:49:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:37.460383 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2d255-9feb-4357-a729-4767a4ee57c3 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:37.460868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2d255-9feb-4357-a729-4767a4ee57c3 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:37.461145 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2d255-9feb-4357-a729-4767a4ee57c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:37.483851 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-dbd2d255-9feb-4357-a729-4767a4ee57c3 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:37.485079 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-dbd2d255-9feb-4357-a729-4767a4ee57c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:37.492945 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 638/1267] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:37 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:37.540655 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8415e-ca41-4d89-b1d1-5b2043597d0c None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:37.540980 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8415e-ca41-4d89-b1d1-5b2043597d0c None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:37.541258 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8415e-ca41-4d89-b1d1-5b2043597d0c None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:37.543063 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 630/1268] 10.222.0.96 () {54 vars in 960 bytes} [Fri Jan 28 01:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:37.549538 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916ae43-a2e2-4d75-bbb8-6073c86d7581 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:37.550220 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916ae43-a2e2-4d75-bbb8-6073c86d7581 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:37.550220 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916ae43-a2e2-4d75-bbb8-6073c86d7581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:37.571214 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-2916ae43-a2e2-4d75-bbb8-6073c86d7581 None None] MFA Rules not processed for user `cc85f5db9c3c47fca68ebab33b0bb73c`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:37.572425 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-2916ae43-a2e2-4d75-bbb8-6073c86d7581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:37.581923 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 639/1269] 10.222.0.96 () {58 vars in 1057 bytes} [Fri Jan 28 01:49:37 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:37.605936 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8415e-ca41-4d89-b1d1-5b2043597d0c None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:37.627176 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8415e-ca41-4d89-b1d1-5b2043597d0c None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:37.634235 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3285da-3905-429f-9991-bfa8b48d9adb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:37.634885 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3285da-3905-429f-9991-bfa8b48d9adb service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:37.635337 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3285da-3905-429f-9991-bfa8b48d9adb service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:37.636581 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3285da-3905-429f-9991-bfa8b48d9adb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:37.646736 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3285da-3905-429f-9991-bfa8b48d9adb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:37.648724 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3285da-3905-429f-9991-bfa8b48d9adb service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:37.659155 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 631/1270] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:49:37 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:39.945474 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c734f8-6b6b-43e4-b2ef-582b4eef3af2 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:39.946069 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c734f8-6b6b-43e4-b2ef-582b4eef3af2 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:39.946069 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c734f8-6b6b-43e4-b2ef-582b4eef3af2 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:39.947694 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 640/1271] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:39.955250 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26b81a-d240-400e-85be-70f4fdf7d67f None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:39.955740 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26b81a-d240-400e-85be-70f4fdf7d67f None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:39.955828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26b81a-d240-400e-85be-70f4fdf7d67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:39.974000 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-ef26b81a-d240-400e-85be-70f4fdf7d67f None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:39.975211 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ef26b81a-d240-400e-85be-70f4fdf7d67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:39.983215 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 632/1272] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:39 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:39.991248 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a28518-c09a-4dd4-8ea6-a4c17f97337e None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:39.991600 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a28518-c09a-4dd4-8ea6-a4c17f97337e None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:39.991877 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a28518-c09a-4dd4-8ea6-a4c17f97337e None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:39.993736 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 641/1273] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:40.001206 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f633f68-642c-429c-97c0-de99e7985838 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:40.001498 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f633f68-642c-429c-97c0-de99e7985838 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:40.001771 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f633f68-642c-429c-97c0-de99e7985838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:40.020589 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-4f633f68-642c-429c-97c0-de99e7985838 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:40.021814 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-4f633f68-642c-429c-97c0-de99e7985838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:40.030332 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 633/1274] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:39 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:40.036272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff2336-2472-4276-94a8-09966763eb7d None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:40.036553 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff2336-2472-4276-94a8-09966763eb7d None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:40.036839 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff2336-2472-4276-94a8-09966763eb7d None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:40.039308 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 642/1275] 10.222.0.96 () {54 vars in 962 bytes} [Fri Jan 28 01:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:49:40.044683 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192f653-c3a9-4384-a9d4-e22d547afd9f None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:40.045309 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192f653-c3a9-4384-a9d4-e22d547afd9f None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:40.045691 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192f653-c3a9-4384-a9d4-e22d547afd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:40.079622 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff2336-2472-4276-94a8-09966763eb7d None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:40.094042 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff2336-2472-4276-94a8-09966763eb7d None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:40.098266 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-1192f653-c3a9-4384-a9d4-e22d547afd9f None None] MFA Rules not processed for user `eb36af30d0fe4369b4459f333cb64a36`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:40.099462 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1192f653-c3a9-4384-a9d4-e22d547afd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:40.100641 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bc0f8-3854-4bf7-ac74-9915ecb58ab3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:40.101557 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bc0f8-3854-4bf7-ac74-9915ecb58ab3 service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:40.101929 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bc0f8-3854-4bf7-ac74-9915ecb58ab3 service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:40.102288 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bc0f8-3854-4bf7-ac74-9915ecb58ab3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:40.110904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bc0f8-3854-4bf7-ac74-9915ecb58ab3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:40.112483 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bc0f8-3854-4bf7-ac74-9915ecb58ab3 service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:40.124309 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 643/1276] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:49:40 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:40.173832 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 634/1277] 10.222.0.96 () {58 vars in 1059 bytes} [Fri Jan 28 01:49:40 2022] POST /identity/v3/auth/tokens => generated 3263 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:40.182754 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bc0f8-3854-4bf7-ac74-9915ecb58ab3 service nova] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:40.192530 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bc0f8-3854-4bf7-ac74-9915ecb58ab3 service nova] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:40.196538 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66c338-79a9-4c8d-882b-2076fdf656f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:40.197127 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66c338-79a9-4c8d-882b-2076fdf656f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:40.197404 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66c338-79a9-4c8d-882b-2076fdf656f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:40.197669 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66c338-79a9-4c8d-882b-2076fdf656f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:40.218466 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66c338-79a9-4c8d-882b-2076fdf656f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:40.220189 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66c338-79a9-4c8d-882b-2076fdf656f9 service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:40.232659 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 644/1278] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:49:40 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:42.404395 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4304dcf-cc59-41bf-922c-634de90b77f3 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:42.404932 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4304dcf-cc59-41bf-922c-634de90b77f3 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:42.405049 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4304dcf-cc59-41bf-922c-634de90b77f3 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:42.406852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 635/1279] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:42.415600 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b89e6-4839-4736-9a45-e74f23fedaf3 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:42.416108 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b89e6-4839-4736-9a45-e74f23fedaf3 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:42.416204 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b89e6-4839-4736-9a45-e74f23fedaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:42.434724 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-008b89e6-4839-4736-9a45-e74f23fedaf3 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:42.435909 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-008b89e6-4839-4736-9a45-e74f23fedaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:42.445017 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 645/1280] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:42 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:42.492305 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4304dcf-cc59-41bf-922c-634de90b77f3 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:42.515374 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4304dcf-cc59-41bf-922c-634de90b77f3 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:42.529875 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d07e04-4c18-48d7-96fd-915d763e88b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:42.530543 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d07e04-4c18-48d7-96fd-915d763e88b6 service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:42.530820 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d07e04-4c18-48d7-96fd-915d763e88b6 service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:42.531355 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d07e04-4c18-48d7-96fd-915d763e88b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:42.548550 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d07e04-4c18-48d7-96fd-915d763e88b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:42.550214 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d07e04-4c18-48d7-96fd-915d763e88b6 service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:42.562048 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 636/1281] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:49:42 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:44.855292 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c24fdf-04eb-42c8-8bae-44e1a68dfec8 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.855791 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c24fdf-04eb-42c8-8bae-44e1a68dfec8 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.855791 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c24fdf-04eb-42c8-8bae-44e1a68dfec8 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.857596 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 646/1282] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:44.864859 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe76d3-f411-4edd-a1a0-e382dc97d52c None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.866252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe76d3-f411-4edd-a1a0-e382dc97d52c None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.866656 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe76d3-f411-4edd-a1a0-e382dc97d52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.885045 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-cebe76d3-f411-4edd-a1a0-e382dc97d52c None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:44.886221 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-cebe76d3-f411-4edd-a1a0-e382dc97d52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:44.894200 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 637/1283] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:44.942315 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c24fdf-04eb-42c8-8bae-44e1a68dfec8 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:44.957196 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c24fdf-04eb-42c8-8bae-44e1a68dfec8 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:44.963363 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6875a-2d31-4ecd-b820-5bc78ae5bddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:44.964115 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6875a-2d31-4ecd-b820-5bc78ae5bddf service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:44.964499 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6875a-2d31-4ecd-b820-5bc78ae5bddf service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:44.966133 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6875a-2d31-4ecd-b820-5bc78ae5bddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:44.974369 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6875a-2d31-4ecd-b820-5bc78ae5bddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:44.976883 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6875a-2d31-4ecd-b820-5bc78ae5bddf service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:44.986835 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 647/1284] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:49:44 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:47.253314 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0395f-562a-460a-9a2c-9792c88fc800 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:47.253873 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0395f-562a-460a-9a2c-9792c88fc800 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:47.253873 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0395f-562a-460a-9a2c-9792c88fc800 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:47.256437 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 638/1285] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:47.266241 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a4746-0a34-4428-81e0-7c23f2585f19 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:47.266779 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a4746-0a34-4428-81e0-7c23f2585f19 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:47.266779 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a4746-0a34-4428-81e0-7c23f2585f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:47.284980 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-024a4746-0a34-4428-81e0-7c23f2585f19 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:47.286169 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-024a4746-0a34-4428-81e0-7c23f2585f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:47.294272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 648/1286] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:47 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:47.338706 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0395f-562a-460a-9a2c-9792c88fc800 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:47.359226 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0395f-562a-460a-9a2c-9792c88fc800 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:47.368863 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bae83c-1519-4f8d-aa66-c5f6e6d2b593 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:47.370025 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bae83c-1519-4f8d-aa66-c5f6e6d2b593 service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:47.370599 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bae83c-1519-4f8d-aa66-c5f6e6d2b593 service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:47.371158 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bae83c-1519-4f8d-aa66-c5f6e6d2b593 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:47.386247 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bae83c-1519-4f8d-aa66-c5f6e6d2b593 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:47.389306 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bae83c-1519-4f8d-aa66-c5f6e6d2b593 service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:47.414780 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 639/1287] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:49:47 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:50.100905 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0401e34-9c2f-4b14-bfca-64b28ef0553f None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:50.101466 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0401e34-9c2f-4b14-bfca-64b28ef0553f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:50.101466 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0401e34-9c2f-4b14-bfca-64b28ef0553f None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:50.103291 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 649/1288] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:49:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:50.111107 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02bab7-9af5-4108-b209-387e624d78e8 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:50.111587 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02bab7-9af5-4108-b209-387e624d78e8 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:50.111679 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02bab7-9af5-4108-b209-387e624d78e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:50.130266 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-6c02bab7-9af5-4108-b209-387e624d78e8 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:50.132139 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-6c02bab7-9af5-4108-b209-387e624d78e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:50.140098 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 640/1289] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:50 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:50.187561 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0401e34-9c2f-4b14-bfca-64b28ef0553f None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:50.202332 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0401e34-9c2f-4b14-bfca-64b28ef0553f None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:50.207759 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8f7f2-62bb-41b2-8127-87ce08969ec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:50.208396 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8f7f2-62bb-41b2-8127-87ce08969ec0 service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:50.209388 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8f7f2-62bb-41b2-8127-87ce08969ec0 service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:50.209724 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8f7f2-62bb-41b2-8127-87ce08969ec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:50.218370 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8f7f2-62bb-41b2-8127-87ce08969ec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:50.219961 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8f7f2-62bb-41b2-8127-87ce08969ec0 service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:50.230144 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 650/1290] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:49:50 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:52.546947 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd639a-56de-4168-892c-dd448ecb1284 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.547494 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd639a-56de-4168-892c-dd448ecb1284 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.547665 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd639a-56de-4168-892c-dd448ecb1284 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.549796 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 641/1291] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:52.557799 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28334df-8b88-486a-b85f-9fbdf9392b02 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.558276 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28334df-8b88-486a-b85f-9fbdf9392b02 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.558390 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28334df-8b88-486a-b85f-9fbdf9392b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.576768 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-b28334df-8b88-486a-b85f-9fbdf9392b02 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:52.578023 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b28334df-8b88-486a-b85f-9fbdf9392b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:52.586657 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 651/1292] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:52 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:52.637081 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd639a-56de-4168-892c-dd448ecb1284 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:52.652281 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd639a-56de-4168-892c-dd448ecb1284 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:52.657753 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60ac03-2169-41cf-beb6-d1e1ef4a86cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:52.658386 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60ac03-2169-41cf-beb6-d1e1ef4a86cb service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.658919 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60ac03-2169-41cf-beb6-d1e1ef4a86cb service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.659201 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60ac03-2169-41cf-beb6-d1e1ef4a86cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.668839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60ac03-2169-41cf-beb6-d1e1ef4a86cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:52.670429 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60ac03-2169-41cf-beb6-d1e1ef4a86cb service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:52.683494 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 642/1293] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:49:52 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:55.016812 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca960b3d-15ed-43e1-b700-8300166d8bef None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.017373 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca960b3d-15ed-43e1-b700-8300166d8bef None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.017373 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca960b3d-15ed-43e1-b700-8300166d8bef None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.019151 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 652/1294] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:55.027508 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef4bef-69cf-4ba9-bdd9-b68896af41bf None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.028024 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef4bef-69cf-4ba9-bdd9-b68896af41bf None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.028129 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef4bef-69cf-4ba9-bdd9-b68896af41bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.047326 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-93ef4bef-69cf-4ba9-bdd9-b68896af41bf None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:55.048515 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-93ef4bef-69cf-4ba9-bdd9-b68896af41bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:55.057161 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 643/1295] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:55 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:55.107134 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca960b3d-15ed-43e1-b700-8300166d8bef None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:55.122605 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca960b3d-15ed-43e1-b700-8300166d8bef None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:55.128318 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded74b0-4ba7-4ce7-80f0-eeb58c9af674 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:55.129122 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded74b0-4ba7-4ce7-80f0-eeb58c9af674 service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.129486 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded74b0-4ba7-4ce7-80f0-eeb58c9af674 service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.130473 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded74b0-4ba7-4ce7-80f0-eeb58c9af674 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.140284 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded74b0-4ba7-4ce7-80f0-eeb58c9af674 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:55.141905 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded74b0-4ba7-4ce7-80f0-eeb58c9af674 service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:55.152761 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 653/1296] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:49:55 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:49:55.413021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7459d1-ffe2-4dd1-8070-1745a66314b3 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.413318 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7459d1-ffe2-4dd1-8070-1745a66314b3 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.413592 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7459d1-ffe2-4dd1-8070-1745a66314b3 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.415385 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 644/1297] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:55.423289 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829ead2-4ee7-4cae-8f68-900e2120e3c9 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.423679 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829ead2-4ee7-4cae-8f68-900e2120e3c9 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.423955 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829ead2-4ee7-4cae-8f68-900e2120e3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.444862 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-9829ead2-4ee7-4cae-8f68-900e2120e3c9 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:55.446743 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-9829ead2-4ee7-4cae-8f68-900e2120e3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:55.455752 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 654/1298] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:55 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:55.519354 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e3a2c-1457-411d-83e4-f1c97b54d3bb None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.519633 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e3a2c-1457-411d-83e4-f1c97b54d3bb None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.519908 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e3a2c-1457-411d-83e4-f1c97b54d3bb None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.521884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 645/1299] 10.222.0.96 () {54 vars in 961 bytes} [Fri Jan 28 01:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:55.527719 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6203771-6013-463e-a4fb-11b25e4d8962 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.528002 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6203771-6013-463e-a4fb-11b25e4d8962 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.528274 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6203771-6013-463e-a4fb-11b25e4d8962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.585687 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-c6203771-6013-463e-a4fb-11b25e4d8962 None None] MFA Rules not processed for user `07298acc960e4154be7c79f2368a1952`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:55.587020 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c6203771-6013-463e-a4fb-11b25e4d8962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:55.653203 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 655/1300] 10.222.0.96 () {58 vars in 1058 bytes} [Fri Jan 28 01:49:55 2022] POST /identity/v3/auth/tokens => generated 3263 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:55.662206 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e3a2c-1457-411d-83e4-f1c97b54d3bb None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:55.673773 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e3a2c-1457-411d-83e4-f1c97b54d3bb None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:55.678096 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5271f16-ef28-4dea-a6cf-f27fcf7d88d4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07298acc960e4154be7c79f2368a1952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:55.678868 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5271f16-ef28-4dea-a6cf-f27fcf7d88d4 service glance] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.679357 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5271f16-ef28-4dea-a6cf-f27fcf7d88d4 service glance] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.679745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5271f16-ef28-4dea-a6cf-f27fcf7d88d4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.689810 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5271f16-ef28-4dea-a6cf-f27fcf7d88d4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:55.691332 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5271f16-ef28-4dea-a6cf-f27fcf7d88d4 service glance] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:55.702231 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 646/1301] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:49:55 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:49:56.163778 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f519a-044e-44d5-a569-7dcce1feb950 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:56.164313 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f519a-044e-44d5-a569-7dcce1feb950 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:56.164313 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f519a-044e-44d5-a569-7dcce1feb950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:56.216038 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-ff4f519a-044e-44d5-a569-7dcce1feb950 None None] MFA Rules not processed for user `591d508a3867412fac76d00134e58864`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:56.217280 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-ff4f519a-044e-44d5-a569-7dcce1feb950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:56.283251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 656/1302] 10.222.0.96 () {58 vars in 1009 bytes} [Fri Jan 28 01:49:56 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:56.331015 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec539de6-3ee8-4562-809c-b997ec16d8c0 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:56.331564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec539de6-3ee8-4562-809c-b997ec16d8c0 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:56.331564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec539de6-3ee8-4562-809c-b997ec16d8c0 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:56.334100 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 647/1303] 10.222.0.96 () {54 vars in 942 bytes} [Fri Jan 28 01:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:56.341689 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc281b-3ae9-4b9f-bd5f-ceaafd20222c None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:56.341980 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc281b-3ae9-4b9f-bd5f-ceaafd20222c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:56.342256 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc281b-3ae9-4b9f-bd5f-ceaafd20222c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:56.392518 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-0fdc281b-3ae9-4b9f-bd5f-ceaafd20222c None None] MFA Rules not processed for user `83a2c3b2815f46b0ac27944f004c4821`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:56.393802 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-0fdc281b-3ae9-4b9f-bd5f-ceaafd20222c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:56.466617 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 657/1304] 10.222.0.96 () {58 vars in 1039 bytes} [Fri Jan 28 01:49:56 2022] POST /identity/v3/auth/tokens => generated 3447 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:56.476879 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec539de6-3ee8-4562-809c-b997ec16d8c0 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:56.490455 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec539de6-3ee8-4562-809c-b997ec16d8c0 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:56.495465 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03ce32-19fc-402f-bcc8-15e196fa9c9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a2c3b2815f46b0ac27944f004c4821', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:56.496153 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03ce32-19fc-402f-bcc8-15e196fa9c9d service swift] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:56.496430 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03ce32-19fc-402f-bcc8-15e196fa9c9d service swift] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:56.496699 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03ce32-19fc-402f-bcc8-15e196fa9c9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:56.506769 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03ce32-19fc-402f-bcc8-15e196fa9c9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:56.508403 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03ce32-19fc-402f-bcc8-15e196fa9c9d service swift] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:56.517460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 648/1305] 10.222.0.96 () {60 vars in 1384 bytes} [Fri Jan 28 01:49:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 01:49:57.621011 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a993bee-3f26-4f1c-989f-46887670091d None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.621643 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a993bee-3f26-4f1c-989f-46887670091d None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.621643 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a993bee-3f26-4f1c-989f-46887670091d None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.623341 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 658/1306] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:57.632114 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50904-4aee-46c4-8f82-fb4a18024b6b None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.632653 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50904-4aee-46c4-8f82-fb4a18024b6b None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.632653 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50904-4aee-46c4-8f82-fb4a18024b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.651293 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-a4f50904-4aee-46c4-8f82-fb4a18024b6b None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:57.652863 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-a4f50904-4aee-46c4-8f82-fb4a18024b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:57.664549 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 649/1307] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:57 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:57.712547 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a993bee-3f26-4f1c-989f-46887670091d None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:57.732408 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a993bee-3f26-4f1c-989f-46887670091d None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:57.738137 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a248f-41c1-4c27-b84f-6fdc63231a7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:57.738784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a248f-41c1-4c27-b84f-6fdc63231a7b service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:57.739129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a248f-41c1-4c27-b84f-6fdc63231a7b service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:57.739507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a248f-41c1-4c27-b84f-6fdc63231a7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:57.748840 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a248f-41c1-4c27-b84f-6fdc63231a7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:57.752242 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a248f-41c1-4c27-b84f-6fdc63231a7b service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:57.761534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 659/1308] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:49:57 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:00.058934 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b90b1-0cb0-4a06-8054-2d19504c8aa8 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:00.059997 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b90b1-0cb0-4a06-8054-2d19504c8aa8 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:00.060489 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b90b1-0cb0-4a06-8054-2d19504c8aa8 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:00.070403 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2997b21-1de5-4bee-840d-f53a264ff4d6 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:00.071370 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2997b21-1de5-4bee-840d-f53a264ff4d6 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:00.071717 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2997b21-1de5-4bee-840d-f53a264ff4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:00.073842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 650/1309] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:50:00 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:00.092852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-b2997b21-1de5-4bee-840d-f53a264ff4d6 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:00.094088 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b2997b21-1de5-4bee-840d-f53a264ff4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:00.105446 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 660/1310] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:00 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:50:00.152905 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b90b1-0cb0-4a06-8054-2d19504c8aa8 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:00.169273 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b90b1-0cb0-4a06-8054-2d19504c8aa8 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:00.175270 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae21a95-fd9b-4cf8-a7e6-4578f4493ee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:00.175917 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae21a95-fd9b-4cf8-a7e6-4578f4493ee0 service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:00.176200 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae21a95-fd9b-4cf8-a7e6-4578f4493ee0 service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:00.176583 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae21a95-fd9b-4cf8-a7e6-4578f4493ee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:00.185667 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae21a95-fd9b-4cf8-a7e6-4578f4493ee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:00.187381 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae21a95-fd9b-4cf8-a7e6-4578f4493ee0 service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:00.202466 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 651/1311] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:50:00 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:14.045092 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dce77-044d-4f9b-96ce-88ad3f179b4f None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:14.045657 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dce77-044d-4f9b-96ce-88ad3f179b4f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:14.045657 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dce77-044d-4f9b-96ce-88ad3f179b4f None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:14.047471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 661/1312] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:14.057074 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ea3be-94f2-47fb-9c06-a15c582d1228 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:14.057581 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ea3be-94f2-47fb-9c06-a15c582d1228 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:14.057685 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ea3be-94f2-47fb-9c06-a15c582d1228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:14.076444 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-6e0ea3be-94f2-47fb-9c06-a15c582d1228 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:14.077709 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-6e0ea3be-94f2-47fb-9c06-a15c582d1228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:14.085653 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 652/1313] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:14 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:14.110165 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dce77-044d-4f9b-96ce-88ad3f179b4f None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:14.123259 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dce77-044d-4f9b-96ce-88ad3f179b4f None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:14.127628 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31df8d5-82ef-4f13-afe8-2f1e4c3a5027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:14.129071 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31df8d5-82ef-4f13-afe8-2f1e4c3a5027 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:14.129478 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31df8d5-82ef-4f13-afe8-2f1e4c3a5027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:14.129746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31df8d5-82ef-4f13-afe8-2f1e4c3a5027 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:14.130460 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31df8d5-82ef-4f13-afe8-2f1e4c3a5027 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:14.132315 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31df8d5-82ef-4f13-afe8-2f1e4c3a5027 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:14.146602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 662/1314] 10.222.0.96 () {56 vars in 1108 bytes} [Fri Jan 28 01:50:14 2022] GET /identity/v3/projects => generated 2553 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:50:16.335036 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c52c1-524f-4510-bf71-36d74020716e None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:16.335564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c52c1-524f-4510-bf71-36d74020716e None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:16.335564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c52c1-524f-4510-bf71-36d74020716e None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:16.337398 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 653/1315] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:16.345030 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e77f67-3c42-499a-a539-79dac9abd364 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:16.345536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e77f67-3c42-499a-a539-79dac9abd364 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:16.345629 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e77f67-3c42-499a-a539-79dac9abd364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:16.363844 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-c9e77f67-3c42-499a-a539-79dac9abd364 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:16.365058 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c9e77f67-3c42-499a-a539-79dac9abd364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:16.372778 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 663/1316] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:16 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:16.397531 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c52c1-524f-4510-bf71-36d74020716e None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:16.411518 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c52c1-524f-4510-bf71-36d74020716e None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:16.415981 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5e233-64cd-4fce-8e59-61dd45c92b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:16.416852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5e233-64cd-4fce-8e59-61dd45c92b5b admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:16.417134 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5e233-64cd-4fce-8e59-61dd45c92b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:16.417401 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5e233-64cd-4fce-8e59-61dd45c92b5b admin admin] PATH_INFO: `/v3/projects/08318c7216804a7bafefeb9cfcce3f64` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:16.428980 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5e233-64cd-4fce-8e59-61dd45c92b5b admin admin] RBAC: Authorizing `identity:get_project(project_id=08318c7216804a7bafefeb9cfcce3f64)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:16.431018 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5e233-64cd-4fce-8e59-61dd45c92b5b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:16.432772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 654/1317] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:50:16 2022] GET /identity/v3/projects/08318c7216804a7bafefeb9cfcce3f64 => generated 312 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:16.439623 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e77f67-3c42-499a-a539-79dac9abd364 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:16.448734 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e77f67-3c42-499a-a539-79dac9abd364 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:16.453271 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fbc9d-82ad-48cf-8e67-f326f16a5225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:16.453911 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fbc9d-82ad-48cf-8e67-f326f16a5225 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:16.454190 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fbc9d-82ad-48cf-8e67-f326f16a5225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:16.454460 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fbc9d-82ad-48cf-8e67-f326f16a5225 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:16.455261 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fbc9d-82ad-48cf-8e67-f326f16a5225 admin admin] RBAC: Adding query filter params (scope.project.id=08318c7216804a7bafefeb9cfcce3f64) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:16.455515 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fbc9d-82ad-48cf-8e67-f326f16a5225 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:16.457880 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fbc9d-82ad-48cf-8e67-f326f16a5225 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:16.464710 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 664/1318] 10.222.0.96 () {56 vars in 1231 bytes} [Fri Jan 28 01:50:16 2022] GET /identity/v3/role_assignments?scope.project.id=08318c7216804a7bafefeb9cfcce3f64 => generated 526 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:16.471127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5e233-64cd-4fce-8e59-61dd45c92b5b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:16.481517 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5e233-64cd-4fce-8e59-61dd45c92b5b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:16.485978 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045794cc-ba57-4547-8761-d5be0e023941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:16.486833 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045794cc-ba57-4547-8761-d5be0e023941 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:16.487110 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045794cc-ba57-4547-8761-d5be0e023941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:16.487506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045794cc-ba57-4547-8761-d5be0e023941 admin admin] PATH_INFO: `/v3/users/7c40b316521b482c91d30172096a90c4` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:16.501389 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045794cc-ba57-4547-8761-d5be0e023941 admin admin] RBAC: Authorizing `identity:get_user(user_id=7c40b316521b482c91d30172096a90c4)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:16.503993 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045794cc-ba57-4547-8761-d5be0e023941 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:16.506021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 655/1319] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:16 2022] GET /identity/v3/users/7c40b316521b482c91d30172096a90c4 => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:18.802720 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8e43d-28f9-4bfd-b44d-eb9cf4adbcb2 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:18.803250 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8e43d-28f9-4bfd-b44d-eb9cf4adbcb2 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:18.803250 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8e43d-28f9-4bfd-b44d-eb9cf4adbcb2 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:18.804995 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 665/1320] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:18.812904 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8580689-b91b-432f-b01e-5ca9e676358b None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:18.813408 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8580689-b91b-432f-b01e-5ca9e676358b None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:18.813486 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8580689-b91b-432f-b01e-5ca9e676358b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:18.832937 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-b8580689-b91b-432f-b01e-5ca9e676358b None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:18.834151 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b8580689-b91b-432f-b01e-5ca9e676358b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:18.841905 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 656/1321] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:18 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:18.866466 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8e43d-28f9-4bfd-b44d-eb9cf4adbcb2 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:18.878992 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8e43d-28f9-4bfd-b44d-eb9cf4adbcb2 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:18.883322 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8a5b1-c752-47e8-9f96-1212f9e393b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:18.884148 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a5b1-c752-47e8-9f96-1212f9e393b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:18.884418 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a5b1-c752-47e8-9f96-1212f9e393b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:18.884680 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a5b1-c752-47e8-9f96-1212f9e393b1 admin admin] PATH_INFO: `/v3/projects/0b4a58b4778f408f901761cdbb7786a3` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:18.896596 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8a5b1-c752-47e8-9f96-1212f9e393b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=0b4a58b4778f408f901761cdbb7786a3)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:18.898662 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8a5b1-c752-47e8-9f96-1212f9e393b1 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:18.900387 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 666/1322] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:50:18 2022] GET /identity/v3/projects/0b4a58b4778f408f901761cdbb7786a3 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:18.907360 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8580689-b91b-432f-b01e-5ca9e676358b None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:18.917000 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8580689-b91b-432f-b01e-5ca9e676358b None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:18.921501 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d011a-fea7-48a7-a2f7-e9cb760d94e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:18.922132 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d011a-fea7-48a7-a2f7-e9cb760d94e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:18.922412 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d011a-fea7-48a7-a2f7-e9cb760d94e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:18.922681 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d011a-fea7-48a7-a2f7-e9cb760d94e7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:18.923422 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d011a-fea7-48a7-a2f7-e9cb760d94e7 admin admin] RBAC: Adding query filter params (scope.project.id=0b4a58b4778f408f901761cdbb7786a3) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:18.923721 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d011a-fea7-48a7-a2f7-e9cb760d94e7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:18.925689 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d011a-fea7-48a7-a2f7-e9cb760d94e7 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:18.932952 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 657/1323] 10.222.0.96 () {56 vars in 1231 bytes} [Fri Jan 28 01:50:18 2022] GET /identity/v3/role_assignments?scope.project.id=0b4a58b4778f408f901761cdbb7786a3 => generated 877 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:18.939463 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8a5b1-c752-47e8-9f96-1212f9e393b1 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:18.950790 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8a5b1-c752-47e8-9f96-1212f9e393b1 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:18.955456 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d0c8b-2495-4468-924f-445212a5fa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:18.957017 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d0c8b-2495-4468-924f-445212a5fa59 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:18.957293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d0c8b-2495-4468-924f-445212a5fa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:18.957743 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d0c8b-2495-4468-924f-445212a5fa59 admin admin] PATH_INFO: `/v3/users/cf8bf512957b4380ad665209c8598739` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:18.972726 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d0c8b-2495-4468-924f-445212a5fa59 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf8bf512957b4380ad665209c8598739)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:18.974875 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d0c8b-2495-4468-924f-445212a5fa59 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:18.976605 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 667/1324] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:18 2022] GET /identity/v3/users/cf8bf512957b4380ad665209c8598739 => generated 285 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:18.983192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d011a-fea7-48a7-a2f7-e9cb760d94e7 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:18.993270 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d011a-fea7-48a7-a2f7-e9cb760d94e7 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:18.997666 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8e97c-dfbd-4bf6-ba6d-65bed709f7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:18.998514 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8e97c-dfbd-4bf6-ba6d-65bed709f7fc admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:18.998790 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8e97c-dfbd-4bf6-ba6d-65bed709f7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:18.999061 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8e97c-dfbd-4bf6-ba6d-65bed709f7fc admin admin] PATH_INFO: `/v3/users/d5fc401c1a34498cb95ac61813a57efa` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:19.013872 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8e97c-dfbd-4bf6-ba6d-65bed709f7fc admin admin] RBAC: Authorizing `identity:get_user(user_id=d5fc401c1a34498cb95ac61813a57efa)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:19.016026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8e97c-dfbd-4bf6-ba6d-65bed709f7fc admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:19.017770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 658/1325] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:18 2022] GET /identity/v3/users/d5fc401c1a34498cb95ac61813a57efa => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:21.257420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e094c9b-bfaa-4ea9-a5e3-9d0e13548fe5 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:21.258957 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e094c9b-bfaa-4ea9-a5e3-9d0e13548fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:21.258957 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e094c9b-bfaa-4ea9-a5e3-9d0e13548fe5 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:21.259778 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 668/1326] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:21.267190 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3bf30-6e45-4c22-aebb-2ff84ff053a7 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:21.267628 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3bf30-6e45-4c22-aebb-2ff84ff053a7 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:21.267734 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3bf30-6e45-4c22-aebb-2ff84ff053a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:21.285850 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-bfc3bf30-6e45-4c22-aebb-2ff84ff053a7 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:21.287054 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-bfc3bf30-6e45-4c22-aebb-2ff84ff053a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:21.297731 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 659/1327] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:21 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:21.322354 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e094c9b-bfaa-4ea9-a5e3-9d0e13548fe5 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:21.335750 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e094c9b-bfaa-4ea9-a5e3-9d0e13548fe5 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:21.340149 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e284176-0cee-4968-87d8-d2f94737de90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:21.341019 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e284176-0cee-4968-87d8-d2f94737de90 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:21.341301 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e284176-0cee-4968-87d8-d2f94737de90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:21.341571 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e284176-0cee-4968-87d8-d2f94737de90 admin admin] PATH_INFO: `/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:21.352488 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e284176-0cee-4968-87d8-d2f94737de90 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d215dc32c4b4fa7b877f3b3b8be47a3)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:21.354580 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e284176-0cee-4968-87d8-d2f94737de90 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:21.356306 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 669/1328] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:50:21 2022] GET /identity/v3/projects/1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:21.363366 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3bf30-6e45-4c22-aebb-2ff84ff053a7 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:21.372479 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3bf30-6e45-4c22-aebb-2ff84ff053a7 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:21.377331 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d6d7c-a861-4c46-8c84-f3919a28211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:21.379125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d6d7c-a861-4c46-8c84-f3919a28211d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:21.379465 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d6d7c-a861-4c46-8c84-f3919a28211d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:21.379745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d6d7c-a861-4c46-8c84-f3919a28211d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:21.380501 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d6d7c-a861-4c46-8c84-f3919a28211d admin admin] RBAC: Adding query filter params (scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:21.380836 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d6d7c-a861-4c46-8c84-f3919a28211d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:21.382649 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d6d7c-a861-4c46-8c84-f3919a28211d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:21.390031 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 660/1329] 10.222.0.96 () {56 vars in 1231 bytes} [Fri Jan 28 01:50:21 2022] GET /identity/v3/role_assignments?scope.project.id=1d215dc32c4b4fa7b877f3b3b8be47a3 => generated 1934 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:50:21.397493 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e284176-0cee-4968-87d8-d2f94737de90 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:21.407407 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e284176-0cee-4968-87d8-d2f94737de90 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:21.412174 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba502c-f557-4ef2-b2ad-8b657b40a5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:21.413347 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba502c-f557-4ef2-b2ad-8b657b40a5cf admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:21.413623 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba502c-f557-4ef2-b2ad-8b657b40a5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:21.413889 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba502c-f557-4ef2-b2ad-8b657b40a5cf admin admin] PATH_INFO: `/v3/users/4d8d6d5762e340d2aeb3219a15d43128` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:21.415045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba502c-f557-4ef2-b2ad-8b657b40a5cf admin admin] RBAC: Authorizing `identity:get_user(user_id=4d8d6d5762e340d2aeb3219a15d43128)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:21.416908 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba502c-f557-4ef2-b2ad-8b657b40a5cf admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:21.418511 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 670/1330] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:21 2022] GET /identity/v3/users/4d8d6d5762e340d2aeb3219a15d43128 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:21.425588 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d6d7c-a861-4c46-8c84-f3919a28211d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:21.435332 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d6d7c-a861-4c46-8c84-f3919a28211d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:21.440431 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641cbfd-dfa1-44e2-b2c0-fd81eeac809c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:21.441805 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641cbfd-dfa1-44e2-b2c0-fd81eeac809c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:21.442087 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641cbfd-dfa1-44e2-b2c0-fd81eeac809c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:21.442364 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641cbfd-dfa1-44e2-b2c0-fd81eeac809c admin admin] PATH_INFO: `/v3/users/7c40b316521b482c91d30172096a90c4` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:21.443580 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641cbfd-dfa1-44e2-b2c0-fd81eeac809c admin admin] RBAC: Authorizing `identity:get_user(user_id=7c40b316521b482c91d30172096a90c4)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:21.445734 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641cbfd-dfa1-44e2-b2c0-fd81eeac809c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:21.447373 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 661/1331] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:21 2022] GET /identity/v3/users/7c40b316521b482c91d30172096a90c4 => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:50:23.754425 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a696b-1ffd-4e96-a8fe-f1c8e1c52401 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:23.754979 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a696b-1ffd-4e96-a8fe-f1c8e1c52401 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:23.754979 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a696b-1ffd-4e96-a8fe-f1c8e1c52401 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:23.757093 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 671/1332] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:23.764609 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47635ad1-9a4e-4574-af60-07f302719fca None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:23.765082 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47635ad1-9a4e-4574-af60-07f302719fca None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:23.765187 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47635ad1-9a4e-4574-af60-07f302719fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:23.784017 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-47635ad1-9a4e-4574-af60-07f302719fca None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:23.785355 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-47635ad1-9a4e-4574-af60-07f302719fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:23.793076 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 662/1333] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:23 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:23.818613 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a696b-1ffd-4e96-a8fe-f1c8e1c52401 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:23.831436 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a696b-1ffd-4e96-a8fe-f1c8e1c52401 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:23.835933 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbd0e0-8759-474f-8610-a41abfcdaac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:23.836775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbd0e0-8759-474f-8610-a41abfcdaac8 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:23.837085 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbd0e0-8759-474f-8610-a41abfcdaac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:23.837357 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbd0e0-8759-474f-8610-a41abfcdaac8 admin admin] PATH_INFO: `/v3/projects/65c96e1c663a4b7db4930772be89df09` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:23.848446 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbd0e0-8759-474f-8610-a41abfcdaac8 admin admin] RBAC: Authorizing `identity:get_project(project_id=65c96e1c663a4b7db4930772be89df09)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:23.850539 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbd0e0-8759-474f-8610-a41abfcdaac8 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:23.852272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 672/1334] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:50:23 2022] GET /identity/v3/projects/65c96e1c663a4b7db4930772be89df09 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:23.859026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47635ad1-9a4e-4574-af60-07f302719fca None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:23.868968 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47635ad1-9a4e-4574-af60-07f302719fca None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:23.873524 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7faf135-fd3c-4e44-ab3b-3e611adb5350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:23.874158 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7faf135-fd3c-4e44-ab3b-3e611adb5350 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:23.874436 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7faf135-fd3c-4e44-ab3b-3e611adb5350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:23.874706 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7faf135-fd3c-4e44-ab3b-3e611adb5350 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:23.875452 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7faf135-fd3c-4e44-ab3b-3e611adb5350 admin admin] RBAC: Adding query filter params (scope.project.id=65c96e1c663a4b7db4930772be89df09) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:23.875754 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7faf135-fd3c-4e44-ab3b-3e611adb5350 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:23.878608 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7faf135-fd3c-4e44-ab3b-3e611adb5350 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:23.885317 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 663/1335] 10.222.0.96 () {56 vars in 1231 bytes} [Fri Jan 28 01:50:23 2022] GET /identity/v3/role_assignments?scope.project.id=65c96e1c663a4b7db4930772be89df09 => generated 1934 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:50:23.891734 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbd0e0-8759-474f-8610-a41abfcdaac8 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:23.901636 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbd0e0-8759-474f-8610-a41abfcdaac8 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:23.906152 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978d78b-5ff9-426f-bcc4-399dfb47b030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:23.907258 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978d78b-5ff9-426f-bcc4-399dfb47b030 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:23.907528 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978d78b-5ff9-426f-bcc4-399dfb47b030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:23.907789 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978d78b-5ff9-426f-bcc4-399dfb47b030 admin admin] PATH_INFO: `/v3/users/a76edb4be4ed4cb1ace2740887f5f01d` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:23.921528 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978d78b-5ff9-426f-bcc4-399dfb47b030 admin admin] RBAC: Authorizing `identity:get_user(user_id=a76edb4be4ed4cb1ace2740887f5f01d)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:23.923649 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978d78b-5ff9-426f-bcc4-399dfb47b030 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:23.926071 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 673/1336] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:23 2022] GET /identity/v3/users/a76edb4be4ed4cb1ace2740887f5f01d => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:23.932591 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7faf135-fd3c-4e44-ab3b-3e611adb5350 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:23.944939 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7faf135-fd3c-4e44-ab3b-3e611adb5350 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:23.952637 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4ed0e-8dfc-4ca0-bd10-46d337186ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:23.954250 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4ed0e-8dfc-4ca0-bd10-46d337186ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:23.954771 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4ed0e-8dfc-4ca0-bd10-46d337186ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:23.955281 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4ed0e-8dfc-4ca0-bd10-46d337186ef2 admin admin] PATH_INFO: `/v3/users/4d8d6d5762e340d2aeb3219a15d43128` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:23.957327 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4ed0e-8dfc-4ca0-bd10-46d337186ef2 admin admin] RBAC: Authorizing `identity:get_user(user_id=4d8d6d5762e340d2aeb3219a15d43128)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:23.960618 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4ed0e-8dfc-4ca0-bd10-46d337186ef2 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:23.963088 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 664/1337] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:23 2022] GET /identity/v3/users/4d8d6d5762e340d2aeb3219a15d43128 => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:26.243803 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754eabf-de27-4830-adbe-76863bf11fee None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:26.244467 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754eabf-de27-4830-adbe-76863bf11fee None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:26.244467 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754eabf-de27-4830-adbe-76863bf11fee None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:26.246170 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 674/1338] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:26.254936 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8df792-0260-43e4-b817-e250f66add07 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:26.255427 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8df792-0260-43e4-b817-e250f66add07 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:26.255537 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8df792-0260-43e4-b817-e250f66add07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:26.273274 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-7e8df792-0260-43e4-b817-e250f66add07 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:26.274467 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-7e8df792-0260-43e4-b817-e250f66add07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:26.282490 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 665/1339] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:26 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:26.307074 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754eabf-de27-4830-adbe-76863bf11fee None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:26.320125 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754eabf-de27-4830-adbe-76863bf11fee None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:26.324635 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f6d9b-0f9d-4fcc-9385-81abc677edef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:26.325555 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f6d9b-0f9d-4fcc-9385-81abc677edef admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:26.325836 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f6d9b-0f9d-4fcc-9385-81abc677edef admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:26.326110 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f6d9b-0f9d-4fcc-9385-81abc677edef admin admin] PATH_INFO: `/v3/projects/7ed2a96df227403c8d2cdfcff229008d` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:26.327295 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f6d9b-0f9d-4fcc-9385-81abc677edef admin admin] RBAC: Authorizing `identity:get_project(project_id=7ed2a96df227403c8d2cdfcff229008d)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:26.329125 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f6d9b-0f9d-4fcc-9385-81abc677edef admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:26.330838 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 675/1340] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:50:26 2022] GET /identity/v3/projects/7ed2a96df227403c8d2cdfcff229008d => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:26.337653 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8df792-0260-43e4-b817-e250f66add07 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:26.346975 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8df792-0260-43e4-b817-e250f66add07 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:26.351498 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85300d24-1377-41b4-86b7-9c82bee5a571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:26.352132 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85300d24-1377-41b4-86b7-9c82bee5a571 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:26.352410 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85300d24-1377-41b4-86b7-9c82bee5a571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:26.352682 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85300d24-1377-41b4-86b7-9c82bee5a571 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:26.353460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85300d24-1377-41b4-86b7-9c82bee5a571 admin admin] RBAC: Adding query filter params (scope.project.id=7ed2a96df227403c8d2cdfcff229008d) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:26.353766 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85300d24-1377-41b4-86b7-9c82bee5a571 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:26.355580 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85300d24-1377-41b4-86b7-9c82bee5a571 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:26.361888 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 666/1341] 10.222.0.96 () {56 vars in 1231 bytes} [Fri Jan 28 01:50:26 2022] GET /identity/v3/role_assignments?scope.project.id=7ed2a96df227403c8d2cdfcff229008d => generated 879 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:26.368570 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f6d9b-0f9d-4fcc-9385-81abc677edef admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:26.379097 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f6d9b-0f9d-4fcc-9385-81abc677edef admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:26.383669 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d55d6-41c1-4667-84ef-9cfa872f0bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:26.384523 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d55d6-41c1-4667-84ef-9cfa872f0bac admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:26.384820 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d55d6-41c1-4667-84ef-9cfa872f0bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:26.385100 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d55d6-41c1-4667-84ef-9cfa872f0bac admin admin] PATH_INFO: `/v3/users/4d8d6d5762e340d2aeb3219a15d43128` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:26.386274 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d55d6-41c1-4667-84ef-9cfa872f0bac admin admin] RBAC: Authorizing `identity:get_user(user_id=4d8d6d5762e340d2aeb3219a15d43128)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:26.388060 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d55d6-41c1-4667-84ef-9cfa872f0bac admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:26.389708 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 676/1342] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:26 2022] GET /identity/v3/users/4d8d6d5762e340d2aeb3219a15d43128 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:28.598857 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1743e-6915-4353-b105-647ea2d84f1c None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:28.599468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1743e-6915-4353-b105-647ea2d84f1c None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:28.599468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1743e-6915-4353-b105-647ea2d84f1c None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:28.601263 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 667/1343] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:28.609127 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03dbde-dd6d-40b5-95cb-def77ae7874a None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:28.609644 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03dbde-dd6d-40b5-95cb-def77ae7874a None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:28.609644 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03dbde-dd6d-40b5-95cb-def77ae7874a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:28.627364 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-3d03dbde-dd6d-40b5-95cb-def77ae7874a None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:28.628548 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-3d03dbde-dd6d-40b5-95cb-def77ae7874a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:28.636262 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 677/1344] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:28 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:28.660898 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1743e-6915-4353-b105-647ea2d84f1c None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:28.673193 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1743e-6915-4353-b105-647ea2d84f1c None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:28.677849 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750b2cf-0658-4d83-9c6f-45b72cda954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:28.678706 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750b2cf-0658-4d83-9c6f-45b72cda954e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:28.678989 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750b2cf-0658-4d83-9c6f-45b72cda954e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:28.679263 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750b2cf-0658-4d83-9c6f-45b72cda954e admin admin] PATH_INFO: `/v3/projects/984daf2b18594b5685fcce748488ac0e` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:28.691440 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750b2cf-0658-4d83-9c6f-45b72cda954e admin admin] RBAC: Authorizing `identity:get_project(project_id=984daf2b18594b5685fcce748488ac0e)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:28.693529 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750b2cf-0658-4d83-9c6f-45b72cda954e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:28.695331 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 668/1345] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:50:28 2022] GET /identity/v3/projects/984daf2b18594b5685fcce748488ac0e => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:28.702275 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03dbde-dd6d-40b5-95cb-def77ae7874a None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:28.711689 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03dbde-dd6d-40b5-95cb-def77ae7874a None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:28.716324 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abaaae-b5a2-47e4-89a3-a61e7c23ddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:28.716991 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abaaae-b5a2-47e4-89a3-a61e7c23ddc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:28.717269 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abaaae-b5a2-47e4-89a3-a61e7c23ddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:28.717542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abaaae-b5a2-47e4-89a3-a61e7c23ddc8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:28.718286 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abaaae-b5a2-47e4-89a3-a61e7c23ddc8 admin admin] RBAC: Adding query filter params (scope.project.id=984daf2b18594b5685fcce748488ac0e) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:28.718588 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abaaae-b5a2-47e4-89a3-a61e7c23ddc8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:28.720405 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abaaae-b5a2-47e4-89a3-a61e7c23ddc8 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:28.725982 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 678/1346] 10.222.0.96 () {56 vars in 1231 bytes} [Fri Jan 28 01:50:28 2022] GET /identity/v3/role_assignments?scope.project.id=984daf2b18594b5685fcce748488ac0e => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:28.732448 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750b2cf-0658-4d83-9c6f-45b72cda954e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:28.742248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750b2cf-0658-4d83-9c6f-45b72cda954e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:28.746788 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40329e81-4709-4681-a439-d078d0fb157c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:28.747637 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40329e81-4709-4681-a439-d078d0fb157c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:28.747914 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40329e81-4709-4681-a439-d078d0fb157c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:28.748187 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40329e81-4709-4681-a439-d078d0fb157c admin admin] PATH_INFO: `/v3/users/80f8272889e841a6800faf598d676e78` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:28.762228 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40329e81-4709-4681-a439-d078d0fb157c admin admin] RBAC: Authorizing `identity:get_user(user_id=80f8272889e841a6800faf598d676e78)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:28.764378 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40329e81-4709-4681-a439-d078d0fb157c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:28.766158 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 669/1347] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:28 2022] GET /identity/v3/users/80f8272889e841a6800faf598d676e78 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:31.017988 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54a55f-f36f-4a7a-9f2b-24620110a510 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:31.018587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54a55f-f36f-4a7a-9f2b-24620110a510 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:31.018587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54a55f-f36f-4a7a-9f2b-24620110a510 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:31.020321 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 679/1348] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:31.027971 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75283a4a-944e-4a1c-96cc-ab3f19c5e494 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:31.028476 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75283a4a-944e-4a1c-96cc-ab3f19c5e494 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:31.028574 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75283a4a-944e-4a1c-96cc-ab3f19c5e494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:31.046199 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-75283a4a-944e-4a1c-96cc-ab3f19c5e494 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:31.047403 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-75283a4a-944e-4a1c-96cc-ab3f19c5e494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:31.055759 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 670/1349] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:31 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:31.080777 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54a55f-f36f-4a7a-9f2b-24620110a510 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:31.098662 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54a55f-f36f-4a7a-9f2b-24620110a510 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:31.105727 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc391f-1172-4331-98ef-5b0e16630195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:31.106592 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc391f-1172-4331-98ef-5b0e16630195 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:31.106867 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc391f-1172-4331-98ef-5b0e16630195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:31.107138 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc391f-1172-4331-98ef-5b0e16630195 admin admin] PATH_INFO: `/v3/projects/b3d292f6183d478783a4a9c0964b9cc3` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:31.119549 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc391f-1172-4331-98ef-5b0e16630195 admin admin] RBAC: Authorizing `identity:get_project(project_id=b3d292f6183d478783a4a9c0964b9cc3)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:31.121658 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc391f-1172-4331-98ef-5b0e16630195 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:31.123507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 680/1350] 10.222.0.96 () {56 vars in 1207 bytes} [Fri Jan 28 01:50:31 2022] GET /identity/v3/projects/b3d292f6183d478783a4a9c0964b9cc3 => generated 361 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:31.130284 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75283a4a-944e-4a1c-96cc-ab3f19c5e494 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:31.139457 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75283a4a-944e-4a1c-96cc-ab3f19c5e494 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:31.144227 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829044d-cdfb-462d-8bd9-5cf3419ea2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:31.144910 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829044d-cdfb-462d-8bd9-5cf3419ea2ce admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:31.145193 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829044d-cdfb-462d-8bd9-5cf3419ea2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:31.145466 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829044d-cdfb-462d-8bd9-5cf3419ea2ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:31.146228 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829044d-cdfb-462d-8bd9-5cf3419ea2ce admin admin] RBAC: Adding query filter params (scope.project.id=b3d292f6183d478783a4a9c0964b9cc3) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:31.146534 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829044d-cdfb-462d-8bd9-5cf3419ea2ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:31.148354 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829044d-cdfb-462d-8bd9-5cf3419ea2ce admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:31.154193 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 671/1351] 10.222.0.96 () {56 vars in 1231 bytes} [Fri Jan 28 01:50:31 2022] GET /identity/v3/role_assignments?scope.project.id=b3d292f6183d478783a4a9c0964b9cc3 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:31.161571 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc391f-1172-4331-98ef-5b0e16630195 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:31.171383 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc391f-1172-4331-98ef-5b0e16630195 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:31.177248 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f222b95-e7a4-44da-ac8c-29783976d5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:31.178102 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f222b95-e7a4-44da-ac8c-29783976d5bf admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:31.178376 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f222b95-e7a4-44da-ac8c-29783976d5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:31.178671 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f222b95-e7a4-44da-ac8c-29783976d5bf admin admin] PATH_INFO: `/v3/users/a7e854b856dc470396d4bb14982283c7` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:31.194163 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f222b95-e7a4-44da-ac8c-29783976d5bf admin admin] RBAC: Authorizing `identity:get_user(user_id=a7e854b856dc470396d4bb14982283c7)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:31.196314 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f222b95-e7a4-44da-ac8c-29783976d5bf admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:31.198058 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 681/1352] 10.222.0.96 () {56 vars in 1198 bytes} [Fri Jan 28 01:50:31 2022] GET /identity/v3/users/a7e854b856dc470396d4bb14982283c7 => generated 311 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:36.701772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b426ba6-ab50-4dc9-b10f-e20c08d640da None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:36.702302 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b426ba6-ab50-4dc9-b10f-e20c08d640da None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:36.702302 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b426ba6-ab50-4dc9-b10f-e20c08d640da None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:36.704089 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 672/1353] 10.222.0.96 () {54 vars in 918 bytes} [Fri Jan 28 01:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:36.816314 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c96356-7b8f-470e-82f3-fc1406dd0ba9 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:36.816848 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c96356-7b8f-470e-82f3-fc1406dd0ba9 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:36.816848 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c96356-7b8f-470e-82f3-fc1406dd0ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:36.834559 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-21c96356-7b8f-470e-82f3-fc1406dd0ba9 None None] MFA Rules not processed for user `88a16f0ecf3448428e969359be57dda8`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:36.835745 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-21c96356-7b8f-470e-82f3-fc1406dd0ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:36.844447 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 682/1354] 10.222.0.96 () {58 vars in 1015 bytes} [Fri Jan 28 01:50:36 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:36.860328 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc2d61-0ef9-4af8-8a2d-dbaa78dc15d0 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:36.860641 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc2d61-0ef9-4af8-8a2d-dbaa78dc15d0 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:36.861344 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc2d61-0ef9-4af8-8a2d-dbaa78dc15d0 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:36.862714 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 673/1355] 10.222.0.96 () {54 vars in 918 bytes} [Fri Jan 28 01:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:36.867970 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed9edf-7111-4e25-80f6-a19d969fbae7 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:36.868262 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed9edf-7111-4e25-80f6-a19d969fbae7 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:36.868541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed9edf-7111-4e25-80f6-a19d969fbae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:36.887200 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-94ed9edf-7111-4e25-80f6-a19d969fbae7 None None] MFA Rules not processed for user `cc85f5db9c3c47fca68ebab33b0bb73c`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:36.888369 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-94ed9edf-7111-4e25-80f6-a19d969fbae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:36.897968 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 683/1356] 10.222.0.96 () {58 vars in 1015 bytes} [Fri Jan 28 01:50:36 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:39.694024 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992cd20-c244-4208-91fb-283c4afc522b None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:39.694564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992cd20-c244-4208-91fb-283c4afc522b None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:39.694564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992cd20-c244-4208-91fb-283c4afc522b None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:39.696336 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 674/1357] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:39.703882 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf0bd0-f8f8-4d0b-9e95-a85d517098ea None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:39.704397 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf0bd0-f8f8-4d0b-9e95-a85d517098ea None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:39.704654 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf0bd0-f8f8-4d0b-9e95-a85d517098ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:39.722859 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-dbdf0bd0-f8f8-4d0b-9e95-a85d517098ea None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:39.724034 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-dbdf0bd0-f8f8-4d0b-9e95-a85d517098ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:39.731721 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 684/1358] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:50:39 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:39.775264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992cd20-c244-4208-91fb-283c4afc522b None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:39.789332 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992cd20-c244-4208-91fb-283c4afc522b None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:39.794543 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e2ab6-878d-40a4-ad6d-05a78726588c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:39.795274 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e2ab6-878d-40a4-ad6d-05a78726588c service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:39.795557 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e2ab6-878d-40a4-ad6d-05a78726588c service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:39.795827 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e2ab6-878d-40a4-ad6d-05a78726588c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:39.804071 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e2ab6-878d-40a4-ad6d-05a78726588c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:39.805607 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e2ab6-878d-40a4-ad6d-05a78726588c service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:39.815092 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 675/1359] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:50:39 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:41.255351 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b46a6c-33be-4fd8-be1f-eb3d90ce7178 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:41.255926 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b46a6c-33be-4fd8-be1f-eb3d90ce7178 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:41.255926 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b46a6c-33be-4fd8-be1f-eb3d90ce7178 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:41.257714 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 685/1360] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:41.263416 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd62d4b-c8f2-4ff5-972b-dc7b27e78a57 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:41.263807 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd62d4b-c8f2-4ff5-972b-dc7b27e78a57 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:41.263972 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd62d4b-c8f2-4ff5-972b-dc7b27e78a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:41.282772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-7cd62d4b-c8f2-4ff5-972b-dc7b27e78a57 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:41.283972 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-7cd62d4b-c8f2-4ff5-972b-dc7b27e78a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:41.291753 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 676/1361] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:50:41 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:41.444932 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b46a6c-33be-4fd8-be1f-eb3d90ce7178 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:41.462904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b46a6c-33be-4fd8-be1f-eb3d90ce7178 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:41.468234 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f92d3-0709-4159-89f5-b7b74354fcd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:41.468902 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f92d3-0709-4159-89f5-b7b74354fcd1 service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:41.469178 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f92d3-0709-4159-89f5-b7b74354fcd1 service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:41.469485 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f92d3-0709-4159-89f5-b7b74354fcd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:41.477864 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f92d3-0709-4159-89f5-b7b74354fcd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:41.479510 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f92d3-0709-4159-89f5-b7b74354fcd1 service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:41.489022 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 686/1362] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:50:41 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:42.901361 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fe987-b0c4-43b8-b38e-c0a26b5279c4 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:42.901872 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fe987-b0c4-43b8-b38e-c0a26b5279c4 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:42.901872 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fe987-b0c4-43b8-b38e-c0a26b5279c4 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:42.903592 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 677/1363] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:42.910499 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd1278-4c7c-4c57-9cf4-8f9b9e1ea375 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:42.910948 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd1278-4c7c-4c57-9cf4-8f9b9e1ea375 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:42.911041 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd1278-4c7c-4c57-9cf4-8f9b9e1ea375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:42.928370 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-c4fd1278-4c7c-4c57-9cf4-8f9b9e1ea375 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:42.929584 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c4fd1278-4c7c-4c57-9cf4-8f9b9e1ea375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:42.937217 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 687/1364] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:50:42 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:43.092928 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fe987-b0c4-43b8-b38e-c0a26b5279c4 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:43.106795 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fe987-b0c4-43b8-b38e-c0a26b5279c4 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:43.112141 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ed82a-768b-4704-b134-7bbd9759dced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:43.112769 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ed82a-768b-4704-b134-7bbd9759dced service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:43.113074 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ed82a-768b-4704-b134-7bbd9759dced service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:43.113348 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ed82a-768b-4704-b134-7bbd9759dced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:43.121123 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ed82a-768b-4704-b134-7bbd9759dced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:43.122685 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ed82a-768b-4704-b134-7bbd9759dced service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:43.132312 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 678/1365] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:50:43 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:44.528704 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc78a61-2cff-41db-878c-bfc93682b431 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:44.529303 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc78a61-2cff-41db-878c-bfc93682b431 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:44.529303 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc78a61-2cff-41db-878c-bfc93682b431 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:44.531301 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 688/1366] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:44.537324 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749d9e7-cbd3-4848-aad4-46631dbc1e93 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:44.537797 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749d9e7-cbd3-4848-aad4-46631dbc1e93 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:44.537906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749d9e7-cbd3-4848-aad4-46631dbc1e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:44.557042 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-f749d9e7-cbd3-4848-aad4-46631dbc1e93 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:44.558221 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-f749d9e7-cbd3-4848-aad4-46631dbc1e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:44.567444 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 679/1367] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:50:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:44.721547 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc78a61-2cff-41db-878c-bfc93682b431 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:44.735251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc78a61-2cff-41db-878c-bfc93682b431 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:44.740487 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207950c-6d88-454d-8b46-70d223ad9fe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:44.741140 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207950c-6d88-454d-8b46-70d223ad9fe1 service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:44.741417 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207950c-6d88-454d-8b46-70d223ad9fe1 service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:44.741684 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207950c-6d88-454d-8b46-70d223ad9fe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:44.749679 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207950c-6d88-454d-8b46-70d223ad9fe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:44.751969 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207950c-6d88-454d-8b46-70d223ad9fe1 service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:44.760889 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 689/1368] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:50:44 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:46.162663 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223974f9-cd25-4bf2-9d33-dd02b855666c None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:46.163242 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223974f9-cd25-4bf2-9d33-dd02b855666c None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:46.163242 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223974f9-cd25-4bf2-9d33-dd02b855666c None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:46.165051 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 680/1369] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:46.170626 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c952d0-d4f0-4e60-9406-0ace1b468193 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:46.171017 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c952d0-d4f0-4e60-9406-0ace1b468193 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:46.171171 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c952d0-d4f0-4e60-9406-0ace1b468193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:46.189259 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-23c952d0-d4f0-4e60-9406-0ace1b468193 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:46.190435 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-23c952d0-d4f0-4e60-9406-0ace1b468193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:46.198009 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 690/1370] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:50:46 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:46.359424 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223974f9-cd25-4bf2-9d33-dd02b855666c None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:46.374073 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223974f9-cd25-4bf2-9d33-dd02b855666c None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:46.380629 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c426bc-52a8-4a70-8072-a911de5cc83c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:46.381295 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c426bc-52a8-4a70-8072-a911de5cc83c service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:46.381571 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c426bc-52a8-4a70-8072-a911de5cc83c service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:46.381841 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c426bc-52a8-4a70-8072-a911de5cc83c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:46.389699 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c426bc-52a8-4a70-8072-a911de5cc83c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:46.391805 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c426bc-52a8-4a70-8072-a911de5cc83c service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:46.400908 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 681/1371] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:50:46 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:47.783730 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a3c66-316f-48fa-8003-a46ad518232f None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:47.784293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a3c66-316f-48fa-8003-a46ad518232f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:47.784293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a3c66-316f-48fa-8003-a46ad518232f None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:47.786101 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 691/1372] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:50:47.791830 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801ce34-bad9-4508-a55f-2e545bb4aa37 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:47.792257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801ce34-bad9-4508-a55f-2e545bb4aa37 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:47.792372 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801ce34-bad9-4508-a55f-2e545bb4aa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:47.810255 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-1801ce34-bad9-4508-a55f-2e545bb4aa37 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:47.811391 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1801ce34-bad9-4508-a55f-2e545bb4aa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:47.819638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 682/1373] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:50:47 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:50:47.973032 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a3c66-316f-48fa-8003-a46ad518232f None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:47.987679 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a3c66-316f-48fa-8003-a46ad518232f None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:47.992941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b9db3-3642-43d9-9e03-e8b39b701d3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:47.993572 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b9db3-3642-43d9-9e03-e8b39b701d3f service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:47.993842 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b9db3-3642-43d9-9e03-e8b39b701d3f service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:47.994107 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b9db3-3642-43d9-9e03-e8b39b701d3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:48.002675 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b9db3-3642-43d9-9e03-e8b39b701d3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:48.004238 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b9db3-3642-43d9-9e03-e8b39b701d3f service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:48.013852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 692/1374] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:50:47 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:49.360494 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f3aa6-4754-4bae-880c-6086d8678f11 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:49.361091 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f3aa6-4754-4bae-880c-6086d8678f11 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:49.361189 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f3aa6-4754-4bae-880c-6086d8678f11 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:49.362929 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 683/1375] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:49.368665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597d100-55ab-4872-a83e-17cf14222e09 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:49.369145 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597d100-55ab-4872-a83e-17cf14222e09 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:49.369241 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597d100-55ab-4872-a83e-17cf14222e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:49.387633 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-5597d100-55ab-4872-a83e-17cf14222e09 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:49.388904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-5597d100-55ab-4872-a83e-17cf14222e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:49.396598 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 693/1376] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:50:49 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:50:49.552220 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f3aa6-4754-4bae-880c-6086d8678f11 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:49.566933 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f3aa6-4754-4bae-880c-6086d8678f11 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:49.572278 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa40ae-3b5c-4751-9c50-252d9ee1ee45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:49.572939 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa40ae-3b5c-4751-9c50-252d9ee1ee45 service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:49.573219 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa40ae-3b5c-4751-9c50-252d9ee1ee45 service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:49.573492 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa40ae-3b5c-4751-9c50-252d9ee1ee45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:49.581535 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa40ae-3b5c-4751-9c50-252d9ee1ee45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:49.583175 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa40ae-3b5c-4751-9c50-252d9ee1ee45 service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:49.592279 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 684/1377] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:50:49 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:50.950118 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08c6a1-c032-4f4d-994f-1dfbb2d72a8f None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:50.950625 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08c6a1-c032-4f4d-994f-1dfbb2d72a8f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:50.950625 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08c6a1-c032-4f4d-994f-1dfbb2d72a8f None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:50.952321 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 694/1378] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:50.958510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8393b-1870-4693-999f-a5485bbdf615 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:50.958966 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8393b-1870-4693-999f-a5485bbdf615 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:50.959063 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8393b-1870-4693-999f-a5485bbdf615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:50.976873 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-23c8393b-1870-4693-999f-a5485bbdf615 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:50.978083 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-23c8393b-1870-4693-999f-a5485bbdf615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:50.986436 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 685/1379] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:50:50 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:51.144383 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08c6a1-c032-4f4d-994f-1dfbb2d72a8f None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:51.159192 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08c6a1-c032-4f4d-994f-1dfbb2d72a8f None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:51.164394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd4d84-67d4-4474-87f3-cded4885c620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:51.165045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd4d84-67d4-4474-87f3-cded4885c620 service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:51.165321 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd4d84-67d4-4474-87f3-cded4885c620 service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:51.165585 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd4d84-67d4-4474-87f3-cded4885c620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:51.174338 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd4d84-67d4-4474-87f3-cded4885c620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:51.175909 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd4d84-67d4-4474-87f3-cded4885c620 service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:51.185013 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 695/1380] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:50:51 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:52.537768 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20d147-446e-4273-91e9-73fc169d9107 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:52.538315 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20d147-446e-4273-91e9-73fc169d9107 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:52.538315 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20d147-446e-4273-91e9-73fc169d9107 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:52.540094 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 686/1381] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:52.545849 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4fd9d-a905-4f83-b23d-8e5c2c153914 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:52.546299 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4fd9d-a905-4f83-b23d-8e5c2c153914 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:52.546410 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4fd9d-a905-4f83-b23d-8e5c2c153914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:52.565250 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-c1a4fd9d-a905-4f83-b23d-8e5c2c153914 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:52.566496 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c1a4fd9d-a905-4f83-b23d-8e5c2c153914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:52.574251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 696/1382] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:50:52 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:52.727414 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20d147-446e-4273-91e9-73fc169d9107 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:52.741972 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20d147-446e-4273-91e9-73fc169d9107 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:52.747230 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc42af-e77d-41af-bcfb-8fb036ae051d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:52.747855 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc42af-e77d-41af-bcfb-8fb036ae051d service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:52.748136 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc42af-e77d-41af-bcfb-8fb036ae051d service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:52.748407 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc42af-e77d-41af-bcfb-8fb036ae051d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:52.756432 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc42af-e77d-41af-bcfb-8fb036ae051d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:52.758063 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc42af-e77d-41af-bcfb-8fb036ae051d service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:52.767137 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 687/1383] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:50:52 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:54.880473 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bad147-2faf-4cc4-9219-c6fd21cd0e0c None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:54.881010 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bad147-2faf-4cc4-9219-c6fd21cd0e0c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:54.881010 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bad147-2faf-4cc4-9219-c6fd21cd0e0c None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:54.882799 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 697/1384] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:54.890284 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a07ee3-eabe-4f53-9761-c9943eb6ddd0 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:54.891227 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a07ee3-eabe-4f53-9761-c9943eb6ddd0 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:54.891436 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a07ee3-eabe-4f53-9761-c9943eb6ddd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:54.909672 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-42a07ee3-eabe-4f53-9761-c9943eb6ddd0 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:54.910864 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-42a07ee3-eabe-4f53-9761-c9943eb6ddd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:54.918626 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 688/1385] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:50:54 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:54.958372 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bad147-2faf-4cc4-9219-c6fd21cd0e0c None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:54.969220 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bad147-2faf-4cc4-9219-c6fd21cd0e0c None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:54.974071 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647daef-54f7-4e96-a8e3-4d0c2c0f959a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:54.974728 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647daef-54f7-4e96-a8e3-4d0c2c0f959a service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:54.975001 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647daef-54f7-4e96-a8e3-4d0c2c0f959a service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:54.975265 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647daef-54f7-4e96-a8e3-4d0c2c0f959a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:54.985490 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647daef-54f7-4e96-a8e3-4d0c2c0f959a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:54.987887 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647daef-54f7-4e96-a8e3-4d0c2c0f959a service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:55.003159 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 698/1386] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:50:54 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:57.464563 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811230a-0404-4e0b-85b1-67d2d936526e None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:57.465158 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811230a-0404-4e0b-85b1-67d2d936526e None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:57.465158 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811230a-0404-4e0b-85b1-67d2d936526e None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:57.466916 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 689/1387] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:50:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:57.475024 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee22cc-8152-4456-9c1a-a7df1998b1e1 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:57.475481 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee22cc-8152-4456-9c1a-a7df1998b1e1 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:57.475576 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee22cc-8152-4456-9c1a-a7df1998b1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:57.493110 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-b5ee22cc-8152-4456-9c1a-a7df1998b1e1 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:57.494286 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b5ee22cc-8152-4456-9c1a-a7df1998b1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:57.502497 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 699/1388] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:50:57 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:57.543425 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811230a-0404-4e0b-85b1-67d2d936526e None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:57.554695 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811230a-0404-4e0b-85b1-67d2d936526e None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:57.558262 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90906784-8359-4c82-8b79-48aa274c1c0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:57.558918 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90906784-8359-4c82-8b79-48aa274c1c0b service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:57.559166 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90906784-8359-4c82-8b79-48aa274c1c0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:57.559439 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90906784-8359-4c82-8b79-48aa274c1c0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:57.569834 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90906784-8359-4c82-8b79-48aa274c1c0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:57.571254 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90906784-8359-4c82-8b79-48aa274c1c0b service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:57.580944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 690/1389] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:50:57 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:51:00.160870 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f95a9-6a90-4d79-997e-431690e51612 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:00.161475 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f95a9-6a90-4d79-997e-431690e51612 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:00.161475 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f95a9-6a90-4d79-997e-431690e51612 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:00.163196 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 700/1390] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:00.170537 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482102ca-5faa-48a6-bd45-aa9daa9c7562 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:00.170995 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482102ca-5faa-48a6-bd45-aa9daa9c7562 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:00.171434 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482102ca-5faa-48a6-bd45-aa9daa9c7562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:00.190150 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-482102ca-5faa-48a6-bd45-aa9daa9c7562 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:00.191330 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-482102ca-5faa-48a6-bd45-aa9daa9c7562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:00.198953 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 691/1391] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:51:00 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:51:00.239114 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f95a9-6a90-4d79-997e-431690e51612 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:00.250277 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f95a9-6a90-4d79-997e-431690e51612 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:00.253967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa48842-9d31-44f2-8f29-6e81fd5cc4d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:00.254594 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa48842-9d31-44f2-8f29-6e81fd5cc4d3 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:00.254873 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa48842-9d31-44f2-8f29-6e81fd5cc4d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:00.255145 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa48842-9d31-44f2-8f29-6e81fd5cc4d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:00.264048 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa48842-9d31-44f2-8f29-6e81fd5cc4d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:00.266388 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa48842-9d31-44f2-8f29-6e81fd5cc4d3 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:00.275556 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 701/1392] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:51:00 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:51:02.569903 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c15f6-a378-4576-809d-9bb08b295e31 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:02.570397 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c15f6-a378-4576-809d-9bb08b295e31 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:02.570497 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c15f6-a378-4576-809d-9bb08b295e31 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:02.572278 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 692/1393] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:02.580406 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd1d2e-cae6-4d39-954b-119df9e76b2b None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:02.580848 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd1d2e-cae6-4d39-954b-119df9e76b2b None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:02.580963 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd1d2e-cae6-4d39-954b-119df9e76b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:02.599226 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-d0dd1d2e-cae6-4d39-954b-119df9e76b2b None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:02.600400 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-d0dd1d2e-cae6-4d39-954b-119df9e76b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:02.607976 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 702/1394] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:51:02 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:51:02.646775 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c15f6-a378-4576-809d-9bb08b295e31 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:02.658128 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c15f6-a378-4576-809d-9bb08b295e31 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:02.661852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50021eaa-1050-4994-9c63-c4069056d30e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:02.662489 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50021eaa-1050-4994-9c63-c4069056d30e service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:02.662769 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50021eaa-1050-4994-9c63-c4069056d30e service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:02.663038 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50021eaa-1050-4994-9c63-c4069056d30e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:02.673336 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50021eaa-1050-4994-9c63-c4069056d30e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:02.674774 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50021eaa-1050-4994-9c63-c4069056d30e service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:02.684891 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 693/1395] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:51:02 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:51:04.975832 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd8f4b-b793-47f3-b664-3401d2243357 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:04.976408 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd8f4b-b793-47f3-b664-3401d2243357 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:04.976408 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd8f4b-b793-47f3-b664-3401d2243357 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:04.978154 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 703/1396] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:04.986321 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc43537-67a1-402d-916f-f1dba866955f None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:04.987655 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc43537-67a1-402d-916f-f1dba866955f None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:04.987655 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc43537-67a1-402d-916f-f1dba866955f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:05.005139 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-bbc43537-67a1-402d-916f-f1dba866955f None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:05.006330 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-bbc43537-67a1-402d-916f-f1dba866955f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:05.014244 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 694/1397] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:51:04 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:51:05.054005 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd8f4b-b793-47f3-b664-3401d2243357 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:05.064770 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd8f4b-b793-47f3-b664-3401d2243357 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:05.068280 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a1b06-e8b5-489d-9e40-8485a3155515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:05.068941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a1b06-e8b5-489d-9e40-8485a3155515 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:05.069219 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a1b06-e8b5-489d-9e40-8485a3155515 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:05.069489 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a1b06-e8b5-489d-9e40-8485a3155515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:05.078967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a1b06-e8b5-489d-9e40-8485a3155515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:05.080386 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a1b06-e8b5-489d-9e40-8485a3155515 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:05.089559 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 704/1398] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:51:05 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:51:07.367434 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096839b-286f-461c-af31-fef0abcd3b65 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:07.367993 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096839b-286f-461c-af31-fef0abcd3b65 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:07.367993 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096839b-286f-461c-af31-fef0abcd3b65 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:07.369837 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 695/1399] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:07.378059 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ca81b-eed0-421f-9464-cc6489e270e0 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:07.378507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ca81b-eed0-421f-9464-cc6489e270e0 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:07.378623 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ca81b-eed0-421f-9464-cc6489e270e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:07.396231 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-475ca81b-eed0-421f-9464-cc6489e270e0 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:07.397444 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-475ca81b-eed0-421f-9464-cc6489e270e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:07.405677 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 705/1400] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:51:07 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:51:07.445303 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096839b-286f-461c-af31-fef0abcd3b65 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:07.455441 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096839b-286f-461c-af31-fef0abcd3b65 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:07.458859 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483f9d3-65bb-4077-bc8e-3f6cc8726b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:07.459475 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483f9d3-65bb-4077-bc8e-3f6cc8726b26 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:07.459751 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483f9d3-65bb-4077-bc8e-3f6cc8726b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:07.460021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483f9d3-65bb-4077-bc8e-3f6cc8726b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:07.468838 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483f9d3-65bb-4077-bc8e-3f6cc8726b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:07.470239 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483f9d3-65bb-4077-bc8e-3f6cc8726b26 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:07.479120 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 696/1401] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:51:07 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:51:09.734293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab58f14-598d-47c1-99d5-096bdd383b93 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:09.734877 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab58f14-598d-47c1-99d5-096bdd383b93 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:09.734982 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab58f14-598d-47c1-99d5-096bdd383b93 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:09.736775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 706/1402] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:51:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:09.744529 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af6a50-2b5e-4895-b174-36f87a8117a1 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:09.745071 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af6a50-2b5e-4895-b174-36f87a8117a1 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:09.745193 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af6a50-2b5e-4895-b174-36f87a8117a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:09.762939 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-99af6a50-2b5e-4895-b174-36f87a8117a1 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:09.764684 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-99af6a50-2b5e-4895-b174-36f87a8117a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:09.772534 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 697/1403] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:51:09 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:51:09.811367 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab58f14-598d-47c1-99d5-096bdd383b93 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:09.822123 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab58f14-598d-47c1-99d5-096bdd383b93 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:09.825751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0095c-e187-4462-867a-8e7277470480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:09.826383 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0095c-e187-4462-867a-8e7277470480 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:09.827195 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0095c-e187-4462-867a-8e7277470480 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:09.827477 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0095c-e187-4462-867a-8e7277470480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:09.836617 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0095c-e187-4462-867a-8e7277470480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:09.838072 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0095c-e187-4462-867a-8e7277470480 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:09.848177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 707/1404] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:51:09 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:51:12.115668 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d0b6a-e618-47bc-8fe0-0592cb00f1d3 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:12.116226 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d0b6a-e618-47bc-8fe0-0592cb00f1d3 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:12.116226 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d0b6a-e618-47bc-8fe0-0592cb00f1d3 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:12.118026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 698/1405] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:12.126659 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c63025-c676-4ee0-9574-130982c6a517 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:12.127185 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c63025-c676-4ee0-9574-130982c6a517 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:12.127185 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c63025-c676-4ee0-9574-130982c6a517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:12.144889 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-e1c63025-c676-4ee0-9574-130982c6a517 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:12.146083 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-e1c63025-c676-4ee0-9574-130982c6a517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:12.153756 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 708/1406] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:51:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:51:12.194065 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d0b6a-e618-47bc-8fe0-0592cb00f1d3 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:12.204910 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d0b6a-e618-47bc-8fe0-0592cb00f1d3 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:12.208322 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89f38d-717d-4283-b7f7-38fd4e17611e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:12.208987 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89f38d-717d-4283-b7f7-38fd4e17611e service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:12.209269 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89f38d-717d-4283-b7f7-38fd4e17611e service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:12.209540 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89f38d-717d-4283-b7f7-38fd4e17611e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:12.219326 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89f38d-717d-4283-b7f7-38fd4e17611e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:12.220745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89f38d-717d-4283-b7f7-38fd4e17611e service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:12.230453 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 699/1407] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:51:12 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:51:14.441991 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9c988-382a-4560-a76e-a1f382c09a5e None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:14.442548 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9c988-382a-4560-a76e-a1f382c09a5e None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:14.442548 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9c988-382a-4560-a76e-a1f382c09a5e None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:14.444294 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 709/1408] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:14.451755 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eff91-fc05-43fc-aa44-ae8208f95343 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:14.452268 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eff91-fc05-43fc-aa44-ae8208f95343 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:14.452562 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eff91-fc05-43fc-aa44-ae8208f95343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:14.470360 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-c13eff91-fc05-43fc-aa44-ae8208f95343 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:14.471536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c13eff91-fc05-43fc-aa44-ae8208f95343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:14.479186 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 700/1409] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:51:14 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:51:14.516637 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9c988-382a-4560-a76e-a1f382c09a5e None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:14.526961 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9c988-382a-4560-a76e-a1f382c09a5e None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:14.531599 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d7a0c-f12b-4740-839f-7fc47386afcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:14.532230 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d7a0c-f12b-4740-839f-7fc47386afcd service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:14.532505 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d7a0c-f12b-4740-839f-7fc47386afcd service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:14.532771 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d7a0c-f12b-4740-839f-7fc47386afcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:14.541824 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d7a0c-f12b-4740-839f-7fc47386afcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:14.543261 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d7a0c-f12b-4740-839f-7fc47386afcd service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:14.553554 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 710/1410] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:51:14 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:51:16.791601 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a13f9-d593-40ab-addb-1fa174c0b310 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:16.792158 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a13f9-d593-40ab-addb-1fa174c0b310 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:16.792158 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a13f9-d593-40ab-addb-1fa174c0b310 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:16.793964 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 701/1411] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:16.802453 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bed943-d6f5-483a-aa79-cbb22ed4ba07 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:16.802882 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bed943-d6f5-483a-aa79-cbb22ed4ba07 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:16.802985 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bed943-d6f5-483a-aa79-cbb22ed4ba07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:16.820761 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-39bed943-d6f5-483a-aa79-cbb22ed4ba07 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:16.821978 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-39bed943-d6f5-483a-aa79-cbb22ed4ba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:16.830073 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 711/1412] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:51:16 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:51:16.868858 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a13f9-d593-40ab-addb-1fa174c0b310 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:16.879529 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a13f9-d593-40ab-addb-1fa174c0b310 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:16.882992 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6234a-9d2a-49ba-bf24-3f9af78a7642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:16.883622 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6234a-9d2a-49ba-bf24-3f9af78a7642 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:16.883901 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6234a-9d2a-49ba-bf24-3f9af78a7642 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:16.884174 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6234a-9d2a-49ba-bf24-3f9af78a7642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:16.893533 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6234a-9d2a-49ba-bf24-3f9af78a7642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:16.894973 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6234a-9d2a-49ba-bf24-3f9af78a7642 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:16.905079 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 702/1413] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:51:16 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:51:29.860941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f58fb-66dd-4956-b43e-2085d5dc71f7 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:29.861561 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f58fb-66dd-4956-b43e-2085d5dc71f7 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:29.861561 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f58fb-66dd-4956-b43e-2085d5dc71f7 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:29.863172 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 712/1414] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:51:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:29.869603 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d029e-8e9e-4e13-9f17-ac856f81cf3f None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:29.870029 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d029e-8e9e-4e13-9f17-ac856f81cf3f None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:29.870182 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d029e-8e9e-4e13-9f17-ac856f81cf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:29.889026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-233d029e-8e9e-4e13-9f17-ac856f81cf3f None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:29.890332 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-233d029e-8e9e-4e13-9f17-ac856f81cf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:29.898118 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 703/1415] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:51:29 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:51:29.947042 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ab594-096e-4337-acea-7931df3f8512 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:29.947322 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ab594-096e-4337-acea-7931df3f8512 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:29.947591 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ab594-096e-4337-acea-7931df3f8512 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:29.949381 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 713/1416] 10.222.0.96 () {54 vars in 961 bytes} [Fri Jan 28 01:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:29.955232 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d13f06-1980-4600-8dd6-6d9a0cc01719 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:29.955527 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d13f06-1980-4600-8dd6-6d9a0cc01719 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:29.955789 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d13f06-1980-4600-8dd6-6d9a0cc01719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:29.974292 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-49d13f06-1980-4600-8dd6-6d9a0cc01719 None None] MFA Rules not processed for user `07298acc960e4154be7c79f2368a1952`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:29.975481 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-49d13f06-1980-4600-8dd6-6d9a0cc01719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:29.981929 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 704/1417] 10.222.0.96 () {58 vars in 1058 bytes} [Fri Jan 28 01:51:29 2022] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:51:29.989753 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ab594-096e-4337-acea-7931df3f8512 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:30.000597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ab594-096e-4337-acea-7931df3f8512 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:30.004123 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1fb4a-4d0f-4ccf-bd25-515ac0ea5f9c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07298acc960e4154be7c79f2368a1952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:30.004750 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1fb4a-4d0f-4ccf-bd25-515ac0ea5f9c service glance] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:30.005060 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1fb4a-4d0f-4ccf-bd25-515ac0ea5f9c service glance] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:30.005333 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1fb4a-4d0f-4ccf-bd25-515ac0ea5f9c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:30.014876 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1fb4a-4d0f-4ccf-bd25-515ac0ea5f9c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:30.016316 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1fb4a-4d0f-4ccf-bd25-515ac0ea5f9c service glance] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:30.025665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 714/1418] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:51:29 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:51:32.320456 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecd860-c505-4df5-8154-f08cf98d270c None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:32.321071 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecd860-c505-4df5-8154-f08cf98d270c None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:32.321071 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecd860-c505-4df5-8154-f08cf98d270c None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:32.322790 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 705/1419] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:32.330783 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614ee88-9b42-40fd-8e49-bce1fea5fe91 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:32.331278 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614ee88-9b42-40fd-8e49-bce1fea5fe91 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:32.331375 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614ee88-9b42-40fd-8e49-bce1fea5fe91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:32.350452 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-f614ee88-9b42-40fd-8e49-bce1fea5fe91 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:32.351654 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-f614ee88-9b42-40fd-8e49-bce1fea5fe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:32.359759 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 715/1420] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:51:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:51:32.383574 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecd860-c505-4df5-8154-f08cf98d270c None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:32.396216 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecd860-c505-4df5-8154-f08cf98d270c None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:32.400584 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0db3a1-f094-4c76-924c-7d6fe69a6012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:32.401252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0db3a1-f094-4c76-924c-7d6fe69a6012 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:32.401535 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0db3a1-f094-4c76-924c-7d6fe69a6012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:32.401809 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0db3a1-f094-4c76-924c-7d6fe69a6012 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:32.402530 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0db3a1-f094-4c76-924c-7d6fe69a6012 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:32.405374 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0db3a1-f094-4c76-924c-7d6fe69a6012 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:32.424102 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 706/1421] 10.222.0.96 () {56 vars in 1108 bytes} [Fri Jan 28 01:51:32 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:51:34.648252 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7455258-0ef6-4d06-9437-91b4a41b8876 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:34.648843 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7455258-0ef6-4d06-9437-91b4a41b8876 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:34.648843 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7455258-0ef6-4d06-9437-91b4a41b8876 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:34.650606 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 716/1422] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:34.659138 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41452b-2de7-4ce1-a29e-d932184e43f5 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:34.659600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41452b-2de7-4ce1-a29e-d932184e43f5 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:34.659700 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41452b-2de7-4ce1-a29e-d932184e43f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:34.677397 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-aa41452b-2de7-4ce1-a29e-d932184e43f5 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:34.678582 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-aa41452b-2de7-4ce1-a29e-d932184e43f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:34.686800 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 707/1423] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:51:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:51:34.730579 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7455258-0ef6-4d06-9437-91b4a41b8876 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:34.745254 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7455258-0ef6-4d06-9437-91b4a41b8876 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:34.751114 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ca68c-cf3e-4c6f-a2a1-65b29074eacc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:34.751745 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ca68c-cf3e-4c6f-a2a1-65b29074eacc service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:34.752027 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ca68c-cf3e-4c6f-a2a1-65b29074eacc service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:34.752303 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ca68c-cf3e-4c6f-a2a1-65b29074eacc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:34.760920 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ca68c-cf3e-4c6f-a2a1-65b29074eacc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:34.763298 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ca68c-cf3e-4c6f-a2a1-65b29074eacc service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:34.773092 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 717/1424] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:51:34 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:51:37.150348 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6f55f-2271-4fa1-88c6-2db5b34b6c54 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:37.150938 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6f55f-2271-4fa1-88c6-2db5b34b6c54 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:37.150938 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6f55f-2271-4fa1-88c6-2db5b34b6c54 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:37.152720 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 708/1425] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:37.161090 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c15964-edcb-4b00-8532-812282964a4f None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:37.161569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c15964-edcb-4b00-8532-812282964a4f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:37.161681 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c15964-edcb-4b00-8532-812282964a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:37.179418 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-22c15964-edcb-4b00-8532-812282964a4f None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:37.180592 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-22c15964-edcb-4b00-8532-812282964a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:37.188216 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 718/1426] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:51:37 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:51:37.224788 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6f55f-2271-4fa1-88c6-2db5b34b6c54 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:37.236032 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6f55f-2271-4fa1-88c6-2db5b34b6c54 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:37.239528 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bed40-a653-43c8-8016-c254fe4ab2fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:37.240156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bed40-a653-43c8-8016-c254fe4ab2fd service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:37.240436 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bed40-a653-43c8-8016-c254fe4ab2fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:37.240710 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bed40-a653-43c8-8016-c254fe4ab2fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:37.250274 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bed40-a653-43c8-8016-c254fe4ab2fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:37.251724 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bed40-a653-43c8-8016-c254fe4ab2fd service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:37.261029 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 709/1427] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:51:37 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:51:39.491488 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2cf60-230c-4662-8c82-6d64684a8c66 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:39.492060 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2cf60-230c-4662-8c82-6d64684a8c66 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:39.492060 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2cf60-230c-4662-8c82-6d64684a8c66 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:39.493815 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 719/1428] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:39.501031 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96119792-d3d5-4529-9d86-ab93bda2acef None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:39.501519 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96119792-d3d5-4529-9d86-ab93bda2acef None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:39.501623 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96119792-d3d5-4529-9d86-ab93bda2acef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:39.519466 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-96119792-d3d5-4529-9d86-ab93bda2acef None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:39.520695 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-96119792-d3d5-4529-9d86-ab93bda2acef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:39.529413 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 710/1429] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:51:39 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:51:39.568494 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2cf60-230c-4662-8c82-6d64684a8c66 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:39.579815 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2cf60-230c-4662-8c82-6d64684a8c66 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:39.583347 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a97a4f-0463-48af-a20b-9b68c2f4fa99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:39.583991 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a97a4f-0463-48af-a20b-9b68c2f4fa99 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:39.584270 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a97a4f-0463-48af-a20b-9b68c2f4fa99 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:39.584578 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a97a4f-0463-48af-a20b-9b68c2f4fa99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:39.594064 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a97a4f-0463-48af-a20b-9b68c2f4fa99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:39.595494 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a97a4f-0463-48af-a20b-9b68c2f4fa99 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:39.604664 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 720/1430] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:51:39 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:51:41.978508 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db91a04-6226-42f9-aeda-f966f68a3226 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:41.979029 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db91a04-6226-42f9-aeda-f966f68a3226 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:41.979029 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db91a04-6226-42f9-aeda-f966f68a3226 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:41.980883 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 711/1431] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:41.988166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c15a90-23b0-46d0-b51e-69869a1e8431 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:41.988584 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c15a90-23b0-46d0-b51e-69869a1e8431 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:41.988992 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c15a90-23b0-46d0-b51e-69869a1e8431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:42.007084 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-61c15a90-23b0-46d0-b51e-69869a1e8431 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:42.008301 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-61c15a90-23b0-46d0-b51e-69869a1e8431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:42.016606 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 721/1432] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:51:41 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:51:42.057904 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db91a04-6226-42f9-aeda-f966f68a3226 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:42.068727 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db91a04-6226-42f9-aeda-f966f68a3226 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:42.072183 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb601f1f-e9ef-4be1-b550-d423f683283d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:42.072821 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb601f1f-e9ef-4be1-b550-d423f683283d service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:42.073115 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb601f1f-e9ef-4be1-b550-d423f683283d service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:42.073385 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb601f1f-e9ef-4be1-b550-d423f683283d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:42.082308 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb601f1f-e9ef-4be1-b550-d423f683283d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:42.083718 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb601f1f-e9ef-4be1-b550-d423f683283d service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:42.093300 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 712/1433] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:51:42 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:51:44.494033 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee698c-da72-4019-8922-a004edc0abed None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:44.494600 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee698c-da72-4019-8922-a004edc0abed None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:44.494600 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee698c-da72-4019-8922-a004edc0abed None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:44.496355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 722/1434] 10.222.0.96 () {54 vars in 926 bytes} [Fri Jan 28 01:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:51:44.503689 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf311062-6fa4-4761-b2b7-3ae2cec32d13 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:44.504192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf311062-6fa4-4761-b2b7-3ae2cec32d13 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:44.504291 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf311062-6fa4-4761-b2b7-3ae2cec32d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:44.525857 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-bf311062-6fa4-4761-b2b7-3ae2cec32d13 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:51:44.526996 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-bf311062-6fa4-4761-b2b7-3ae2cec32d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:51:44.535841 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 713/1435] 10.222.0.96 () {58 vars in 1023 bytes} [Fri Jan 28 01:51:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:51:44.577490 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee698c-da72-4019-8922-a004edc0abed None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:51:44.593404 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee698c-da72-4019-8922-a004edc0abed None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:51:44.596931 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17e010-18a7-4b92-bfc8-9efbde24a8fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:51:44.597567 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17e010-18a7-4b92-bfc8-9efbde24a8fc service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:51:44.597840 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17e010-18a7-4b92-bfc8-9efbde24a8fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:51:44.598107 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17e010-18a7-4b92-bfc8-9efbde24a8fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:51:44.608534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17e010-18a7-4b92-bfc8-9efbde24a8fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:51:44.610011 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17e010-18a7-4b92-bfc8-9efbde24a8fc service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:51:44.619247 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 723/1436] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:51:44 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:53:04.091272 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c129ca-dc0e-4072-891b-7e6903358ea8 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:04.091884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c129ca-dc0e-4072-891b-7e6903358ea8 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:04.091884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c129ca-dc0e-4072-891b-7e6903358ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:04.110264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-16c129ca-dc0e-4072-891b-7e6903358ea8 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:04.111499 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-16c129ca-dc0e-4072-891b-7e6903358ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:04.120078 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 714/1437] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:53:04 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:53:04.128180 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf0b54-1def-412a-924d-b4c6d7324483 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:04.128688 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf0b54-1def-412a-924d-b4c6d7324483 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:04.128816 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf0b54-1def-412a-924d-b4c6d7324483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:04.146903 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-79bf0b54-1def-412a-924d-b4c6d7324483 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:04.148097 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-79bf0b54-1def-412a-924d-b4c6d7324483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:04.156159 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 724/1438] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:53:04 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:53:04.160738 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c129ca-dc0e-4072-891b-7e6903358ea8 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:04.171244 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c129ca-dc0e-4072-891b-7e6903358ea8 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:04.175800 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6d5a9-77de-4661-859b-a552d69bb260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:04.176451 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6d5a9-77de-4661-859b-a552d69bb260 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:04.176730 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6d5a9-77de-4661-859b-a552d69bb260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:04.177040 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6d5a9-77de-4661-859b-a552d69bb260 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:04.177752 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6d5a9-77de-4661-859b-a552d69bb260 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:53:04.178058 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6d5a9-77de-4661-859b-a552d69bb260 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:04.180160 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6d5a9-77de-4661-859b-a552d69bb260 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:04.191687 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 715/1439] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:53:04.200567 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf0b54-1def-412a-924d-b4c6d7324483 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:04.209493 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf0b54-1def-412a-924d-b4c6d7324483 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:04.214238 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cbe6a-abff-430d-83bc-66f75a621a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:04.214877 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cbe6a-abff-430d-83bc-66f75a621a2d admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:04.215152 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cbe6a-abff-430d-83bc-66f75a621a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:04.215419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cbe6a-abff-430d-83bc-66f75a621a2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:04.216091 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cbe6a-abff-430d-83bc-66f75a621a2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:04.218000 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cbe6a-abff-430d-83bc-66f75a621a2d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:04.252655 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 725/1440] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:53:04 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:53:04.256825 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6d5a9-77de-4661-859b-a552d69bb260 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:04.267285 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6d5a9-77de-4661-859b-a552d69bb260 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:04.325778 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9810cfa-b561-4d82-9748-ebda55c6499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:04.326453 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9810cfa-b561-4d82-9748-ebda55c6499e admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:04.326729 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9810cfa-b561-4d82-9748-ebda55c6499e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:04.326997 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9810cfa-b561-4d82-9748-ebda55c6499e admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:04.327675 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9810cfa-b561-4d82-9748-ebda55c6499e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:04.329652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9810cfa-b561-4d82-9748-ebda55c6499e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:04.349830 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 716/1441] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:53:04 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:53:04.354549 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cbe6a-abff-430d-83bc-66f75a621a2d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:04.364438 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cbe6a-abff-430d-83bc-66f75a621a2d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:04.369736 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff7242-1867-4e10-aec9-50ccda20c09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:04.370389 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff7242-1867-4e10-aec9-50ccda20c09e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:04.370664 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff7242-1867-4e10-aec9-50ccda20c09e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:04.370933 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff7242-1867-4e10-aec9-50ccda20c09e admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:04.371667 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff7242-1867-4e10-aec9-50ccda20c09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:04.373282 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff7242-1867-4e10-aec9-50ccda20c09e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:04.385868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 726/1442] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:53:04.390101 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9810cfa-b561-4d82-9748-ebda55c6499e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:04.400375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9810cfa-b561-4d82-9748-ebda55c6499e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:04.405213 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595f833-1398-487f-857b-91fbc82f0e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:04.405861 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595f833-1398-487f-857b-91fbc82f0e68 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:04.406136 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595f833-1398-487f-857b-91fbc82f0e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:04.406405 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595f833-1398-487f-857b-91fbc82f0e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:04.407141 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595f833-1398-487f-857b-91fbc82f0e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:04.408715 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595f833-1398-487f-857b-91fbc82f0e68 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:04.422510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 717/1443] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:53:04.426773 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff7242-1867-4e10-aec9-50ccda20c09e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:04.437034 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff7242-1867-4e10-aec9-50ccda20c09e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:04.441551 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126943bd-4227-4035-8a57-bcfce89b8c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:04.442419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126943bd-4227-4035-8a57-bcfce89b8c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:04.442693 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126943bd-4227-4035-8a57-bcfce89b8c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:04.442961 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126943bd-4227-4035-8a57-bcfce89b8c9b admin admin] PATH_INFO: `/v3/projects/de042d6d92b242ed9c5170eb69cf741e/users/44a988996af644dcbd6cfc5d418ddeaf/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:04.457425 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126943bd-4227-4035-8a57-bcfce89b8c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=de042d6d92b242ed9c5170eb69cf741e, user_id=44a988996af644dcbd6cfc5d418ddeaf, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:04.460042 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126943bd-4227-4035-8a57-bcfce89b8c9b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:04.479375 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 727/1444] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:53:04 2022] PUT /identity/v3/projects/de042d6d92b242ed9c5170eb69cf741e/users/44a988996af644dcbd6cfc5d418ddeaf/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:53:04.491622 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7c8e-4a5f-4713-b010-18e9eedc28a7 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:04.492001 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7c8e-4a5f-4713-b010-18e9eedc28a7 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:04.492942 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7c8e-4a5f-4713-b010-18e9eedc28a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:04.520119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-494c7c8e-4a5f-4713-b010-18e9eedc28a7 None None] MFA Rules not processed for user `44a988996af644dcbd6cfc5d418ddeaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:04.521341 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-494c7c8e-4a5f-4713-b010-18e9eedc28a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:04.583778 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 718/1445] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:53:04 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:53:04.595764 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126943bd-4227-4035-8a57-bcfce89b8c9b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:04.663215 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126943bd-4227-4035-8a57-bcfce89b8c9b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:04.669086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb5c51-5943-4cde-85ad-269175a1b656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:04.669724 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb5c51-5943-4cde-85ad-269175a1b656 service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:04.669997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb5c51-5943-4cde-85ad-269175a1b656 service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:04.670266 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb5c51-5943-4cde-85ad-269175a1b656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:04.677801 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb5c51-5943-4cde-85ad-269175a1b656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:04.679420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb5c51-5943-4cde-85ad-269175a1b656 service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:04.687873 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 728/1446] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:53:04 2022] GET /identity/v3/auth/tokens => generated 3399 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:53:04.755044 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75e48d-25bc-4e59-aba0-399affec6494 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:04.755332 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75e48d-25bc-4e59-aba0-399affec6494 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:04.755607 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75e48d-25bc-4e59-aba0-399affec6494 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:04.757343 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 719/1447] 10.222.0.96 () {52 vars in 829 bytes} [Fri Jan 28 01:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:53:04.761077 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb5c51-5943-4cde-85ad-269175a1b656 service nova] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:04.819651 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb5c51-5943-4cde-85ad-269175a1b656 service nova] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:04.824547 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330ee85-d12a-4057-8a8a-222ebdbb8b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:04.825425 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330ee85-d12a-4057-8a8a-222ebdbb8b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:04.825704 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330ee85-d12a-4057-8a8a-222ebdbb8b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:04.825975 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330ee85-d12a-4057-8a8a-222ebdbb8b5f admin admin] PATH_INFO: `/v3/users/44a988996af644dcbd6cfc5d418ddeaf` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:04.827126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330ee85-d12a-4057-8a8a-222ebdbb8b5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a988996af644dcbd6cfc5d418ddeaf)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:04.828136 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-7330ee85-d12a-4057-8a8a-222ebdbb8b5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:53:04.828136 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:53:04.828136 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:53:04.829349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330ee85-d12a-4057-8a8a-222ebdbb8b5f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:04.899858 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7330ee85-d12a-4057-8a8a-222ebdbb8b5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a988996af644dcbd6cfc5d418ddeaf'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:53:04.900515 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7330ee85-d12a-4057-8a8a-222ebdbb8b5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a988996af644dcbd6cfc5d418ddeaf'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:53:04.901496 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7330ee85-d12a-4057-8a8a-222ebdbb8b5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a988996af644dcbd6cfc5d418ddeaf'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:53:04.911009 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7330ee85-d12a-4057-8a8a-222ebdbb8b5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a988996af644dcbd6cfc5d418ddeaf'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:53:04.924439 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7330ee85-d12a-4057-8a8a-222ebdbb8b5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a988996af644dcbd6cfc5d418ddeaf'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:53:04.949059 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 729/1448] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:53:04 2022] DELETE /identity/v3/users/44a988996af644dcbd6cfc5d418ddeaf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:53:04.953512 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc147f9f-c8ce-4fdf-af8a-508842b80448 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:04.953828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc147f9f-c8ce-4fdf-af8a-508842b80448 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:04.954107 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc147f9f-c8ce-4fdf-af8a-508842b80448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:04.971726 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-cc147f9f-c8ce-4fdf-af8a-508842b80448 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:53:04.972961 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-cc147f9f-c8ce-4fdf-af8a-508842b80448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:05.029326 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 720/1449] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:53:04 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:53:05.039800 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330ee85-d12a-4057-8a8a-222ebdbb8b5f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:05.041255 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-7330ee85-d12a-4057-8a8a-222ebdbb8b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:05.098910 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330ee85-d12a-4057-8a8a-222ebdbb8b5f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:05.102742 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5dd32-69ca-4109-b506-29b28d36b83d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:05.103379 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5dd32-69ca-4109-b506-29b28d36b83d service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:05.103656 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5dd32-69ca-4109-b506-29b28d36b83d service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:05.103926 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5dd32-69ca-4109-b506-29b28d36b83d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:05.112654 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5dd32-69ca-4109-b506-29b28d36b83d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:05.114117 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5dd32-69ca-4109-b506-29b28d36b83d service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:05.123395 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 730/1450] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:53:05 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:53:05.454946 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc147f9f-c8ce-4fdf-af8a-508842b80448 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:53:05.456441 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-cc147f9f-c8ce-4fdf-af8a-508842b80448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:53:05.468212 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc147f9f-c8ce-4fdf-af8a-508842b80448 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:53:05.472972 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0cd92-1e9a-4b87-9264-8e8588d9495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:53:05.473835 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0cd92-1e9a-4b87-9264-8e8588d9495e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:53:05.474113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0cd92-1e9a-4b87-9264-8e8588d9495e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:53:05.474389 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0cd92-1e9a-4b87-9264-8e8588d9495e admin admin] PATH_INFO: `/v3/projects/de042d6d92b242ed9c5170eb69cf741e` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:53:05.475572 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0cd92-1e9a-4b87-9264-8e8588d9495e admin admin] RBAC: Authorizing `identity:delete_project(project_id=de042d6d92b242ed9c5170eb69cf741e)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:53:05.476638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING py.warnings [None req-9ef0cd92-1e9a-4b87-9264-8e8588d9495e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:53:05.476638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: warnings.warn(msg) Jan 28 01:53:05.476638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: Jan 28 01:53:05.477861 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0cd92-1e9a-4b87-9264-8e8588d9495e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:53:05.538256 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9ef0cd92-1e9a-4b87-9264-8e8588d9495e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de042d6d92b242ed9c5170eb69cf741e', 'request_id': 'req-9ef0cd92-1e9a-4b87-9264-8e8588d9495e'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:53:05.551240 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9ef0cd92-1e9a-4b87-9264-8e8588d9495e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de042d6d92b242ed9c5170eb69cf741e', 'request_id': 'req-9ef0cd92-1e9a-4b87-9264-8e8588d9495e'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:53:05.557659 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9ef0cd92-1e9a-4b87-9264-8e8588d9495e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de042d6d92b242ed9c5170eb69cf741e', 'request_id': 'req-9ef0cd92-1e9a-4b87-9264-8e8588d9495e'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:53:05.572286 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9ef0cd92-1e9a-4b87-9264-8e8588d9495e admin admin] The token cache is being invalidate because project de042d6d92b242ed9c5170eb69cf741e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:53:05.572573 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9ef0cd92-1e9a-4b87-9264-8e8588d9495e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:53:05.573272 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9ef0cd92-1e9a-4b87-9264-8e8588d9495e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:53:05.574923 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 721/1451] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:53:05 2022] DELETE /identity/v3/projects/de042d6d92b242ed9c5170eb69cf741e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:54:40.093893 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de530ef-9bb4-4dd4-8e10-d173697a2fd1 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:40.094581 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de530ef-9bb4-4dd4-8e10-d173697a2fd1 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:40.094581 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de530ef-9bb4-4dd4-8e10-d173697a2fd1 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:40.096860 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 731/1452] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:54:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:54:40.103986 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6155f8-565d-43af-b9e2-1c3828afa59d None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:40.104589 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6155f8-565d-43af-b9e2-1c3828afa59d None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:40.104912 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6155f8-565d-43af-b9e2-1c3828afa59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:40.131413 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-1f6155f8-565d-43af-b9e2-1c3828afa59d None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:40.132679 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1f6155f8-565d-43af-b9e2-1c3828afa59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:40.202495 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 722/1453] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:54:40 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:40.210075 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341f3dd-6ee0-4fa3-b428-3db89b9b7b5f None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:40.210449 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341f3dd-6ee0-4fa3-b428-3db89b9b7b5f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:40.210783 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341f3dd-6ee0-4fa3-b428-3db89b9b7b5f None None] PATH_INFO: `/v3` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:40.212437 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 732/1454] 10.222.0.100 () {54 vars in 926 bytes} [Fri Jan 28 01:54:40 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:54:40.219677 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf41e21-b9a9-4dcf-87e1-b22a39202956 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:40.220178 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf41e21-b9a9-4dcf-87e1-b22a39202956 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:40.220571 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf41e21-b9a9-4dcf-87e1-b22a39202956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:40.241471 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-8cf41e21-b9a9-4dcf-87e1-b22a39202956 None None] MFA Rules not processed for user `88a16f0ecf3448428e969359be57dda8`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:40.242702 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-8cf41e21-b9a9-4dcf-87e1-b22a39202956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:40.315377 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 723/1455] 10.222.0.100 () {58 vars in 1016 bytes} [Fri Jan 28 01:54:40 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:54:40.375266 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341f3dd-6ee0-4fa3-b428-3db89b9b7b5f None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:40.377172 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-0341f3dd-6ee0-4fa3-b428-3db89b9b7b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:40.467879 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341f3dd-6ee0-4fa3-b428-3db89b9b7b5f None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:40.474639 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dbc96-847a-41ee-a75d-0a128506ae5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:40.475299 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dbc96-847a-41ee-a75d-0a128506ae5f service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:40.475580 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dbc96-847a-41ee-a75d-0a128506ae5f service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:40.475855 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dbc96-847a-41ee-a75d-0a128506ae5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:40.484754 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60dbc96-847a-41ee-a75d-0a128506ae5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:40.486426 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60dbc96-847a-41ee-a75d-0a128506ae5f service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:40.497803 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 733/1456] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:54:40 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:54:41.941612 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f864d37-eba6-41df-b8d0-99f3f95de586 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:41.942175 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f864d37-eba6-41df-b8d0-99f3f95de586 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:41.942175 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f864d37-eba6-41df-b8d0-99f3f95de586 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:41.944274 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 724/1457] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:54:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:54:41.950826 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f252fb0-db65-4ae5-9611-1d26b45b962a None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:41.951496 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f252fb0-db65-4ae5-9611-1d26b45b962a None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:41.951640 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f252fb0-db65-4ae5-9611-1d26b45b962a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:41.972992 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-0f252fb0-db65-4ae5-9611-1d26b45b962a None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:41.974273 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-0f252fb0-db65-4ae5-9611-1d26b45b962a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:41.983387 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 734/1458] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:54:41 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:42.149345 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f864d37-eba6-41df-b8d0-99f3f95de586 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:42.165347 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f864d37-eba6-41df-b8d0-99f3f95de586 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:42.171569 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb217235-5f64-4099-b823-f834e1391236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:42.172286 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb217235-5f64-4099-b823-f834e1391236 service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:42.172617 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb217235-5f64-4099-b823-f834e1391236 service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:42.172964 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb217235-5f64-4099-b823-f834e1391236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:42.183436 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb217235-5f64-4099-b823-f834e1391236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:42.185245 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb217235-5f64-4099-b823-f834e1391236 service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:42.197569 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 725/1459] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:54:42 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:54:48.866450 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcf17d-7004-4db1-ab17-950bcbd13924 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:48.866976 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcf17d-7004-4db1-ab17-950bcbd13924 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:48.867083 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcf17d-7004-4db1-ab17-950bcbd13924 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:48.868912 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 735/1460] 10.222.0.96 () {54 vars in 960 bytes} [Fri Jan 28 01:54:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:54:48.874706 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5614aa1-823b-48c6-b38c-75091ccad0ba None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:48.875208 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5614aa1-823b-48c6-b38c-75091ccad0ba None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:48.875343 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5614aa1-823b-48c6-b38c-75091ccad0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:48.896134 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-d5614aa1-823b-48c6-b38c-75091ccad0ba None None] MFA Rules not processed for user `88a16f0ecf3448428e969359be57dda8`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:48.897375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-d5614aa1-823b-48c6-b38c-75091ccad0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:48.906031 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 726/1461] 10.222.0.96 () {58 vars in 1057 bytes} [Fri Jan 28 01:54:48 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:48.913929 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcf17d-7004-4db1-ab17-950bcbd13924 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:48.928121 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcf17d-7004-4db1-ab17-950bcbd13924 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:48.933090 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78c802-d896-4476-a571-98a0af2141fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a16f0ecf3448428e969359be57dda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:48.933725 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78c802-d896-4476-a571-98a0af2141fe service placement] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:48.934006 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78c802-d896-4476-a571-98a0af2141fe service placement] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:48.934279 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78c802-d896-4476-a571-98a0af2141fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:48.943762 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78c802-d896-4476-a571-98a0af2141fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:48.945676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78c802-d896-4476-a571-98a0af2141fe service placement] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:48.955403 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 736/1462] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:54:48 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:54:54.053259 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9530a-80c4-482f-898e-51d27c62d982 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:54.053895 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9530a-80c4-482f-898e-51d27c62d982 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:54.053895 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9530a-80c4-482f-898e-51d27c62d982 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:54.055607 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 727/1463] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:54:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:54.061335 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f6fdf-21a3-4930-98c6-64cd0e19120c None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:54.061764 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f6fdf-21a3-4930-98c6-64cd0e19120c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:54.061887 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f6fdf-21a3-4930-98c6-64cd0e19120c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:54.080420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-a21f6fdf-21a3-4930-98c6-64cd0e19120c None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:54.082468 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a21f6fdf-21a3-4930-98c6-64cd0e19120c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:54.090704 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 737/1464] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:54:54 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:54.247266 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9530a-80c4-482f-898e-51d27c62d982 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:54.261724 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9530a-80c4-482f-898e-51d27c62d982 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:54.267323 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414ca4d-4f43-481c-91f5-a02be69a5490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:54.267986 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414ca4d-4f43-481c-91f5-a02be69a5490 service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:54.268262 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414ca4d-4f43-481c-91f5-a02be69a5490 service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:54.268542 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414ca4d-4f43-481c-91f5-a02be69a5490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:54.278688 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414ca4d-4f43-481c-91f5-a02be69a5490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:54.280295 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414ca4d-4f43-481c-91f5-a02be69a5490 service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:54.291034 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 728/1465] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:54:54 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:54:55.732351 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0f641-df91-4694-b446-7e34ee3ce9eb None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:55.732947 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0f641-df91-4694-b446-7e34ee3ce9eb None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:55.732947 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0f641-df91-4694-b446-7e34ee3ce9eb None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:55.734871 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 738/1466] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:54:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:54:55.742119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fb62b-d6f4-461d-822e-57ded62bd45e None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:55.742708 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fb62b-d6f4-461d-822e-57ded62bd45e None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:55.742829 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fb62b-d6f4-461d-822e-57ded62bd45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:55.761657 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-0b7fb62b-d6f4-461d-822e-57ded62bd45e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:54:55.762869 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-0b7fb62b-d6f4-461d-822e-57ded62bd45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:54:55.771130 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 729/1467] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:54:55 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:54:55.928565 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0f641-df91-4694-b446-7e34ee3ce9eb None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:54:55.944051 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0f641-df91-4694-b446-7e34ee3ce9eb None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:54:55.950072 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28ff80-3296-427a-8772-be5fff622fc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:54:55.950742 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28ff80-3296-427a-8772-be5fff622fc2 service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:54:55.951023 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28ff80-3296-427a-8772-be5fff622fc2 service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:54:55.951295 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28ff80-3296-427a-8772-be5fff622fc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:54:55.961844 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28ff80-3296-427a-8772-be5fff622fc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:54:55.965016 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28ff80-3296-427a-8772-be5fff622fc2 service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:54:55.982463 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 739/1468] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:54:55 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:00.423422 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f072e-456d-4455-a322-23d0ba055149 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:00.423962 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f072e-456d-4455-a322-23d0ba055149 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:00.423962 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f072e-456d-4455-a322-23d0ba055149 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:00.426422 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 730/1469] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:55:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:00.433610 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7fde9-6890-4bd0-8bae-a207888f5c8f None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:00.434036 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7fde9-6890-4bd0-8bae-a207888f5c8f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:00.434161 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7fde9-6890-4bd0-8bae-a207888f5c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:00.452553 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-47f7fde9-6890-4bd0-8bae-a207888f5c8f None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:00.453859 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-47f7fde9-6890-4bd0-8bae-a207888f5c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:00.461732 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 740/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:55:00 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:00.503705 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f072e-456d-4455-a322-23d0ba055149 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:00.505416 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-d56f072e-456d-4455-a322-23d0ba055149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:00.562076 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f072e-456d-4455-a322-23d0ba055149 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:00.565598 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced4198-4ab8-4556-8d04-8e65123c0327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:00.566233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced4198-4ab8-4556-8d04-8e65123c0327 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:00.566508 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced4198-4ab8-4556-8d04-8e65123c0327 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:00.566774 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced4198-4ab8-4556-8d04-8e65123c0327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:00.575295 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced4198-4ab8-4556-8d04-8e65123c0327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:00.576695 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced4198-4ab8-4556-8d04-8e65123c0327 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:00.587064 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 731/1471] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:00 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:02.796073 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f806583-c7c1-4d21-9023-9d00d78ea6b7 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:02.796612 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f806583-c7c1-4d21-9023-9d00d78ea6b7 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:02.796612 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f806583-c7c1-4d21-9023-9d00d78ea6b7 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:02.798466 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 741/1472] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:55:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:02.805837 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc56c8-0c35-4bef-b017-fbf1101bb68b None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:02.806291 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc56c8-0c35-4bef-b017-fbf1101bb68b None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:02.806397 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc56c8-0c35-4bef-b017-fbf1101bb68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:02.824518 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-1bfc56c8-0c35-4bef-b017-fbf1101bb68b None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:02.825740 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1bfc56c8-0c35-4bef-b017-fbf1101bb68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:02.834053 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 732/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:55:02 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:02.869995 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f806583-c7c1-4d21-9023-9d00d78ea6b7 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:02.880884 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f806583-c7c1-4d21-9023-9d00d78ea6b7 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:02.884341 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866e0a9-851d-4f47-abd1-1a1dc0e2ee8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:02.884998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866e0a9-851d-4f47-abd1-1a1dc0e2ee8e service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:02.885275 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866e0a9-851d-4f47-abd1-1a1dc0e2ee8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:02.885542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866e0a9-851d-4f47-abd1-1a1dc0e2ee8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:02.894794 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866e0a9-851d-4f47-abd1-1a1dc0e2ee8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:02.896192 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866e0a9-851d-4f47-abd1-1a1dc0e2ee8e service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:02.905807 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 742/1474] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:02 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:06.670268 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0fd31-266c-4b55-bae9-2a052d7f8e26 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:06.670781 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0fd31-266c-4b55-bae9-2a052d7f8e26 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:06.670781 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0fd31-266c-4b55-bae9-2a052d7f8e26 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:06.672543 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 733/1475] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:55:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:06.680068 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fe51c-f250-4bbb-b8e4-e1a151aafa5c None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:06.680536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fe51c-f250-4bbb-b8e4-e1a151aafa5c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:06.680657 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fe51c-f250-4bbb-b8e4-e1a151aafa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:06.700195 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-e15fe51c-f250-4bbb-b8e4-e1a151aafa5c None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:06.701457 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-e15fe51c-f250-4bbb-b8e4-e1a151aafa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:06.710306 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 743/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:55:06 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:06.761328 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0fd31-266c-4b55-bae9-2a052d7f8e26 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:06.763007 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-a9d0fd31-266c-4b55-bae9-2a052d7f8e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:06.821457 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0fd31-266c-4b55-bae9-2a052d7f8e26 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:06.824940 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29443779-fb90-4e58-9d34-e667b65e6ae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:06.825575 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29443779-fb90-4e58-9d34-e667b65e6ae6 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:06.825850 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29443779-fb90-4e58-9d34-e667b65e6ae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:06.826116 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29443779-fb90-4e58-9d34-e667b65e6ae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:06.835537 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29443779-fb90-4e58-9d34-e667b65e6ae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:06.836969 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29443779-fb90-4e58-9d34-e667b65e6ae6 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:06.845985 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 734/1477] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:06 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:55:09.057942 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8063177-837a-4d6c-804c-f5f461f9b0ad None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:09.058508 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8063177-837a-4d6c-804c-f5f461f9b0ad None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:09.058508 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8063177-837a-4d6c-804c-f5f461f9b0ad None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:09.060269 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 744/1478] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:55:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:09.067498 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63949d-9f90-402c-8aa7-b00c3137be2a None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:09.067953 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63949d-9f90-402c-8aa7-b00c3137be2a None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:09.068044 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63949d-9f90-402c-8aa7-b00c3137be2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:09.086349 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-4a63949d-9f90-402c-8aa7-b00c3137be2a None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:09.087553 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-4a63949d-9f90-402c-8aa7-b00c3137be2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:09.095347 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 735/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:55:09 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:09.147220 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb21b2-8729-4b4a-aa8d-7f2c1c69e13f None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:09.147505 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb21b2-8729-4b4a-aa8d-7f2c1c69e13f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:09.147784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb21b2-8729-4b4a-aa8d-7f2c1c69e13f None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:09.149594 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 745/1480] 10.222.0.96 () {54 vars in 962 bytes} [Fri Jan 28 01:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:55:09.155223 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e7879-6ad5-4cf3-a904-899d0cef45ba None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:09.155511 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e7879-6ad5-4cf3-a904-899d0cef45ba None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:09.155783 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e7879-6ad5-4cf3-a904-899d0cef45ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:09.174587 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-b39e7879-6ad5-4cf3-a904-899d0cef45ba None None] MFA Rules not processed for user `eb36af30d0fe4369b4459f333cb64a36`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:55:09.176192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b39e7879-6ad5-4cf3-a904-899d0cef45ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:55:09.182592 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 736/1481] 10.222.0.96 () {58 vars in 1059 bytes} [Fri Jan 28 01:55:09 2022] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:55:09.190963 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb21b2-8729-4b4a-aa8d-7f2c1c69e13f None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:55:09.201427 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb21b2-8729-4b4a-aa8d-7f2c1c69e13f None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:55:09.204958 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110e72c-2e3b-4dff-ad63-ab230a8bbc41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:55:09.206154 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110e72c-2e3b-4dff-ad63-ab230a8bbc41 service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:55:09.206527 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110e72c-2e3b-4dff-ad63-ab230a8bbc41 service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:55:09.206931 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110e72c-2e3b-4dff-ad63-ab230a8bbc41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:55:09.215888 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110e72c-2e3b-4dff-ad63-ab230a8bbc41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:55:09.217371 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110e72c-2e3b-4dff-ad63-ab230a8bbc41 service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:55:09.227382 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 746/1482] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:55:09 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:44.513081 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240baa61-9b73-44d5-89ff-1a84c44e7880 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:44.513879 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240baa61-9b73-44d5-89ff-1a84c44e7880 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:44.513879 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240baa61-9b73-44d5-89ff-1a84c44e7880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:44.549754 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-240baa61-9b73-44d5-89ff-1a84c44e7880 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:44.551320 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-240baa61-9b73-44d5-89ff-1a84c44e7880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:44.617429 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 737/1483] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:56:44.630184 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29208fc-12bc-4c6c-9698-8c575b022de6 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:44.630776 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29208fc-12bc-4c6c-9698-8c575b022de6 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:44.630776 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29208fc-12bc-4c6c-9698-8c575b022de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:44.647841 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce18eb-e39c-47cf-995a-e6fd75036a54 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:44.648045 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce18eb-e39c-47cf-995a-e6fd75036a54 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:44.648564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce18eb-e39c-47cf-995a-e6fd75036a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:44.671506 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-f29208fc-12bc-4c6c-9698-8c575b022de6 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:44.673852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-f29208fc-12bc-4c6c-9698-8c575b022de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:44.689661 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-acce18eb-e39c-47cf-995a-e6fd75036a54 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:44.690819 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-acce18eb-e39c-47cf-995a-e6fd75036a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:44.709577 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 738/1484] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:56:44.710212 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 747/1485] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:44.721910 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce18eb-e39c-47cf-995a-e6fd75036a54 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:44.731531 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb792986-e345-4c0a-83fb-2c43f6f7ac99 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:44.738231 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb792986-e345-4c0a-83fb-2c43f6f7ac99 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:44.739069 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb792986-e345-4c0a-83fb-2c43f6f7ac99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:44.747814 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce18eb-e39c-47cf-995a-e6fd75036a54 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:44.764728 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced30fd-5af7-4ead-b6c5-f749fc78c011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:44.766084 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced30fd-5af7-4ead-b6c5-f749fc78c011 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:44.766569 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced30fd-5af7-4ead-b6c5-f749fc78c011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:44.767036 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced30fd-5af7-4ead-b6c5-f749fc78c011 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:44.768460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced30fd-5af7-4ead-b6c5-f749fc78c011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:56:44.768765 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced30fd-5af7-4ead-b6c5-f749fc78c011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:44.770784 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced30fd-5af7-4ead-b6c5-f749fc78c011 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:44.778299 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-eb792986-e345-4c0a-83fb-2c43f6f7ac99 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:44.780147 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-eb792986-e345-4c0a-83fb-2c43f6f7ac99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:44.800248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 739/1486] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:56:44.801137 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 748/1487] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:44.802843 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a356cd5-f161-46da-94a4-2a8d41ee167e None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:44.803517 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a356cd5-f161-46da-94a4-2a8d41ee167e None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:44.804018 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a356cd5-f161-46da-94a4-2a8d41ee167e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:44.806913 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2f6fa-6754-4034-9086-aca84ae2138d None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:44.807374 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2f6fa-6754-4034-9086-aca84ae2138d None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:44.807842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2f6fa-6754-4034-9086-aca84ae2138d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:44.846548 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-5a356cd5-f161-46da-94a4-2a8d41ee167e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:44.848495 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-5a356cd5-f161-46da-94a4-2a8d41ee167e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:44.855936 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-04b2f6fa-6754-4034-9086-aca84ae2138d None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:44.858447 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-04b2f6fa-6754-4034-9086-aca84ae2138d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:44.870461 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 749/1488] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:44.872086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a356cd5-f161-46da-94a4-2a8d41ee167e None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:44.877369 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 740/1489] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:44.878666 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2f6fa-6754-4034-9086-aca84ae2138d None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:44.896345 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2f6fa-6754-4034-9086-aca84ae2138d None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:44.897178 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a356cd5-f161-46da-94a4-2a8d41ee167e None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:44.901892 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5404d-3d84-488e-8ee9-3edfb0845a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:44.902480 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5404d-3d84-488e-8ee9-3edfb0845a83 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:44.902757 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5404d-3d84-488e-8ee9-3edfb0845a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:44.903021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5404d-3d84-488e-8ee9-3edfb0845a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:44.903729 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5404d-3d84-488e-8ee9-3edfb0845a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:44.904049 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ea55a-6c3a-42fd-b2e7-2a4374f20308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:44.904587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ea55a-6c3a-42fd-b2e7-2a4374f20308 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:44.904932 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ea55a-6c3a-42fd-b2e7-2a4374f20308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:44.905193 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ea55a-6c3a-42fd-b2e7-2a4374f20308 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:44.906045 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5404d-3d84-488e-8ee9-3edfb0845a83 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:44.906677 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ea55a-6c3a-42fd-b2e7-2a4374f20308 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:56:44.907247 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ea55a-6c3a-42fd-b2e7-2a4374f20308 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:44.909416 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ea55a-6c3a-42fd-b2e7-2a4374f20308 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:44.924127 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 750/1490] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:56:44.925658 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4de8dd-4f7d-4cc3-9b75-a4393f9531da None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:44.925979 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4de8dd-4f7d-4cc3-9b75-a4393f9531da None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:44.926886 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4de8dd-4f7d-4cc3-9b75-a4393f9531da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:44.953012 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-bc4de8dd-4f7d-4cc3-9b75-a4393f9531da None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:44.953820 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 741/1491] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:56:44 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:44.954521 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-bc4de8dd-4f7d-4cc3-9b75-a4393f9531da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:44.954648 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d19ad-634a-4b01-a559-899d42d8bc55 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:44.954648 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d19ad-634a-4b01-a559-899d42d8bc55 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:44.954648 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d19ad-634a-4b01-a559-899d42d8bc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:44.979170 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-a80d19ad-634a-4b01-a559-899d42d8bc55 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:44.980673 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-a80d19ad-634a-4b01-a559-899d42d8bc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:45.028627 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 751/1492] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:45.032474 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2180b5-9c4a-456a-88c7-cc0fa34b4cad None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.033471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2180b5-9c4a-456a-88c7-cc0fa34b4cad None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.034335 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2180b5-9c4a-456a-88c7-cc0fa34b4cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.060631 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-1d2180b5-9c4a-456a-88c7-cc0fa34b4cad None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:45.062774 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-1d2180b5-9c4a-456a-88c7-cc0fa34b4cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:45.068987 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 742/1493] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:45.079410 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 752/1494] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:45 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:45.079410 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41659e4a-bfb7-4e35-8de9-0184cb426ed3 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.079410 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41659e4a-bfb7-4e35-8de9-0184cb426ed3 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.079410 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41659e4a-bfb7-4e35-8de9-0184cb426ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.080042 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcd401-baca-4429-b5bf-5e1bb9f51bac None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.080042 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcd401-baca-4429-b5bf-5e1bb9f51bac None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.080042 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcd401-baca-4429-b5bf-5e1bb9f51bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.099337 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-62bcd401-baca-4429-b5bf-5e1bb9f51bac None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:45.100594 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-62bcd401-baca-4429-b5bf-5e1bb9f51bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:45.100712 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-41659e4a-bfb7-4e35-8de9-0184cb426ed3 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:45.102008 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-41659e4a-bfb7-4e35-8de9-0184cb426ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:45.115670 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 753/1495] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:45 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:45.117405 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 743/1496] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:45 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:45.117405 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcd401-baca-4429-b5bf-5e1bb9f51bac None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:45.120292 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41659e4a-bfb7-4e35-8de9-0184cb426ed3 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:45.130101 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcd401-baca-4429-b5bf-5e1bb9f51bac None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:45.132390 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41659e4a-bfb7-4e35-8de9-0184cb426ed3 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:45.135788 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89c0c4-9706-4688-9b28-f3eeac023c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:45.136467 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89c0c4-9706-4688-9b28-f3eeac023c08 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.136761 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89c0c4-9706-4688-9b28-f3eeac023c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.137099 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89c0c4-9706-4688-9b28-f3eeac023c08 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.137702 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6127d-632f-420e-bedb-1fa6abdb0384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:45.137831 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89c0c4-9706-4688-9b28-f3eeac023c08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:45.138429 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6127d-632f-420e-bedb-1fa6abdb0384 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.138735 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6127d-632f-420e-bedb-1fa6abdb0384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.138974 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6127d-632f-420e-bedb-1fa6abdb0384 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.139650 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89c0c4-9706-4688-9b28-f3eeac023c08 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:45.139770 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6127d-632f-420e-bedb-1fa6abdb0384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:45.141872 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6127d-632f-420e-bedb-1fa6abdb0384 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:45.168824 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 744/1497] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:56:45 2022] POST /identity/v3/users => generated 293 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:45.174884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8c14d-a993-4443-8cf8-84b18c973ce0 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.175381 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8c14d-a993-4443-8cf8-84b18c973ce0 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.175658 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8c14d-a993-4443-8cf8-84b18c973ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.180359 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 754/1498] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:56:45 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:45.181162 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6127d-632f-420e-bedb-1fa6abdb0384 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:45.197295 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-49c8c14d-a993-4443-8cf8-84b18c973ce0 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:45.198617 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-49c8c14d-a993-4443-8cf8-84b18c973ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:45.270741 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6127d-632f-420e-bedb-1fa6abdb0384 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:45.271731 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 745/1499] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:45 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:45.273166 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7839d-69c4-40cd-9949-f8781f59ba0d None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.273449 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7839d-69c4-40cd-9949-f8781f59ba0d None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.273923 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7839d-69c4-40cd-9949-f8781f59ba0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.280424 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245eab70-cd8c-4e09-8976-b42a41c02c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:45.281682 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eab70-cd8c-4e09-8976-b42a41c02c0d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.282043 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eab70-cd8c-4e09-8976-b42a41c02c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.282502 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eab70-cd8c-4e09-8976-b42a41c02c0d admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.283500 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245eab70-cd8c-4e09-8976-b42a41c02c0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:56:45.283806 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245eab70-cd8c-4e09-8976-b42a41c02c0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:45.285494 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245eab70-cd8c-4e09-8976-b42a41c02c0d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:45.298831 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 755/1500] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:56:45.299707 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245eab70-cd8c-4e09-8976-b42a41c02c0d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:45.302787 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-d0d7839d-69c4-40cd-9949-f8781f59ba0d None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:45.304906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-d0d7839d-69c4-40cd-9949-f8781f59ba0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:45.310960 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245eab70-cd8c-4e09-8976-b42a41c02c0d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:45.316569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b607a5-7a51-4614-9922-f6f2aad439a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:45.317467 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b607a5-7a51-4614-9922-f6f2aad439a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.317717 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b607a5-7a51-4614-9922-f6f2aad439a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.318040 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b607a5-7a51-4614-9922-f6f2aad439a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.318264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 746/1501] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:45 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:45.318919 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b607a5-7a51-4614-9922-f6f2aad439a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:56:45.319207 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b607a5-7a51-4614-9922-f6f2aad439a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:45.319665 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139b81f-b9a7-43fb-a0eb-b2a3e43d3510 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.319895 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139b81f-b9a7-43fb-a0eb-b2a3e43d3510 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.320265 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139b81f-b9a7-43fb-a0eb-b2a3e43d3510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.320910 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b607a5-7a51-4614-9922-f6f2aad439a2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:45.336338 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 756/1502] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:56:45.338011 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aae923-87cb-4a67-addf-22e88159daf6 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.338253 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aae923-87cb-4a67-addf-22e88159daf6 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.338457 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aae923-87cb-4a67-addf-22e88159daf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.342883 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-b139b81f-b9a7-43fb-a0eb-b2a3e43d3510 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:45.344194 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b139b81f-b9a7-43fb-a0eb-b2a3e43d3510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:45.354425 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 747/1503] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:45 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:45.355106 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139b81f-b9a7-43fb-a0eb-b2a3e43d3510 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:45.364650 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-62aae923-87cb-4a67-addf-22e88159daf6 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:45.365964 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-62aae923-87cb-4a67-addf-22e88159daf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:45.366890 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139b81f-b9a7-43fb-a0eb-b2a3e43d3510 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:45.374288 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5f7ff-1ae2-429e-b6f2-aa7875be7b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:45.374601 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 757/1504] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:45 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:45.376045 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5f7ff-1ae2-429e-b6f2-aa7875be7b31 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.376518 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5f7ff-1ae2-429e-b6f2-aa7875be7b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.376750 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aae923-87cb-4a67-addf-22e88159daf6 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:45.377141 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5f7ff-1ae2-429e-b6f2-aa7875be7b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.378373 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5f7ff-1ae2-429e-b6f2-aa7875be7b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:45.381365 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5f7ff-1ae2-429e-b6f2-aa7875be7b31 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:45.387857 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aae923-87cb-4a67-addf-22e88159daf6 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:45.394156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dab20-c63f-4048-a96d-6fb341c6c5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:45.397743 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dab20-c63f-4048-a96d-6fb341c6c5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.397743 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dab20-c63f-4048-a96d-6fb341c6c5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.397743 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dab20-c63f-4048-a96d-6fb341c6c5d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.397743 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020dab20-c63f-4048-a96d-6fb341c6c5d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:45.398366 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 748/1505] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:45.398366 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5f7ff-1ae2-429e-b6f2-aa7875be7b31 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:45.398670 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020dab20-c63f-4048-a96d-6fb341c6c5d3 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:45.410971 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5f7ff-1ae2-429e-b6f2-aa7875be7b31 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:45.416771 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2a883-8ebb-49c1-8f93-fed8ff98902c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:45.417490 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2a883-8ebb-49c1-8f93-fed8ff98902c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.417775 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2a883-8ebb-49c1-8f93-fed8ff98902c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.418052 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2a883-8ebb-49c1-8f93-fed8ff98902c admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.418792 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2a883-8ebb-49c1-8f93-fed8ff98902c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:56:45.419171 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2a883-8ebb-49c1-8f93-fed8ff98902c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:45.420716 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2a883-8ebb-49c1-8f93-fed8ff98902c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:45.428645 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 758/1506] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:56:45 2022] POST /identity/v3/users => generated 289 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:45.428645 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dab20-c63f-4048-a96d-6fb341c6c5d3 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:45.436125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 749/1507] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:56:45.437885 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2a883-8ebb-49c1-8f93-fed8ff98902c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:45.438507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dab20-c63f-4048-a96d-6fb341c6c5d3 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:45.444405 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf97aef-cd36-4d44-9982-3c8c5cc98642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:45.445133 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf97aef-cd36-4d44-9982-3c8c5cc98642 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.445417 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf97aef-cd36-4d44-9982-3c8c5cc98642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.445932 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf97aef-cd36-4d44-9982-3c8c5cc98642 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.446394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf97aef-cd36-4d44-9982-3c8c5cc98642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:45.448392 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf97aef-cd36-4d44-9982-3c8c5cc98642 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:45.452133 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2a883-8ebb-49c1-8f93-fed8ff98902c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:45.457902 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be62a2-be07-48f2-866c-494e6ef81c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:45.458591 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be62a2-be07-48f2-866c-494e6ef81c90 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.458871 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be62a2-be07-48f2-866c-494e6ef81c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.459150 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be62a2-be07-48f2-866c-494e6ef81c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.459926 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be62a2-be07-48f2-866c-494e6ef81c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:56:45.460234 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be62a2-be07-48f2-866c-494e6ef81c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:45.461966 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be62a2-be07-48f2-866c-494e6ef81c90 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:45.478905 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 759/1508] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:56:45 2022] POST /identity/v3/projects => generated 403 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:45.479750 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 750/1509] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:56:45.487970 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf97aef-cd36-4d44-9982-3c8c5cc98642 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:45.488132 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be62a2-be07-48f2-866c-494e6ef81c90 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:45.503488 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be62a2-be07-48f2-866c-494e6ef81c90 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:45.568211 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf97aef-cd36-4d44-9982-3c8c5cc98642 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:45.573228 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69d747-6a8d-4ce9-b926-8399b7c66f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:45.573883 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69d747-6a8d-4ce9-b926-8399b7c66f51 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.574157 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69d747-6a8d-4ce9-b926-8399b7c66f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.574432 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69d747-6a8d-4ce9-b926-8399b7c66f51 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.575127 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69d747-6a8d-4ce9-b926-8399b7c66f51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:45.577077 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69d747-6a8d-4ce9-b926-8399b7c66f51 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:45.595436 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9058c5-a14c-4c77-8c77-150508d19898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:45.596412 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9058c5-a14c-4c77-8c77-150508d19898 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.596929 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9058c5-a14c-4c77-8c77-150508d19898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.597431 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9058c5-a14c-4c77-8c77-150508d19898 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.603726 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9058c5-a14c-4c77-8c77-150508d19898 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:56:45.604190 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9058c5-a14c-4c77-8c77-150508d19898 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:45.607081 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9058c5-a14c-4c77-8c77-150508d19898 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:45.618802 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 760/1510] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:56:45 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:45.620723 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d504b-0447-4d50-afa4-1677acf749a4 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.621240 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d504b-0447-4d50-afa4-1677acf749a4 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.621728 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d504b-0447-4d50-afa4-1677acf749a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.626671 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 751/1511] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:56:45.627945 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9058c5-a14c-4c77-8c77-150508d19898 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:45.639414 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9058c5-a14c-4c77-8c77-150508d19898 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:45.646313 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-551d504b-0447-4d50-afa4-1677acf749a4 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:45.647658 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-551d504b-0447-4d50-afa4-1677acf749a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:45.711593 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfeccda-ccbb-4e74-a714-1ac46593af46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:45.712293 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfeccda-ccbb-4e74-a714-1ac46593af46 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.712736 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfeccda-ccbb-4e74-a714-1ac46593af46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.713139 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfeccda-ccbb-4e74-a714-1ac46593af46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.714101 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfeccda-ccbb-4e74-a714-1ac46593af46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:45.716178 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfeccda-ccbb-4e74-a714-1ac46593af46 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:45.725997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 761/1512] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:45 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:45.727298 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d504b-0447-4d50-afa4-1677acf749a4 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:45.731933 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 752/1513] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:45.733384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfeccda-ccbb-4e74-a714-1ac46593af46 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:45.744510 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d504b-0447-4d50-afa4-1677acf749a4 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:45.748562 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfeccda-ccbb-4e74-a714-1ac46593af46 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:45.753238 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb56c3-deb8-4308-9e05-3d94028177f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:45.754304 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb56c3-deb8-4308-9e05-3d94028177f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.754672 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb56c3-deb8-4308-9e05-3d94028177f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.755051 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb56c3-deb8-4308-9e05-3d94028177f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.756035 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb56c3-deb8-4308-9e05-3d94028177f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:45.758339 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb56c3-deb8-4308-9e05-3d94028177f5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:45.759876 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1308ce-34ec-4a79-8f1e-71615fa96bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:45.760850 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1308ce-34ec-4a79-8f1e-71615fa96bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.761290 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1308ce-34ec-4a79-8f1e-71615fa96bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.761742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1308ce-34ec-4a79-8f1e-71615fa96bb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.762835 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1308ce-34ec-4a79-8f1e-71615fa96bb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:45.766425 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1308ce-34ec-4a79-8f1e-71615fa96bb1 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:45.777804 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 762/1514] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:45.778971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb56c3-deb8-4308-9e05-3d94028177f5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:45.795120 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb56c3-deb8-4308-9e05-3d94028177f5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:45.802491 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401f5a8-838f-4923-acc3-001338c331cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:45.803485 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401f5a8-838f-4923-acc3-001338c331cb admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.803934 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401f5a8-838f-4923-acc3-001338c331cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.804470 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401f5a8-838f-4923-acc3-001338c331cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.805879 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401f5a8-838f-4923-acc3-001338c331cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:45.813824 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 753/1515] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:56:45 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:45.814133 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401f5a8-838f-4923-acc3-001338c331cb admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:45.814313 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1308ce-34ec-4a79-8f1e-71615fa96bb1 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:45.852349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 763/1516] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:56:45 2022] POST /identity/v3/projects => generated 389 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:45.860619 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401f5a8-838f-4923-acc3-001338c331cb admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:45.893888 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1308ce-34ec-4a79-8f1e-71615fa96bb1 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:45.947557 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401f5a8-838f-4923-acc3-001338c331cb admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:45.954418 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905ea27-4aad-42b3-ae42-738e2281050e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:45.955140 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905ea27-4aad-42b3-ae42-738e2281050e admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.955423 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905ea27-4aad-42b3-ae42-738e2281050e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.955693 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905ea27-4aad-42b3-ae42-738e2281050e admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.956403 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905ea27-4aad-42b3-ae42-738e2281050e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:45.958513 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905ea27-4aad-42b3-ae42-738e2281050e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:45.977559 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9422d8b-ae5d-4d6e-beda-7ee07be3c5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:45.978497 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9422d8b-ae5d-4d6e-beda-7ee07be3c5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:45.979008 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9422d8b-ae5d-4d6e-beda-7ee07be3c5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:45.979773 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9422d8b-ae5d-4d6e-beda-7ee07be3c5f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:45.980898 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 764/1517] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:56:45 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:45.981828 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905ea27-4aad-42b3-ae42-738e2281050e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:45.985013 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9422d8b-ae5d-4d6e-beda-7ee07be3c5f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:45.987772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9422d8b-ae5d-4d6e-beda-7ee07be3c5f5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:45.994062 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905ea27-4aad-42b3-ae42-738e2281050e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.001358 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fa06c-9648-4fe3-8776-071ab5d3f299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.002569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fa06c-9648-4fe3-8776-071ab5d3f299 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.002991 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fa06c-9648-4fe3-8776-071ab5d3f299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.003417 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fa06c-9648-4fe3-8776-071ab5d3f299 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.004280 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fa06c-9648-4fe3-8776-071ab5d3f299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.006897 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fa06c-9648-4fe3-8776-071ab5d3f299 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.017515 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 754/1518] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:56:45 2022] POST /identity/v3/users => generated 302 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:46.018797 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9422d8b-ae5d-4d6e-beda-7ee07be3c5f5 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.033652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9422d8b-ae5d-4d6e-beda-7ee07be3c5f5 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.038974 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cb6b0-ec36-4062-afce-c7d45a732f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.039671 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cb6b0-ec36-4062-afce-c7d45a732f63 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.039944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cb6b0-ec36-4062-afce-c7d45a732f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.040216 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cb6b0-ec36-4062-afce-c7d45a732f63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.041026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cb6b0-ec36-4062-afce-c7d45a732f63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:56:46.041338 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cb6b0-ec36-4062-afce-c7d45a732f63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.043004 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cb6b0-ec36-4062-afce-c7d45a732f63 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.053415 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 765/1519] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:56:45 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:46.054287 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fa06c-9648-4fe3-8776-071ab5d3f299 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.072836 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 755/1520] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:56:46.072836 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cb6b0-ec36-4062-afce-c7d45a732f63 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.080329 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cb6b0-ec36-4062-afce-c7d45a732f63 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.145739 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fa06c-9648-4fe3-8776-071ab5d3f299 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.153195 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c080b88-4db4-4b9d-ada1-a86d82832883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.154028 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c080b88-4db4-4b9d-ada1-a86d82832883 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.154309 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c080b88-4db4-4b9d-ada1-a86d82832883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.154571 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a60b4b-37fc-4405-b35e-0cb6c06a051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.154826 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c080b88-4db4-4b9d-ada1-a86d82832883 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.155324 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c080b88-4db4-4b9d-ada1-a86d82832883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.156178 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a60b4b-37fc-4405-b35e-0cb6c06a051b admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.156659 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a60b4b-37fc-4405-b35e-0cb6c06a051b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.157197 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a60b4b-37fc-4405-b35e-0cb6c06a051b admin admin] PATH_INFO: `/v3/projects/f2f478fd06754a38b139c8415da6a514/users/1f57e62502564821b4be822554d9f5a7/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.157366 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c080b88-4db4-4b9d-ada1-a86d82832883 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.175994 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 756/1521] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:46.175994 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c080b88-4db4-4b9d-ada1-a86d82832883 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.183270 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a60b4b-37fc-4405-b35e-0cb6c06a051b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f478fd06754a38b139c8415da6a514, user_id=1f57e62502564821b4be822554d9f5a7, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.186607 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a60b4b-37fc-4405-b35e-0cb6c06a051b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.190089 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c080b88-4db4-4b9d-ada1-a86d82832883 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.197815 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367e58d-2e2d-4565-a2be-6e5efeedf64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.198927 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367e58d-2e2d-4565-a2be-6e5efeedf64b admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.199393 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367e58d-2e2d-4565-a2be-6e5efeedf64b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.199842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367e58d-2e2d-4565-a2be-6e5efeedf64b admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.201032 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367e58d-2e2d-4565-a2be-6e5efeedf64b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.204757 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367e58d-2e2d-4565-a2be-6e5efeedf64b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.207115 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 766/1522] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:56:46 2022] PUT /identity/v3/projects/f2f478fd06754a38b139c8415da6a514/users/1f57e62502564821b4be822554d9f5a7/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:56:46.208033 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a60b4b-37fc-4405-b35e-0cb6c06a051b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.235325 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 757/1523] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:56:46 2022] POST /identity/v3/users => generated 286 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:46.236207 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367e58d-2e2d-4565-a2be-6e5efeedf64b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.253951 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367e58d-2e2d-4565-a2be-6e5efeedf64b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.289992 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a60b4b-37fc-4405-b35e-0cb6c06a051b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.295974 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc9557-e646-4f1c-b857-976d3c1daabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.297041 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc9557-e646-4f1c-b857-976d3c1daabe admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.297569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc9557-e646-4f1c-b857-976d3c1daabe admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.297950 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc9557-e646-4f1c-b857-976d3c1daabe admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.299108 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc9557-e646-4f1c-b857-976d3c1daabe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.302848 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc9557-e646-4f1c-b857-976d3c1daabe admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.335678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 767/1524] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:56:46 2022] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:46.335911 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3bc0d-d8d9-4094-b3f1-19976ffb712c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.336767 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3bc0d-d8d9-4094-b3f1-19976ffb712c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.337170 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc9557-e646-4f1c-b857-976d3c1daabe admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.337429 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3bc0d-d8d9-4094-b3f1-19976ffb712c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.337882 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3bc0d-d8d9-4094-b3f1-19976ffb712c admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.338776 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3bc0d-d8d9-4094-b3f1-19976ffb712c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.341242 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3bc0d-d8d9-4094-b3f1-19976ffb712c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.355793 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc9557-e646-4f1c-b857-976d3c1daabe admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.361309 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 758/1525] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:46.362319 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3bc0d-d8d9-4094-b3f1-19976ffb712c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.366779 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc473c6e-39ff-41d4-a4c5-df4065f3b941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.367491 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc473c6e-39ff-41d4-a4c5-df4065f3b941 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.367765 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc473c6e-39ff-41d4-a4c5-df4065f3b941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.368034 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc473c6e-39ff-41d4-a4c5-df4065f3b941 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.369001 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc473c6e-39ff-41d4-a4c5-df4065f3b941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.370716 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc473c6e-39ff-41d4-a4c5-df4065f3b941 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.377300 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3bc0d-d8d9-4094-b3f1-19976ffb712c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.388889 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 768/1526] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:46.388889 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc473c6e-39ff-41d4-a4c5-df4065f3b941 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.392371 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82bc9d-2265-4384-9dbf-92cd76b4f57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.393172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82bc9d-2265-4384-9dbf-92cd76b4f57a admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.393453 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82bc9d-2265-4384-9dbf-92cd76b4f57a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.393867 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82bc9d-2265-4384-9dbf-92cd76b4f57a admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.394567 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82bc9d-2265-4384-9dbf-92cd76b4f57a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.396840 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82bc9d-2265-4384-9dbf-92cd76b4f57a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.412859 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc473c6e-39ff-41d4-a4c5-df4065f3b941 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.418155 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13c8d8-9774-4114-960e-96bcc675bf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.418827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13c8d8-9774-4114-960e-96bcc675bf09 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.419155 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13c8d8-9774-4114-960e-96bcc675bf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.419401 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13c8d8-9774-4114-960e-96bcc675bf09 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.420092 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13c8d8-9774-4114-960e-96bcc675bf09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.423514 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13c8d8-9774-4114-960e-96bcc675bf09 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.425727 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 759/1527] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:56:46 2022] POST /identity/v3/users => generated 289 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:46.426903 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82bc9d-2265-4384-9dbf-92cd76b4f57a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.440384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82bc9d-2265-4384-9dbf-92cd76b4f57a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.447302 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfee4a-770a-4be2-915a-9e48b1cd82e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.448668 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfee4a-770a-4be2-915a-9e48b1cd82e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.449153 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfee4a-770a-4be2-915a-9e48b1cd82e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.449611 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfee4a-770a-4be2-915a-9e48b1cd82e5 admin admin] PATH_INFO: `/v3/projects/8c0aef26837b47059522707fb2ce8422/users/d62a8866a5dd404cbc333c640d85e6f2/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.457618 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 769/1528] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:56:46 2022] POST /identity/v3/projects => generated 393 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:46.460213 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83f5d9-cbeb-42a6-a72c-31e046d1f3bd None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.460773 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83f5d9-cbeb-42a6-a72c-31e046d1f3bd None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.462135 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83f5d9-cbeb-42a6-a72c-31e046d1f3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.476044 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfee4a-770a-4be2-915a-9e48b1cd82e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0aef26837b47059522707fb2ce8422, user_id=d62a8866a5dd404cbc333c640d85e6f2, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.479855 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfee4a-770a-4be2-915a-9e48b1cd82e5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.483382 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-2c83f5d9-cbeb-42a6-a72c-31e046d1f3bd None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:46.485437 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-2c83f5d9-cbeb-42a6-a72c-31e046d1f3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:46.498874 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 760/1529] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:56:46 2022] PUT /identity/v3/projects/8c0aef26837b47059522707fb2ce8422/users/d62a8866a5dd404cbc333c640d85e6f2/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:56:46.500017 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfee4a-770a-4be2-915a-9e48b1cd82e5 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.567882 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 770/1530] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:46 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:46.570025 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83f5d9-cbeb-42a6-a72c-31e046d1f3bd None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.575187 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfee4a-770a-4be2-915a-9e48b1cd82e5 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.580604 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311f460-8ada-4c44-96e2-56797343002f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.581423 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311f460-8ada-4c44-96e2-56797343002f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.582069 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311f460-8ada-4c44-96e2-56797343002f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.582353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311f460-8ada-4c44-96e2-56797343002f admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.583078 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311f460-8ada-4c44-96e2-56797343002f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.584749 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311f460-8ada-4c44-96e2-56797343002f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.585013 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83f5d9-cbeb-42a6-a72c-31e046d1f3bd None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.592592 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65dfb2e-05ad-4eeb-b9e9-f62e5ac0d24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.593349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dfb2e-05ad-4eeb-b9e9-f62e5ac0d24c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.594361 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dfb2e-05ad-4eeb-b9e9-f62e5ac0d24c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.594738 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dfb2e-05ad-4eeb-b9e9-f62e5ac0d24c admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.595491 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65dfb2e-05ad-4eeb-b9e9-f62e5ac0d24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.597223 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65dfb2e-05ad-4eeb-b9e9-f62e5ac0d24c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.598049 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 761/1531] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:46.603376 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311f460-8ada-4c44-96e2-56797343002f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.610070 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311f460-8ada-4c44-96e2-56797343002f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.611025 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 771/1532] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:46.614885 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5186a-27cd-4dbd-bda6-45f1a24b0141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.615638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5186a-27cd-4dbd-bda6-45f1a24b0141 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.615870 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5186a-27cd-4dbd-bda6-45f1a24b0141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.616139 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5186a-27cd-4dbd-bda6-45f1a24b0141 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.616896 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5186a-27cd-4dbd-bda6-45f1a24b0141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.617080 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65dfb2e-05ad-4eeb-b9e9-f62e5ac0d24c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.618488 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5186a-27cd-4dbd-bda6-45f1a24b0141 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.629463 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 762/1533] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:46.630332 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5186a-27cd-4dbd-bda6-45f1a24b0141 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.632367 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65dfb2e-05ad-4eeb-b9e9-f62e5ac0d24c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.638160 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f555444-9443-4bb2-aaf1-d42123c2c0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.638835 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f555444-9443-4bb2-aaf1-d42123c2c0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.639111 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f555444-9443-4bb2-aaf1-d42123c2c0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.639434 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f555444-9443-4bb2-aaf1-d42123c2c0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.640874 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f555444-9443-4bb2-aaf1-d42123c2c0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.642072 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5186a-27cd-4dbd-bda6-45f1a24b0141 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.642568 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f555444-9443-4bb2-aaf1-d42123c2c0c5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.649058 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca33503-1b15-4d97-9cd7-9d1b60e33fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.649742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca33503-1b15-4d97-9cd7-9d1b60e33fca admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.650079 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca33503-1b15-4d97-9cd7-9d1b60e33fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.650688 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca33503-1b15-4d97-9cd7-9d1b60e33fca admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.651455 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca33503-1b15-4d97-9cd7-9d1b60e33fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.653881 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 772/1534] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:46.654349 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca33503-1b15-4d97-9cd7-9d1b60e33fca admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.654862 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f555444-9443-4bb2-aaf1-d42123c2c0c5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.665908 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f555444-9443-4bb2-aaf1-d42123c2c0c5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.671077 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30c8ba-6f4f-4a4f-9f52-7aaf106d896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.671289 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 763/1535] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:46.671957 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30c8ba-6f4f-4a4f-9f52-7aaf106d896a admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.672314 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30c8ba-6f4f-4a4f-9f52-7aaf106d896a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.672587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30c8ba-6f4f-4a4f-9f52-7aaf106d896a admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.673266 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cbe5b-24bb-4fd3-aa71-590f86fa0b37 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.673426 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30c8ba-6f4f-4a4f-9f52-7aaf106d896a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.673735 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cbe5b-24bb-4fd3-aa71-590f86fa0b37 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.674141 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cbe5b-24bb-4fd3-aa71-590f86fa0b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.675964 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30c8ba-6f4f-4a4f-9f52-7aaf106d896a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.697766 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 773/1536] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:56:46 2022] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:46.698261 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-2d1cbe5b-24bb-4fd3-aa71-590f86fa0b37 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:46.698608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30c8ba-6f4f-4a4f-9f52-7aaf106d896a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.699711 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2d1cbe5b-24bb-4fd3-aa71-590f86fa0b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:46.700617 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-2c30c8ba-6f4f-4a4f-9f52-7aaf106d896a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:46.711026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 764/1537] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:46 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:46.711875 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cbe5b-24bb-4fd3-aa71-590f86fa0b37 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.726741 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cbe5b-24bb-4fd3-aa71-590f86fa0b37 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.731532 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e880204-d244-4d3b-a3fd-a390f7905b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.732207 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e880204-d244-4d3b-a3fd-a390f7905b46 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.732488 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e880204-d244-4d3b-a3fd-a390f7905b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.732817 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e880204-d244-4d3b-a3fd-a390f7905b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.733538 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e880204-d244-4d3b-a3fd-a390f7905b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.735331 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e880204-d244-4d3b-a3fd-a390f7905b46 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.746267 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 765/1538] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:46.749798 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e880204-d244-4d3b-a3fd-a390f7905b46 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.760160 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e880204-d244-4d3b-a3fd-a390f7905b46 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.765929 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20570e5a-22ac-41b8-a9d4-6f1109d83f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.766611 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20570e5a-22ac-41b8-a9d4-6f1109d83f7a admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.766889 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20570e5a-22ac-41b8-a9d4-6f1109d83f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.767156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20570e5a-22ac-41b8-a9d4-6f1109d83f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.767877 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20570e5a-22ac-41b8-a9d4-6f1109d83f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.769518 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20570e5a-22ac-41b8-a9d4-6f1109d83f7a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.773861 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30c8ba-6f4f-4a4f-9f52-7aaf106d896a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.779921 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a122305-11ff-4849-9823-143d0f06d253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.780661 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a122305-11ff-4849-9823-143d0f06d253 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.781065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a122305-11ff-4849-9823-143d0f06d253 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.782004 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a122305-11ff-4849-9823-143d0f06d253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.783234 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 766/1539] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:46.784249 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20570e5a-22ac-41b8-a9d4-6f1109d83f7a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.794152 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a122305-11ff-4849-9823-143d0f06d253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.794737 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20570e5a-22ac-41b8-a9d4-6f1109d83f7a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.795619 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a122305-11ff-4849-9823-143d0f06d253 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.799630 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81207c6b-a477-4c47-817e-48bd85d6e064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.800529 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81207c6b-a477-4c47-817e-48bd85d6e064 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.800828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81207c6b-a477-4c47-817e-48bd85d6e064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.801112 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81207c6b-a477-4c47-817e-48bd85d6e064 admin admin] PATH_INFO: `/v3/projects/bc2f6f78fa7d4ad89b4965d6823e3437/users/0f4d9ffbb8bb4c67b7d6c3f74ad3c137/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.806466 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 774/1540] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:46 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:46.807385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a122305-11ff-4849-9823-143d0f06d253 service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.818805 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a122305-11ff-4849-9823-143d0f06d253 service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.820679 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81207c6b-a477-4c47-817e-48bd85d6e064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc2f6f78fa7d4ad89b4965d6823e3437, user_id=0f4d9ffbb8bb4c67b7d6c3f74ad3c137, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.824033 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81207c6b-a477-4c47-817e-48bd85d6e064 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.824247 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcc3f5-6f38-48db-bcf8-c4e6e352cef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.825044 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcc3f5-6f38-48db-bcf8-c4e6e352cef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.825327 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcc3f5-6f38-48db-bcf8-c4e6e352cef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.825606 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcc3f5-6f38-48db-bcf8-c4e6e352cef2 admin admin] PATH_INFO: `/v3/projects/82ce407dec3d480797a15fca87c7cb79/users/f02c5e1e856e42038981eea51211debd/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.849905 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 767/1541] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:56:46 2022] PUT /identity/v3/projects/bc2f6f78fa7d4ad89b4965d6823e3437/users/0f4d9ffbb8bb4c67b7d6c3f74ad3c137/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:56:46.851455 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81207c6b-a477-4c47-817e-48bd85d6e064 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.854986 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcc3f5-6f38-48db-bcf8-c4e6e352cef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82ce407dec3d480797a15fca87c7cb79, user_id=f02c5e1e856e42038981eea51211debd, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.862218 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcc3f5-6f38-48db-bcf8-c4e6e352cef2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:46.886571 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 775/1542] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:56:46 2022] PUT /identity/v3/projects/82ce407dec3d480797a15fca87c7cb79/users/f02c5e1e856e42038981eea51211debd/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:56:46.887577 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcc3f5-6f38-48db-bcf8-c4e6e352cef2 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:46.961984 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81207c6b-a477-4c47-817e-48bd85d6e064 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.984906 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcc3f5-6f38-48db-bcf8-c4e6e352cef2 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:46.990272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad407679-56c5-45c9-94f3-ba0a706f541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:46.990966 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad407679-56c5-45c9-94f3-ba0a706f541a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:46.991247 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad407679-56c5-45c9-94f3-ba0a706f541a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:46.991557 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad407679-56c5-45c9-94f3-ba0a706f541a admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:46.992301 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad407679-56c5-45c9-94f3-ba0a706f541a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:46.994056 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad407679-56c5-45c9-94f3-ba0a706f541a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:47.009414 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 776/1543] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:47.009414 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad407679-56c5-45c9-94f3-ba0a706f541a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:47.055059 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db00b4-b913-417d-84ab-9bb62dee9750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:47.055755 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db00b4-b913-417d-84ab-9bb62dee9750 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:47.056073 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db00b4-b913-417d-84ab-9bb62dee9750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:47.056488 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db00b4-b913-417d-84ab-9bb62dee9750 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:47.057272 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db00b4-b913-417d-84ab-9bb62dee9750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:47.059077 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db00b4-b913-417d-84ab-9bb62dee9750 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:47.075065 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 768/1544] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:47.075065 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db00b4-b913-417d-84ab-9bb62dee9750 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:47.086183 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db00b4-b913-417d-84ab-9bb62dee9750 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:47.090865 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad407679-56c5-45c9-94f3-ba0a706f541a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:47.091849 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cc4f6-33d0-4290-80f0-f5a3531750c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:47.092896 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cc4f6-33d0-4290-80f0-f5a3531750c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:47.093450 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cc4f6-33d0-4290-80f0-f5a3531750c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:47.094008 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cc4f6-33d0-4290-80f0-f5a3531750c7 admin admin] PATH_INFO: `/v3/projects/e853f04a46b14da0837e79a2bfe4c971/users/e8a1b585e92e4eb28505883fa4936392/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:47.100637 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452bc4a-34e7-440d-9d57-e666144c6d59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:47.101913 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452bc4a-34e7-440d-9d57-e666144c6d59 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:47.102216 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452bc4a-34e7-440d-9d57-e666144c6d59 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:47.102773 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452bc4a-34e7-440d-9d57-e666144c6d59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:47.113143 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704cc4f6-33d0-4290-80f0-f5a3531750c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e853f04a46b14da0837e79a2bfe4c971, user_id=e8a1b585e92e4eb28505883fa4936392, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:47.116996 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704cc4f6-33d0-4290-80f0-f5a3531750c7 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:47.117733 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452bc4a-34e7-440d-9d57-e666144c6d59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:47.119296 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452bc4a-34e7-440d-9d57-e666144c6d59 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:47.136306 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 777/1546] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:47 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:47.139507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452bc4a-34e7-440d-9d57-e666144c6d59 service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:47.183558 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 769/1546] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:56:47 2022] PUT /identity/v3/projects/e853f04a46b14da0837e79a2bfe4c971/users/e8a1b585e92e4eb28505883fa4936392/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:56:47.183558 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc655a89-46a6-46d6-b3f2-c3e0e94ef514 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:47.183558 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc655a89-46a6-46d6-b3f2-c3e0e94ef514 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:47.183558 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc655a89-46a6-46d6-b3f2-c3e0e94ef514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:47.197969 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452bc4a-34e7-440d-9d57-e666144c6d59 service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:47.242753 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-bc655a89-46a6-46d6-b3f2-c3e0e94ef514 None None] MFA Rules not processed for user `0f4d9ffbb8bb4c67b7d6c3f74ad3c137`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:47.244996 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-bc655a89-46a6-46d6-b3f2-c3e0e94ef514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:47.288257 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c963b3-bb9b-4877-971e-14fca7ead047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:47.289085 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c963b3-bb9b-4877-971e-14fca7ead047 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:47.289362 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c963b3-bb9b-4877-971e-14fca7ead047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:47.289633 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c963b3-bb9b-4877-971e-14fca7ead047 admin admin] PATH_INFO: `/v3/projects/c744efbffa214f18ab24d619620343c6/users/c34c05b7e55447f2a5ddf9c9b9299f44/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:47.306641 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c963b3-bb9b-4877-971e-14fca7ead047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c744efbffa214f18ab24d619620343c6, user_id=c34c05b7e55447f2a5ddf9c9b9299f44, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:47.309672 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c963b3-bb9b-4877-971e-14fca7ead047 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:47.334083 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 778/1547] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:56:47 2022] PUT /identity/v3/projects/c744efbffa214f18ab24d619620343c6/users/c34c05b7e55447f2a5ddf9c9b9299f44/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:56:47.338184 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7a447-81ad-4871-a0d5-941833f9eb45 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:47.339038 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7a447-81ad-4871-a0d5-941833f9eb45 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:47.339796 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7a447-81ad-4871-a0d5-941833f9eb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:47.362375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 770/1548] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:47 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:47.363328 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc655a89-46a6-46d6-b3f2-c3e0e94ef514 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:47.382308 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc655a89-46a6-46d6-b3f2-c3e0e94ef514 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:47.391528 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-a6f7a447-81ad-4871-a0d5-941833f9eb45 None None] MFA Rules not processed for user `f02c5e1e856e42038981eea51211debd`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:47.393309 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a6f7a447-81ad-4871-a0d5-941833f9eb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:47.466370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5b807-bb79-421f-8161-a02f20a3ec82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:47.467707 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5b807-bb79-421f-8161-a02f20a3ec82 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:47.468458 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5b807-bb79-421f-8161-a02f20a3ec82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:47.469203 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5b807-bb79-421f-8161-a02f20a3ec82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:47.470226 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5b807-bb79-421f-8161-a02f20a3ec82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:47.472608 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5b807-bb79-421f-8161-a02f20a3ec82 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:47.486247 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 779/1549] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:47 2022] POST /identity/v3/auth/tokens => generated 3423 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:47.491997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7a447-81ad-4871-a0d5-941833f9eb45 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:47.492189 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 771/1550] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:47.493038 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc450d79-5a0f-48ee-a823-2087d3d03598 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:47.493426 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc450d79-5a0f-48ee-a823-2087d3d03598 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:47.493916 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc450d79-5a0f-48ee-a823-2087d3d03598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:47.523058 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7a447-81ad-4871-a0d5-941833f9eb45 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:47.530252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-dc450d79-5a0f-48ee-a823-2087d3d03598 None None] MFA Rules not processed for user `e8a1b585e92e4eb28505883fa4936392`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:47.531762 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-dc450d79-5a0f-48ee-a823-2087d3d03598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:47.538998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2d612-794f-4854-b59c-604423335651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:47.540389 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2d612-794f-4854-b59c-604423335651 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:47.540914 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2d612-794f-4854-b59c-604423335651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:47.541774 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2d612-794f-4854-b59c-604423335651 admin admin] PATH_INFO: `/v3/projects/a894e08c57954c6bad11b7c9e4cd33f7/users/9e6ab8c8aff74d059615850548d95770/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:47.580273 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2d612-794f-4854-b59c-604423335651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a894e08c57954c6bad11b7c9e4cd33f7, user_id=9e6ab8c8aff74d059615850548d95770, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:47.584959 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2d612-794f-4854-b59c-604423335651 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:47.616243 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 780/1551] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:56:47 2022] PUT /identity/v3/projects/a894e08c57954c6bad11b7c9e4cd33f7/users/9e6ab8c8aff74d059615850548d95770/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:56:47.618642 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3167ae-d159-41a6-b11e-ca24eb0b2343 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:47.619126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3167ae-d159-41a6-b11e-ca24eb0b2343 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:47.619585 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3167ae-d159-41a6-b11e-ca24eb0b2343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:47.635939 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 772/1552] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:47 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:47.637593 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee6f1d-81ce-4ee0-8674-369eae04d0d4 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:47.637901 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee6f1d-81ce-4ee0-8674-369eae04d0d4 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:47.638251 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee6f1d-81ce-4ee0-8674-369eae04d0d4 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:47.641082 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 773/1553] 10.222.0.96 () {54 vars in 960 bytes} [Fri Jan 28 01:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:56:47.642542 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee6f1d-81ce-4ee0-8674-369eae04d0d4 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:47.680904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-5c3167ae-d159-41a6-b11e-ca24eb0b2343 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:47.683096 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-5c3167ae-d159-41a6-b11e-ca24eb0b2343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:47.773481 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 781/1554] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:47 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:47.778886 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3167ae-d159-41a6-b11e-ca24eb0b2343 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:47.787425 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3167ae-d159-41a6-b11e-ca24eb0b2343 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:47.787855 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee6f1d-81ce-4ee0-8674-369eae04d0d4 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:47.793917 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b6c14-c3f4-4e21-80bb-0d6b7f0e11a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:47.794588 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b6c14-c3f4-4e21-80bb-0d6b7f0e11a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:47.795361 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b6c14-c3f4-4e21-80bb-0d6b7f0e11a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:47.795798 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b6c14-c3f4-4e21-80bb-0d6b7f0e11a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:47.796658 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b6c14-c3f4-4e21-80bb-0d6b7f0e11a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:47.799732 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b6c14-c3f4-4e21-80bb-0d6b7f0e11a2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:47.800054 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa7aac-273d-4a2c-a014-cba65e5e9a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:47.803290 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa7aac-273d-4a2c-a014-cba65e5e9a1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:47.804426 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa7aac-273d-4a2c-a014-cba65e5e9a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:47.804980 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa7aac-273d-4a2c-a014-cba65e5e9a1e admin admin] PATH_INFO: `/v3/projects/d068e263c4ba4c6fa1bc08b5e2c90d4d/users/7b8f259580b84c1da7ccd7dd9391e406/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:47.840731 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 782/1555] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:56:47 2022] POST /identity/v3/projects => generated 405 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:47.842866 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6cd5c-a861-491d-b27c-49f5b5fd978b None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:47.843939 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6cd5c-a861-491d-b27c-49f5b5fd978b None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:47.844384 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6cd5c-a861-491d-b27c-49f5b5fd978b None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:47.846923 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa7aac-273d-4a2c-a014-cba65e5e9a1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d068e263c4ba4c6fa1bc08b5e2c90d4d, user_id=7b8f259580b84c1da7ccd7dd9391e406, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:47.852601 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa7aac-273d-4a2c-a014-cba65e5e9a1e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:47.853894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 783/1556] 10.222.0.96 () {54 vars in 960 bytes} [Fri Jan 28 01:56:47 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:56:47.855515 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28fc9a-bc13-4dfc-a9a3-257b2776a921 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:47.855928 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28fc9a-bc13-4dfc-a9a3-257b2776a921 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:47.856358 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28fc9a-bc13-4dfc-a9a3-257b2776a921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:47.892453 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-ae28fc9a-bc13-4dfc-a9a3-257b2776a921 None None] MFA Rules not processed for user `cc85f5db9c3c47fca68ebab33b0bb73c`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:47.894681 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-ae28fc9a-bc13-4dfc-a9a3-257b2776a921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:47.898098 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 774/1557] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:56:47 2022] PUT /identity/v3/projects/d068e263c4ba4c6fa1bc08b5e2c90d4d/users/7b8f259580b84c1da7ccd7dd9391e406/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:56:47.907260 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccd5f4-f337-4bcc-ae4c-4e2aec298b51 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:47.907702 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccd5f4-f337-4bcc-ae4c-4e2aec298b51 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:47.907980 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccd5f4-f337-4bcc-ae4c-4e2aec298b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:47.960011 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-b1ccd5f4-f337-4bcc-ae4c-4e2aec298b51 None None] MFA Rules not processed for user `9e6ab8c8aff74d059615850548d95770`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:47.961762 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b1ccd5f4-f337-4bcc-ae4c-4e2aec298b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:48.013396 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 784/1558] 10.222.0.96 () {58 vars in 1057 bytes} [Fri Jan 28 01:56:47 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:48.014786 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28fc9a-bc13-4dfc-a9a3-257b2776a921 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:48.090417 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28fc9a-bc13-4dfc-a9a3-257b2776a921 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:48.097894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c38ec-77e4-4116-9d08-dc6710925c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:48.098688 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c38ec-77e4-4116-9d08-dc6710925c7f service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:48.098970 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c38ec-77e4-4116-9d08-dc6710925c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:48.099242 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c38ec-77e4-4116-9d08-dc6710925c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:48.102763 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 775/1559] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:47 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:48.104152 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccd5f4-f337-4bcc-ae4c-4e2aec298b51 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:48.222487 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c38ec-77e4-4116-9d08-dc6710925c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:48.224822 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c38ec-77e4-4116-9d08-dc6710925c7f service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:48.233570 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccd5f4-f337-4bcc-ae4c-4e2aec298b51 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:48.246208 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70726c-150e-4506-b738-b9277cd20332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:48.247026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70726c-150e-4506-b738-b9277cd20332 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:48.247311 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70726c-150e-4506-b738-b9277cd20332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:48.247739 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70726c-150e-4506-b738-b9277cd20332 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:48.248488 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70726c-150e-4506-b738-b9277cd20332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:48.251476 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70726c-150e-4506-b738-b9277cd20332 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:48.282687 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 785/1560] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:48 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:48.290324 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78705a-e7d3-48d3-8d18-93aee1d9bddb None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:48.290592 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78705a-e7d3-48d3-8d18-93aee1d9bddb None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:48.290865 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78705a-e7d3-48d3-8d18-93aee1d9bddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:48.306287 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 776/1561] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:56:48 2022] POST /identity/v3/users => generated 309 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:48.309460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927d4f5-a770-4613-8c5d-81de7ed0dae4 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:48.310250 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927d4f5-a770-4613-8c5d-81de7ed0dae4 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:48.310739 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927d4f5-a770-4613-8c5d-81de7ed0dae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:48.342397 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-9927d4f5-a770-4613-8c5d-81de7ed0dae4 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:48.348858 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-4b78705a-e7d3-48d3-8d18-93aee1d9bddb None None] MFA Rules not processed for user `cc85f5db9c3c47fca68ebab33b0bb73c`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:48.352842 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-4b78705a-e7d3-48d3-8d18-93aee1d9bddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:48.354282 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-9927d4f5-a770-4613-8c5d-81de7ed0dae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:48.377462 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 786/1562] 10.222.0.96 () {58 vars in 1057 bytes} [Fri Jan 28 01:56:48 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:48.379457 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78705a-e7d3-48d3-8d18-93aee1d9bddb None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:48.396155 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 777/1563] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:48.397463 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927d4f5-a770-4613-8c5d-81de7ed0dae4 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:48.405274 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78705a-e7d3-48d3-8d18-93aee1d9bddb None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:48.415915 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927d4f5-a770-4613-8c5d-81de7ed0dae4 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:48.419596 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af130e8d-5e46-497a-b200-7316edc3b6f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:48.420690 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af130e8d-5e46-497a-b200-7316edc3b6f9 service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:48.421115 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0765edb-01ac-4a68-9a48-b43ce5f8629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:48.422187 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af130e8d-5e46-497a-b200-7316edc3b6f9 service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:48.422534 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0765edb-01ac-4a68-9a48-b43ce5f8629d admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:48.422746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af130e8d-5e46-497a-b200-7316edc3b6f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:48.422935 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0765edb-01ac-4a68-9a48-b43ce5f8629d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:48.423177 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0765edb-01ac-4a68-9a48-b43ce5f8629d admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:48.423891 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0765edb-01ac-4a68-9a48-b43ce5f8629d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:48.426005 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0765edb-01ac-4a68-9a48-b43ce5f8629d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:48.461020 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 778/1564] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:56:48 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:48.465666 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21421194-52ae-408d-af99-2c4a84c96a96 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:48.465959 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21421194-52ae-408d-af99-2c4a84c96a96 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:48.466236 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21421194-52ae-408d-af99-2c4a84c96a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:48.503036 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-21421194-52ae-408d-af99-2c4a84c96a96 None None] MFA Rules not processed for user `1f57e62502564821b4be822554d9f5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:48.505085 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-21421194-52ae-408d-af99-2c4a84c96a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:48.530765 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af130e8d-5e46-497a-b200-7316edc3b6f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:48.534685 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af130e8d-5e46-497a-b200-7316edc3b6f9 service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:48.548895 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 787/1565] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:48 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:48.561622 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af130e8d-5e46-497a-b200-7316edc3b6f9 service nova] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:48.594781 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af130e8d-5e46-497a-b200-7316edc3b6f9 service nova] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:48.600841 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 779/1566] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:48 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:48.601911 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21421194-52ae-408d-af99-2c4a84c96a96 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:48.715917 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21421194-52ae-408d-af99-2c4a84c96a96 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:48.721022 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86bd08-c979-4d56-98d5-74f5e124f948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:48.722526 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86bd08-c979-4d56-98d5-74f5e124f948 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:48.723332 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86bd08-c979-4d56-98d5-74f5e124f948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:48.723779 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7506a1-5701-47be-b350-292fa536d664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:48.723921 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86bd08-c979-4d56-98d5-74f5e124f948 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:48.724715 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7506a1-5701-47be-b350-292fa536d664 service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:48.725042 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86bd08-c979-4d56-98d5-74f5e124f948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:48.725159 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7506a1-5701-47be-b350-292fa536d664 service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:48.725408 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7506a1-5701-47be-b350-292fa536d664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:48.727112 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86bd08-c979-4d56-98d5-74f5e124f948 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:48.745019 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 788/1567] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:48.746828 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce64748-316a-4c5d-94dd-02d4d44cea40 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:48.747321 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce64748-316a-4c5d-94dd-02d4d44cea40 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:48.747911 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce64748-316a-4c5d-94dd-02d4d44cea40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:48.793148 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-1ce64748-316a-4c5d-94dd-02d4d44cea40 None None] MFA Rules not processed for user `d62a8866a5dd404cbc333c640d85e6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:48.798943 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-1ce64748-316a-4c5d-94dd-02d4d44cea40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:48.866248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7506a1-5701-47be-b350-292fa536d664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:48.871427 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7506a1-5701-47be-b350-292fa536d664 service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:48.902136 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 780/1568] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:48 2022] GET /identity/v3/auth/tokens => generated 3391 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:48.904407 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7506a1-5701-47be-b350-292fa536d664 service nova] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:48.997061 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 789/1569] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:48 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:48.997061 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce64748-316a-4c5d-94dd-02d4d44cea40 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:49.015710 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce64748-316a-4c5d-94dd-02d4d44cea40 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:49.034642 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef30af-4ba0-4b5c-be26-f5d94a589339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:49.035522 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef30af-4ba0-4b5c-be26-f5d94a589339 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:49.035821 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef30af-4ba0-4b5c-be26-f5d94a589339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:49.036964 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef30af-4ba0-4b5c-be26-f5d94a589339 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:49.037995 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef30af-4ba0-4b5c-be26-f5d94a589339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:49.045096 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef30af-4ba0-4b5c-be26-f5d94a589339 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:49.057809 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7506a1-5701-47be-b350-292fa536d664 service nova] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:49.064540 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeabce8-3b9c-4cc2-a6bc-655f9cb80dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:49.065456 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeabce8-3b9c-4cc2-a6bc-655f9cb80dec service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:49.065722 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeabce8-3b9c-4cc2-a6bc-655f9cb80dec service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:49.066001 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeabce8-3b9c-4cc2-a6bc-655f9cb80dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:49.086375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeabce8-3b9c-4cc2-a6bc-655f9cb80dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:49.087925 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeabce8-3b9c-4cc2-a6bc-655f9cb80dec service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:49.092518 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 790/1570] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:56:48 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:49.096384 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cb108-803c-436c-997d-8207e5b31453 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:49.097137 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cb108-803c-436c-997d-8207e5b31453 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:49.098086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cb108-803c-436c-997d-8207e5b31453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:49.103373 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 781/1571] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:48 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:49.104235 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeabce8-3b9c-4cc2-a6bc-655f9cb80dec service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:49.116228 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeabce8-3b9c-4cc2-a6bc-655f9cb80dec service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:49.121898 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbae6c-f425-4bf0-98fd-2704b1d2f86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:49.122720 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbae6c-f425-4bf0-98fd-2704b1d2f86f admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:49.122990 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbae6c-f425-4bf0-98fd-2704b1d2f86f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:49.123473 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbae6c-f425-4bf0-98fd-2704b1d2f86f admin admin] PATH_INFO: `/v3/projects/45f52646f6ca453c9898aa53a7c5d880/users/7b8c661ee30f43c3b1472385dce7ee48/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:49.134048 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-6d1cb108-803c-436c-997d-8207e5b31453 None None] MFA Rules not processed for user `1f57e62502564821b4be822554d9f5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:49.135665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-6d1cb108-803c-436c-997d-8207e5b31453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:49.143507 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbae6c-f425-4bf0-98fd-2704b1d2f86f admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f52646f6ca453c9898aa53a7c5d880, user_id=7b8c661ee30f43c3b1472385dce7ee48, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:49.146223 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 791/1572] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:49 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:49.146625 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbae6c-f425-4bf0-98fd-2704b1d2f86f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:49.147813 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4e354-2bb0-45f8-b9a5-e3024a42c04b None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:49.148228 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4e354-2bb0-45f8-b9a5-e3024a42c04b None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:49.148592 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4e354-2bb0-45f8-b9a5-e3024a42c04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:49.166460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 782/1573] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:56:49 2022] PUT /identity/v3/projects/45f52646f6ca453c9898aa53a7c5d880/users/7b8c661ee30f43c3b1472385dce7ee48/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:56:49.168184 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb4d6b-fa7b-4925-8b02-f0ad0b640818 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:49.168494 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb4d6b-fa7b-4925-8b02-f0ad0b640818 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:49.168816 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb4d6b-fa7b-4925-8b02-f0ad0b640818 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:49.174221 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-d8c4e354-2bb0-45f8-b9a5-e3024a42c04b None None] MFA Rules not processed for user `d62a8866a5dd404cbc333c640d85e6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:49.175601 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-d8c4e354-2bb0-45f8-b9a5-e3024a42c04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:49.177281 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 783/1574] 10.222.0.96 () {54 vars in 912 bytes} [Fri Jan 28 01:56:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:56:49.178363 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb4d6b-fa7b-4925-8b02-f0ad0b640818 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:49.249397 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 792/1575] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:49 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:49.254441 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4e354-2bb0-45f8-b9a5-e3024a42c04b None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:49.271044 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb4d6b-fa7b-4925-8b02-f0ad0b640818 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:49.273618 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4e354-2bb0-45f8-b9a5-e3024a42c04b None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:49.278707 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aded2b8-5711-4083-92a6-9a237005d22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:49.279880 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aded2b8-5711-4083-92a6-9a237005d22b admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:49.280026 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b284e-e23a-4d19-a775-7d04e0c12d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:49.280592 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aded2b8-5711-4083-92a6-9a237005d22b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:49.282496 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b284e-e23a-4d19-a775-7d04e0c12d96 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:49.282692 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b284e-e23a-4d19-a775-7d04e0c12d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:49.282979 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b284e-e23a-4d19-a775-7d04e0c12d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:49.283414 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aded2b8-5711-4083-92a6-9a237005d22b admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:49.284002 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b284e-e23a-4d19-a775-7d04e0c12d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:49.284690 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aded2b8-5711-4083-92a6-9a237005d22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:49.286028 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b284e-e23a-4d19-a775-7d04e0c12d96 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:49.287345 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aded2b8-5711-4083-92a6-9a237005d22b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:49.301051 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 793/1576] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:49.305540 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28cdf4-ad45-4955-acee-74c0dac413f9 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:49.305540 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28cdf4-ad45-4955-acee-74c0dac413f9 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:49.305540 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28cdf4-ad45-4955-acee-74c0dac413f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:49.306601 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 784/1577] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:49.308921 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aded2b8-5711-4083-92a6-9a237005d22b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:49.323463 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aded2b8-5711-4083-92a6-9a237005d22b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:49.331174 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595634d-f097-4f9a-b935-4e059deefb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:49.331684 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-dd28cdf4-ad45-4955-acee-74c0dac413f9 None None] MFA Rules not processed for user `cc85f5db9c3c47fca68ebab33b0bb73c`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:49.332780 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595634d-f097-4f9a-b935-4e059deefb0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:49.333223 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-dd28cdf4-ad45-4955-acee-74c0dac413f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:49.333528 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595634d-f097-4f9a-b935-4e059deefb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:49.334045 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595634d-f097-4f9a-b935-4e059deefb0e admin admin] PATH_INFO: `/v3/projects/45f52646f6ca453c9898aa53a7c5d880/users/7b8c661ee30f43c3b1472385dce7ee48/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:49.336902 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595634d-f097-4f9a-b935-4e059deefb0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f52646f6ca453c9898aa53a7c5d880, user_id=7b8c661ee30f43c3b1472385dce7ee48, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:49.341178 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595634d-f097-4f9a-b935-4e059deefb0e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:49.356530 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 785/1578] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:56:49 2022] PUT /identity/v3/projects/45f52646f6ca453c9898aa53a7c5d880/users/7b8c661ee30f43c3b1472385dce7ee48/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:56:49.357899 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595634d-f097-4f9a-b935-4e059deefb0e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:49.426330 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 794/1579] 10.222.0.96 () {58 vars in 1009 bytes} [Fri Jan 28 01:56:49 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:49.428116 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e86965-cf04-4bbc-b01e-dd989775e395 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:49.428413 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e86965-cf04-4bbc-b01e-dd989775e395 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:49.428718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e86965-cf04-4bbc-b01e-dd989775e395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:49.448863 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595634d-f097-4f9a-b935-4e059deefb0e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:49.457812 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d2cf8-a95a-44e6-a0a5-ef63d4c14a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:49.459433 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d2cf8-a95a-44e6-a0a5-ef63d4c14a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:49.460041 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d2cf8-a95a-44e6-a0a5-ef63d4c14a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:49.461316 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d2cf8-a95a-44e6-a0a5-ef63d4c14a30 admin admin] PATH_INFO: `/v3/projects/aaa19bacb8874596aa41cfda5442516e/users/be77a6cef367428e92080741f60520a2/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:49.467281 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-a4e86965-cf04-4bbc-b01e-dd989775e395 None None] MFA Rules not processed for user `7b8c661ee30f43c3b1472385dce7ee48`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:49.470611 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a4e86965-cf04-4bbc-b01e-dd989775e395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:49.488101 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d2cf8-a95a-44e6-a0a5-ef63d4c14a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa19bacb8874596aa41cfda5442516e, user_id=be77a6cef367428e92080741f60520a2, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:49.492697 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d2cf8-a95a-44e6-a0a5-ef63d4c14a30 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:49.513219 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 786/1580] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:56:49 2022] PUT /identity/v3/projects/aaa19bacb8874596aa41cfda5442516e/users/be77a6cef367428e92080741f60520a2/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:56:49.513747 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c6217-f17f-457f-98bc-450ebfc34bd6 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:49.514180 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c6217-f17f-457f-98bc-450ebfc34bd6 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:49.514596 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c6217-f17f-457f-98bc-450ebfc34bd6 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:49.523265 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 787/1581] 10.222.0.96 () {54 vars in 912 bytes} [Fri Jan 28 01:56:49 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:56:49.524294 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c6217-f17f-457f-98bc-450ebfc34bd6 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:49.600206 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 795/1582] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:49 2022] POST /identity/v3/auth/tokens => generated 3492 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:49.602010 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e86965-cf04-4bbc-b01e-dd989775e395 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:49.619592 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c6217-f17f-457f-98bc-450ebfc34bd6 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:49.623092 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e86965-cf04-4bbc-b01e-dd989775e395 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:49.625830 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab54c3-628a-4645-86da-19da5764c6b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:49.626655 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab54c3-628a-4645-86da-19da5764c6b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:49.626939 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab54c3-628a-4645-86da-19da5764c6b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:49.627234 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab54c3-628a-4645-86da-19da5764c6b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:49.718739 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab54c3-628a-4645-86da-19da5764c6b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:49.721017 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab54c3-628a-4645-86da-19da5764c6b8 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:49.735300 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 788/1583] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:49 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:49.736065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c02515-483c-4e7f-9f2d-eeaa370b6eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:49.736582 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f323619-aeb7-4660-9d70-d26339435b6c None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:49.736683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c02515-483c-4e7f-9f2d-eeaa370b6eac admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:49.737220 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f323619-aeb7-4660-9d70-d26339435b6c None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:49.737220 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f323619-aeb7-4660-9d70-d26339435b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:49.737552 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c02515-483c-4e7f-9f2d-eeaa370b6eac admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:49.737704 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c02515-483c-4e7f-9f2d-eeaa370b6eac admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:49.739303 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c02515-483c-4e7f-9f2d-eeaa370b6eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:49.742214 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c02515-483c-4e7f-9f2d-eeaa370b6eac admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:49.759778 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-4f323619-aeb7-4660-9d70-d26339435b6c None None] MFA Rules not processed for user `cc85f5db9c3c47fca68ebab33b0bb73c`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:49.759778 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-4f323619-aeb7-4660-9d70-d26339435b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:49.778956 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 796/1584] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:49.778956 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c02515-483c-4e7f-9f2d-eeaa370b6eac admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:49.779558 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 789/1585] 10.222.0.96 () {58 vars in 1009 bytes} [Fri Jan 28 01:56:49 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:49.779991 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f323619-aeb7-4660-9d70-d26339435b6c None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:49.801128 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c02515-483c-4e7f-9f2d-eeaa370b6eac admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:49.803626 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f323619-aeb7-4660-9d70-d26339435b6c None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:49.809436 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e95a5e-aaff-48e6-b1d7-81714fb88cad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:49.810620 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e95a5e-aaff-48e6-b1d7-81714fb88cad service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:49.810915 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e95a5e-aaff-48e6-b1d7-81714fb88cad service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:49.811191 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e95a5e-aaff-48e6-b1d7-81714fb88cad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:49.815473 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819237e1-2c04-4958-a717-8ffbdcddc570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:49.817277 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819237e1-2c04-4958-a717-8ffbdcddc570 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:49.818435 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819237e1-2c04-4958-a717-8ffbdcddc570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:49.818717 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819237e1-2c04-4958-a717-8ffbdcddc570 admin admin] PATH_INFO: `/v3/projects/aaa19bacb8874596aa41cfda5442516e/users/be77a6cef367428e92080741f60520a2/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:49.824089 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819237e1-2c04-4958-a717-8ffbdcddc570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa19bacb8874596aa41cfda5442516e, user_id=be77a6cef367428e92080741f60520a2, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:49.827287 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819237e1-2c04-4958-a717-8ffbdcddc570 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:49.860140 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 790/1586] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:56:49 2022] PUT /identity/v3/projects/aaa19bacb8874596aa41cfda5442516e/users/be77a6cef367428e92080741f60520a2/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:56:49.882313 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045abd98-3360-492f-9d72-1be2283b4ad7 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:49.882779 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045abd98-3360-492f-9d72-1be2283b4ad7 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:49.883369 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045abd98-3360-492f-9d72-1be2283b4ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:49.936099 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e95a5e-aaff-48e6-b1d7-81714fb88cad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:49.941389 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e95a5e-aaff-48e6-b1d7-81714fb88cad service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:49.957011 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-045abd98-3360-492f-9d72-1be2283b4ad7 None None] MFA Rules not processed for user `be77a6cef367428e92080741f60520a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:49.959409 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-045abd98-3360-492f-9d72-1be2283b4ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:49.966220 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 797/1587] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:49 2022] GET /identity/v3/auth/tokens => generated 3492 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:50.113332 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e95a5e-aaff-48e6-b1d7-81714fb88cad service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:50.138991 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e95a5e-aaff-48e6-b1d7-81714fb88cad service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:50.212335 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 791/1588] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:49 2022] POST /identity/v3/auth/tokens => generated 3464 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:56:50.290827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33991f35-889c-40ef-aefe-4b3ab2d02660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:50.292342 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33991f35-889c-40ef-aefe-4b3ab2d02660 service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:50.292694 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33991f35-889c-40ef-aefe-4b3ab2d02660 service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:50.293028 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33991f35-889c-40ef-aefe-4b3ab2d02660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:50.472989 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33991f35-889c-40ef-aefe-4b3ab2d02660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:50.476378 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33991f35-889c-40ef-aefe-4b3ab2d02660 service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:50.522618 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 798/1589] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:50 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:56:50.957491 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045abd98-3360-492f-9d72-1be2283b4ad7 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:50.971440 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045abd98-3360-492f-9d72-1be2283b4ad7 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:50.984348 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a6f7b-8c01-44e6-a36d-9512df41164c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:50.985414 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a6f7b-8c01-44e6-a36d-9512df41164c service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:50.985611 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a6f7b-8c01-44e6-a36d-9512df41164c service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:50.985876 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a6f7b-8c01-44e6-a36d-9512df41164c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:51.123994 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a6f7b-8c01-44e6-a36d-9512df41164c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:51.125838 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a6f7b-8c01-44e6-a36d-9512df41164c service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:51.148698 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 792/1590] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:50 2022] GET /identity/v3/auth/tokens => generated 3397 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:51.847394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33991f35-889c-40ef-aefe-4b3ab2d02660 service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:51.863660 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33991f35-889c-40ef-aefe-4b3ab2d02660 service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:51.885439 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9b09a-a185-43ea-a8ac-483bc4e56817 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:51.886159 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9b09a-a185-43ea-a8ac-483bc4e56817 service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:51.886606 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9b09a-a185-43ea-a8ac-483bc4e56817 service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:51.886894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9b09a-a185-43ea-a8ac-483bc4e56817 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:51.956170 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a6f7b-8c01-44e6-a36d-9512df41164c service cinder] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:51.991740 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a6f7b-8c01-44e6-a36d-9512df41164c service cinder] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:52.016128 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9b09a-a185-43ea-a8ac-483bc4e56817 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:52.019189 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9b09a-a185-43ea-a8ac-483bc4e56817 service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:52.021039 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf8ee7-ff77-49b8-9b5c-8b9030e169e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:52.022105 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf8ee7-ff77-49b8-9b5c-8b9030e169e7 service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:52.022723 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf8ee7-ff77-49b8-9b5c-8b9030e169e7 service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:52.023172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf8ee7-ff77-49b8-9b5c-8b9030e169e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:52.035308 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 799/1591] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:51 2022] GET /identity/v3/auth/tokens => generated 3405 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:52.069934 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9b09a-a185-43ea-a8ac-483bc4e56817 service nova] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:52.195193 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf8ee7-ff77-49b8-9b5c-8b9030e169e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:52.199007 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf8ee7-ff77-49b8-9b5c-8b9030e169e7 service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:52.260726 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 793/1592] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:51 2022] GET /identity/v3/auth/tokens => generated 3397 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:52.319573 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9b09a-a185-43ea-a8ac-483bc4e56817 service nova] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:52.335157 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41915f-7265-4f39-904d-9dab714541c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:52.336009 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41915f-7265-4f39-904d-9dab714541c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:52.336509 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41915f-7265-4f39-904d-9dab714541c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:52.336902 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41915f-7265-4f39-904d-9dab714541c5 admin admin] PATH_INFO: `/v3/users/f02c5e1e856e42038981eea51211debd` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:52.338431 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41915f-7265-4f39-904d-9dab714541c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f02c5e1e856e42038981eea51211debd)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:52.341139 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41915f-7265-4f39-904d-9dab714541c5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:52.429037 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9f41915f-7265-4f39-904d-9dab714541c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f02c5e1e856e42038981eea51211debd'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:52.429938 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9f41915f-7265-4f39-904d-9dab714541c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f02c5e1e856e42038981eea51211debd'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:52.430710 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9f41915f-7265-4f39-904d-9dab714541c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f02c5e1e856e42038981eea51211debd'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:52.452349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9f41915f-7265-4f39-904d-9dab714541c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f02c5e1e856e42038981eea51211debd'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:52.462946 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9f41915f-7265-4f39-904d-9dab714541c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f02c5e1e856e42038981eea51211debd'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:52.522996 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 800/1593] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:56:52 2022] DELETE /identity/v3/users/f02c5e1e856e42038981eea51211debd => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:56:52.528385 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548934d7-662d-4526-8823-e244fad01b32 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:52.540562 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548934d7-662d-4526-8823-e244fad01b32 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:52.541021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548934d7-662d-4526-8823-e244fad01b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:52.571470 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-548934d7-662d-4526-8823-e244fad01b32 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:52.573799 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-548934d7-662d-4526-8823-e244fad01b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:52.668303 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 794/1594] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:52 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:56:52.730751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41915f-7265-4f39-904d-9dab714541c5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:52.735877 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-9f41915f-7265-4f39-904d-9dab714541c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:52.855788 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41915f-7265-4f39-904d-9dab714541c5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:52.861257 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe1e7c-1991-456a-b593-675c3eedc2a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:52.862828 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe1e7c-1991-456a-b593-675c3eedc2a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:52.862828 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe1e7c-1991-456a-b593-675c3eedc2a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:52.863082 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe1e7c-1991-456a-b593-675c3eedc2a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:52.875713 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe1e7c-1991-456a-b593-675c3eedc2a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:52.878711 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe1e7c-1991-456a-b593-675c3eedc2a3 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:52.905490 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 801/1595] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:52 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:53.159223 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef068a-e27c-495d-be01-4ee469f01285 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:53.159223 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef068a-e27c-495d-be01-4ee469f01285 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:53.160317 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef068a-e27c-495d-be01-4ee469f01285 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:53.161667 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 795/1596] 10.222.0.96 () {54 vars in 912 bytes} [Fri Jan 28 01:56:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:56:53.173241 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c1e0d-0092-40a7-8108-bbe5b9afc95a None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:53.173867 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c1e0d-0092-40a7-8108-bbe5b9afc95a None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:53.174458 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c1e0d-0092-40a7-8108-bbe5b9afc95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:53.248642 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8998c-1f56-465a-b17d-37a62e007fb9 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:53.249416 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8998c-1f56-465a-b17d-37a62e007fb9 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:53.251122 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8998c-1f56-465a-b17d-37a62e007fb9 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:53.258944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 796/1597] 10.222.0.96 () {54 vars in 912 bytes} [Fri Jan 28 01:56:53 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:56:53.261765 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-100c1e0d-0092-40a7-8108-bbe5b9afc95a None None] MFA Rules not processed for user `4acc32735f0a418ba5620f6225500402`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:53.262995 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-100c1e0d-0092-40a7-8108-bbe5b9afc95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:53.273981 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c539da9-b8bf-4a2d-adc6-f54cf1d5c88a None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:53.275622 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c539da9-b8bf-4a2d-adc6-f54cf1d5c88a None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:53.276506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c539da9-b8bf-4a2d-adc6-f54cf1d5c88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:53.279558 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 802/1598] 10.222.0.96 () {58 vars in 1009 bytes} [Fri Jan 28 01:56:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:56:53.316084 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-2c539da9-b8bf-4a2d-adc6-f54cf1d5c88a None None] MFA Rules not processed for user `4acc32735f0a418ba5620f6225500402`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:53.318886 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2c539da9-b8bf-4a2d-adc6-f54cf1d5c88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:53.327254 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c1e0d-0092-40a7-8108-bbe5b9afc95a None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:53.337469 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 797/1599] 10.222.0.96 () {58 vars in 1009 bytes} [Fri Jan 28 01:56:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:56:53.340743 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c1e0d-0092-40a7-8108-bbe5b9afc95a None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:53.350433 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0803b-7956-4331-bf06-b308f54bfbda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:53.351818 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0803b-7956-4331-bf06-b308f54bfbda service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:53.352071 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0803b-7956-4331-bf06-b308f54bfbda service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:53.352403 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0803b-7956-4331-bf06-b308f54bfbda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:53.373200 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0803b-7956-4331-bf06-b308f54bfbda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:53.376694 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0803b-7956-4331-bf06-b308f54bfbda service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:53.390493 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c539da9-b8bf-4a2d-adc6-f54cf1d5c88a None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:53.403235 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c539da9-b8bf-4a2d-adc6-f54cf1d5c88a None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:53.412182 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b09335-0a01-460e-a8a9-5ff7e257df6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:53.413458 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b09335-0a01-460e-a8a9-5ff7e257df6b service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:53.415449 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b09335-0a01-460e-a8a9-5ff7e257df6b service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:53.416174 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b09335-0a01-460e-a8a9-5ff7e257df6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:53.429564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b09335-0a01-460e-a8a9-5ff7e257df6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:53.442883 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b09335-0a01-460e-a8a9-5ff7e257df6b service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:53.445812 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 803/1600] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:56:53.457506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 798/1601] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:54.311277 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0803b-7956-4331-bf06-b308f54bfbda service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:54.313890 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-20d0803b-7956-4331-bf06-b308f54bfbda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:54.339399 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0803b-7956-4331-bf06-b308f54bfbda service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:54.356549 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c159733-aa64-496f-936e-4b29812ea8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:54.357678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c159733-aa64-496f-936e-4b29812ea8c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:54.358143 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c159733-aa64-496f-936e-4b29812ea8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:54.358732 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c159733-aa64-496f-936e-4b29812ea8c0 admin admin] PATH_INFO: `/v3/projects/82ce407dec3d480797a15fca87c7cb79` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:54.360602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c159733-aa64-496f-936e-4b29812ea8c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82ce407dec3d480797a15fca87c7cb79)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:54.365447 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: WARNING py.warnings [None req-2c159733-aa64-496f-936e-4b29812ea8c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:56:54.365447 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: warnings.warn(msg) Jan 28 01:56:54.365447 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: Jan 28 01:56:54.367156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c159733-aa64-496f-936e-4b29812ea8c0 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:54.487400 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-2c159733-aa64-496f-936e-4b29812ea8c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82ce407dec3d480797a15fca87c7cb79', 'request_id': 'req-2c159733-aa64-496f-936e-4b29812ea8c0'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:54.534010 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-2c159733-aa64-496f-936e-4b29812ea8c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82ce407dec3d480797a15fca87c7cb79', 'request_id': 'req-2c159733-aa64-496f-936e-4b29812ea8c0'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:54.559144 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-2c159733-aa64-496f-936e-4b29812ea8c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82ce407dec3d480797a15fca87c7cb79', 'request_id': 'req-2c159733-aa64-496f-936e-4b29812ea8c0'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:54.583777 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-2c159733-aa64-496f-936e-4b29812ea8c0 admin admin] The token cache is being invalidate because project 82ce407dec3d480797a15fca87c7cb79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:56:54.584070 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-2c159733-aa64-496f-936e-4b29812ea8c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:54.587353 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-2c159733-aa64-496f-936e-4b29812ea8c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:54.596529 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b09335-0a01-460e-a8a9-5ff7e257df6b service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:54.598721 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 804/1602] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:56:54 2022] DELETE /identity/v3/projects/82ce407dec3d480797a15fca87c7cb79 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:56:54.610428 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b09335-0a01-460e-a8a9-5ff7e257df6b service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:54.785643 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a311b-1054-46cf-b25c-c339c0a2d6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:54.786542 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a311b-1054-46cf-b25c-c339c0a2d6ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:54.786816 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a311b-1054-46cf-b25c-c339c0a2d6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:54.789080 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a311b-1054-46cf-b25c-c339c0a2d6ae admin admin] PATH_INFO: `/v3/users/7b8c661ee30f43c3b1472385dce7ee48` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:54.792305 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a311b-1054-46cf-b25c-c339c0a2d6ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b8c661ee30f43c3b1472385dce7ee48)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:54.795422 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: WARNING py.warnings [None req-713a311b-1054-46cf-b25c-c339c0a2d6ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:56:54.795422 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: warnings.warn(msg) Jan 28 01:56:54.795422 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: Jan 28 01:56:54.801493 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a311b-1054-46cf-b25c-c339c0a2d6ae admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:54.870364 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a470a-c51e-4b4d-b233-f5f8d13bde67 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:54.870648 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a470a-c51e-4b4d-b233-f5f8d13bde67 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:54.870923 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a470a-c51e-4b4d-b233-f5f8d13bde67 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:54.872845 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 805/1603] 10.222.0.96 () {54 vars in 960 bytes} [Fri Jan 28 01:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:56:54.882827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722b1a8-72cc-4dce-ac1e-2adfba61f672 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:54.883268 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722b1a8-72cc-4dce-ac1e-2adfba61f672 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:54.883379 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722b1a8-72cc-4dce-ac1e-2adfba61f672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:54.945143 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-7722b1a8-72cc-4dce-ac1e-2adfba61f672 None None] MFA Rules not processed for user `88a16f0ecf3448428e969359be57dda8`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:54.949446 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-7722b1a8-72cc-4dce-ac1e-2adfba61f672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:55.041998 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-713a311b-1054-46cf-b25c-c339c0a2d6ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b8c661ee30f43c3b1472385dce7ee48'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:55.042657 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-713a311b-1054-46cf-b25c-c339c0a2d6ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b8c661ee30f43c3b1472385dce7ee48'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:55.068925 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-713a311b-1054-46cf-b25c-c339c0a2d6ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b8c661ee30f43c3b1472385dce7ee48'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:55.094514 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-713a311b-1054-46cf-b25c-c339c0a2d6ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b8c661ee30f43c3b1472385dce7ee48'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:55.129992 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-713a311b-1054-46cf-b25c-c339c0a2d6ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b8c661ee30f43c3b1472385dce7ee48'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:55.144211 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 799/1604] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:56:54 2022] DELETE /identity/v3/users/7b8c661ee30f43c3b1472385dce7ee48 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:56:55.148309 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a311b-1054-46cf-b25c-c339c0a2d6ae admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:55.175540 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-713a311b-1054-46cf-b25c-c339c0a2d6ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:55.247986 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 806/1605] 10.222.0.96 () {58 vars in 1057 bytes} [Fri Jan 28 01:56:54 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jan 28 01:56:55.256999 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722b1a8-72cc-4dce-ac1e-2adfba61f672 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:55.295064 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722b1a8-72cc-4dce-ac1e-2adfba61f672 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:55.353310 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a311b-1054-46cf-b25c-c339c0a2d6ae admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:55.383182 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd13620-8ba3-4220-abc2-d5237f56021d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a16f0ecf3448428e969359be57dda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:55.386464 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd13620-8ba3-4220-abc2-d5237f56021d service placement] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:55.391542 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd13620-8ba3-4220-abc2-d5237f56021d service placement] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:55.392949 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd13620-8ba3-4220-abc2-d5237f56021d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:55.399605 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-8bd13620-8ba3-4220-abc2-d5237f56021d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:55.449373 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd13620-8ba3-4220-abc2-d5237f56021d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:55.451459 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd13620-8ba3-4220-abc2-d5237f56021d service placement] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:55.502436 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b26ca-cf13-41b2-8a00-5d7ff6f6789c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a16f0ecf3448428e969359be57dda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:55.505191 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b26ca-cf13-41b2-8a00-5d7ff6f6789c service placement] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:55.506054 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b26ca-cf13-41b2-8a00-5d7ff6f6789c service placement] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:55.507761 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b26ca-cf13-41b2-8a00-5d7ff6f6789c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:55.514427 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 800/1606] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:55 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:55.554034 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b26ca-cf13-41b2-8a00-5d7ff6f6789c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:55.558511 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b26ca-cf13-41b2-8a00-5d7ff6f6789c service placement] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:55.608979 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 807/1607] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:55 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:56.718626 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd13620-8ba3-4220-abc2-d5237f56021d service placement] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:56.723056 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-8bd13620-8ba3-4220-abc2-d5237f56021d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:56.871022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd13620-8ba3-4220-abc2-d5237f56021d service placement] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:56.885935 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27a28b-3047-43dd-9c6c-0803569c8a68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:56.887258 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27a28b-3047-43dd-9c6c-0803569c8a68 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:56.888579 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27a28b-3047-43dd-9c6c-0803569c8a68 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:56.890704 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27a28b-3047-43dd-9c6c-0803569c8a68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:56.907690 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-8a27a28b-3047-43dd-9c6c-0803569c8a68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:57.087286 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27a28b-3047-43dd-9c6c-0803569c8a68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:57.089384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27a28b-3047-43dd-9c6c-0803569c8a68 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:57.121633 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 801/1608] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:56 2022] GET /identity/v3/auth/tokens => generated 3464 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:57.301705 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b26ca-cf13-41b2-8a00-5d7ff6f6789c service placement] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:57.306994 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-cb3b26ca-cf13-41b2-8a00-5d7ff6f6789c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:57.532313 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b26ca-cf13-41b2-8a00-5d7ff6f6789c service placement] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:57.557674 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48312b77-776b-49d6-baa7-aeb467dc0a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:57.559036 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48312b77-776b-49d6-baa7-aeb467dc0a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:57.559521 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48312b77-776b-49d6-baa7-aeb467dc0a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:57.562959 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48312b77-776b-49d6-baa7-aeb467dc0a9e admin admin] PATH_INFO: `/v3/projects/45f52646f6ca453c9898aa53a7c5d880` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:57.566275 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48312b77-776b-49d6-baa7-aeb467dc0a9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f52646f6ca453c9898aa53a7c5d880)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:57.571377 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48312b77-776b-49d6-baa7-aeb467dc0a9e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:57.654945 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07e4d0-42f4-4e4d-aaeb-4e15aed14530 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:57.655809 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07e4d0-42f4-4e4d-aaeb-4e15aed14530 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:57.656235 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07e4d0-42f4-4e4d-aaeb-4e15aed14530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:57.727012 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-1e07e4d0-42f4-4e4d-aaeb-4e15aed14530 None None] MFA Rules not processed for user `7b8f259580b84c1da7ccd7dd9391e406`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:57.728613 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1e07e4d0-42f4-4e4d-aaeb-4e15aed14530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:57.733610 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-48312b77-776b-49d6-baa7-aeb467dc0a9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f52646f6ca453c9898aa53a7c5d880', 'request_id': 'req-48312b77-776b-49d6-baa7-aeb467dc0a9e'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:57.758198 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-48312b77-776b-49d6-baa7-aeb467dc0a9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f52646f6ca453c9898aa53a7c5d880', 'request_id': 'req-48312b77-776b-49d6-baa7-aeb467dc0a9e'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:57.778271 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-48312b77-776b-49d6-baa7-aeb467dc0a9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f52646f6ca453c9898aa53a7c5d880', 'request_id': 'req-48312b77-776b-49d6-baa7-aeb467dc0a9e'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:57.806695 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-48312b77-776b-49d6-baa7-aeb467dc0a9e admin admin] The token cache is being invalidate because project 45f52646f6ca453c9898aa53a7c5d880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:56:57.807187 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-48312b77-776b-49d6-baa7-aeb467dc0a9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:57.808057 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-48312b77-776b-49d6-baa7-aeb467dc0a9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:56:57.810507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 808/1609] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:56:57 2022] DELETE /identity/v3/projects/45f52646f6ca453c9898aa53a7c5d880 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:56:57.817768 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa50e95-1527-46fe-b3f2-52b1561c108e None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:57.820267 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa50e95-1527-46fe-b3f2-52b1561c108e None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:57.820893 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa50e95-1527-46fe-b3f2-52b1561c108e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:57.856094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-daa50e95-1527-46fe-b3f2-52b1561c108e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:57.857749 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-daa50e95-1527-46fe-b3f2-52b1561c108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:57.935859 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 802/1610] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:57 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:57.937668 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa44c6-9470-445a-a0ff-40e3b3d55be8 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:57.937957 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa44c6-9470-445a-a0ff-40e3b3d55be8 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:57.938235 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa44c6-9470-445a-a0ff-40e3b3d55be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:57.968074 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-2aaa44c6-9470-445a-a0ff-40e3b3d55be8 None None] MFA Rules not processed for user `7b8f259580b84c1da7ccd7dd9391e406`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:57.969878 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2aaa44c6-9470-445a-a0ff-40e3b3d55be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:57.981556 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 803/1611] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:57 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:57.995735 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa44c6-9470-445a-a0ff-40e3b3d55be8 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:57.999260 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2aaa44c6-9470-445a-a0ff-40e3b3d55be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:58.012824 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 809/1612] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:57 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:58.023220 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8fac5-bbdf-40d2-a46c-77a5157d70d4 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:58.023679 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8fac5-bbdf-40d2-a46c-77a5157d70d4 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:58.024219 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8fac5-bbdf-40d2-a46c-77a5157d70d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:58.074110 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-9dc8fac5-bbdf-40d2-a46c-77a5157d70d4 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:58.075960 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-9dc8fac5-bbdf-40d2-a46c-77a5157d70d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:58.097801 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 810/1613] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:58 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:58.104507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8fac5-bbdf-40d2-a46c-77a5157d70d4 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:58.126465 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8fac5-bbdf-40d2-a46c-77a5157d70d4 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:58.140475 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63180f6d-5ac9-436e-9e10-9107dd4eb78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:58.141646 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63180f6d-5ac9-436e-9e10-9107dd4eb78e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:58.142314 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63180f6d-5ac9-436e-9e10-9107dd4eb78e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:58.144044 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63180f6d-5ac9-436e-9e10-9107dd4eb78e admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:58.145335 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63180f6d-5ac9-436e-9e10-9107dd4eb78e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:56:58.146884 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63180f6d-5ac9-436e-9e10-9107dd4eb78e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:58.149055 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63180f6d-5ac9-436e-9e10-9107dd4eb78e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:58.180587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 811/1614] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:56:58.185165 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63180f6d-5ac9-436e-9e10-9107dd4eb78e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:58.199875 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63180f6d-5ac9-436e-9e10-9107dd4eb78e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:58.204747 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa44c6-9470-445a-a0ff-40e3b3d55be8 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:58.211118 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd8237-5b8d-4664-8cc5-24d5f1c548e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:58.211963 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd8237-5b8d-4664-8cc5-24d5f1c548e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:58.212335 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd8237-5b8d-4664-8cc5-24d5f1c548e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:58.212681 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd8237-5b8d-4664-8cc5-24d5f1c548e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:58.213498 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd8237-5b8d-4664-8cc5-24d5f1c548e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:58.215522 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd8237-5b8d-4664-8cc5-24d5f1c548e2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:58.223100 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79311b-7d32-49f1-b0fa-61013c157bbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:58.223821 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79311b-7d32-49f1-b0fa-61013c157bbf service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:58.224196 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79311b-7d32-49f1-b0fa-61013c157bbf service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:58.224438 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79311b-7d32-49f1-b0fa-61013c157bbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:58.234562 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79311b-7d32-49f1-b0fa-61013c157bbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:58.236908 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79311b-7d32-49f1-b0fa-61013c157bbf service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:58.249091 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 804/1615] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:56:57 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:56:58.270520 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 812/1616] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:56:58 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:58.274475 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79311b-7d32-49f1-b0fa-61013c157bbf service nova] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:58.300712 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79311b-7d32-49f1-b0fa-61013c157bbf service nova] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:58.446005 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513af6c-e139-4f43-a297-d8d07313736e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:58.447032 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513af6c-e139-4f43-a297-d8d07313736e admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:58.449300 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513af6c-e139-4f43-a297-d8d07313736e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:58.449766 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513af6c-e139-4f43-a297-d8d07313736e admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:58.450660 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513af6c-e139-4f43-a297-d8d07313736e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:58.454129 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513af6c-e139-4f43-a297-d8d07313736e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:58.531893 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 805/1617] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:56:58 2022] POST /identity/v3/users => generated 287 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:58.533545 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd8237-5b8d-4664-8cc5-24d5f1c548e2 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:58.553440 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd8237-5b8d-4664-8cc5-24d5f1c548e2 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:58.560293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38ba61-bc8d-48bc-a625-5819f9a9711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:58.561574 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38ba61-bc8d-48bc-a625-5819f9a9711f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:58.562033 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38ba61-bc8d-48bc-a625-5819f9a9711f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:58.562894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38ba61-bc8d-48bc-a625-5819f9a9711f admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:58.563748 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38ba61-bc8d-48bc-a625-5819f9a9711f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:58.565828 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38ba61-bc8d-48bc-a625-5819f9a9711f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:58.578755 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 813/1618] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:58.587333 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513af6c-e139-4f43-a297-d8d07313736e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:58.606035 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513af6c-e139-4f43-a297-d8d07313736e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:58.612546 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938559b7-9d6a-4b19-b3d9-39071ecf81c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:58.613459 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938559b7-9d6a-4b19-b3d9-39071ecf81c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:58.613807 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938559b7-9d6a-4b19-b3d9-39071ecf81c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:58.614089 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938559b7-9d6a-4b19-b3d9-39071ecf81c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:58.614834 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938559b7-9d6a-4b19-b3d9-39071ecf81c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:58.617014 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938559b7-9d6a-4b19-b3d9-39071ecf81c0 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:58.647581 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 806/1619] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:58.652306 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38ba61-bc8d-48bc-a625-5819f9a9711f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:58.671039 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38ba61-bc8d-48bc-a625-5819f9a9711f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:58.681405 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9a072-daad-4e9c-b116-3c0a5cceac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:58.682400 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9a072-daad-4e9c-b116-3c0a5cceac56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:58.682749 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9a072-daad-4e9c-b116-3c0a5cceac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:58.683063 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9a072-daad-4e9c-b116-3c0a5cceac56 admin admin] PATH_INFO: `/v3/projects/17607543dad9463e960a0c9494f97fef/users/61b1b91160e6468a988bcdfc12c4531a/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:58.712512 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9a072-daad-4e9c-b116-3c0a5cceac56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17607543dad9463e960a0c9494f97fef, user_id=61b1b91160e6468a988bcdfc12c4531a, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:58.715448 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9a072-daad-4e9c-b116-3c0a5cceac56 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:58.745786 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 814/1620] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:56:58 2022] PUT /identity/v3/projects/17607543dad9463e960a0c9494f97fef/users/61b1b91160e6468a988bcdfc12c4531a/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:56:58.760982 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd0552-cef6-41aa-8dc7-bbaa4c1560cb None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:58.761771 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd0552-cef6-41aa-8dc7-bbaa4c1560cb None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:58.761930 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd0552-cef6-41aa-8dc7-bbaa4c1560cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:58.795267 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-5dcd0552-cef6-41aa-8dc7-bbaa4c1560cb None None] MFA Rules not processed for user `61b1b91160e6468a988bcdfc12c4531a`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:56:58.797160 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-5dcd0552-cef6-41aa-8dc7-bbaa4c1560cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:56:58.899475 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 807/1621] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:56:58 2022] POST /identity/v3/auth/tokens => generated 3393 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:56:58.904436 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9a072-daad-4e9c-b116-3c0a5cceac56 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:59.077977 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9a072-daad-4e9c-b116-3c0a5cceac56 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:59.088257 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec524f35-be50-4c7b-8cf2-7227af411281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:59.089471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec524f35-be50-4c7b-8cf2-7227af411281 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:59.091936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec524f35-be50-4c7b-8cf2-7227af411281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:59.092460 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec524f35-be50-4c7b-8cf2-7227af411281 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:59.095481 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec524f35-be50-4c7b-8cf2-7227af411281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:59.107368 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec524f35-be50-4c7b-8cf2-7227af411281 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:59.171148 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 815/1622] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:56:58 2022] POST /identity/v3/projects => generated 371 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:56:59.176381 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd0552-cef6-41aa-8dc7-bbaa4c1560cb None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:59.216832 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd0552-cef6-41aa-8dc7-bbaa4c1560cb None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:59.371516 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17de070-296b-4d91-959b-8f9d8815de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:59.372698 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17de070-296b-4d91-959b-8f9d8815de3e admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:59.373178 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17de070-296b-4d91-959b-8f9d8815de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:59.373632 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17de070-296b-4d91-959b-8f9d8815de3e admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:59.386503 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17de070-296b-4d91-959b-8f9d8815de3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:59.391128 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17de070-296b-4d91-959b-8f9d8815de3e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:59.432208 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 808/1623] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:56:59 2022] POST /identity/v3/users => generated 292 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:56:59.438428 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec524f35-be50-4c7b-8cf2-7227af411281 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:59.455610 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec524f35-be50-4c7b-8cf2-7227af411281 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:59.474889 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5228baf-25f3-4d93-b62a-925dd3f2528a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:59.475889 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5228baf-25f3-4d93-b62a-925dd3f2528a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:59.476249 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5228baf-25f3-4d93-b62a-925dd3f2528a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:59.476598 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5228baf-25f3-4d93-b62a-925dd3f2528a admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:59.488058 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5228baf-25f3-4d93-b62a-925dd3f2528a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:59.491202 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5228baf-25f3-4d93-b62a-925dd3f2528a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:59.545263 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 816/1624] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:59.548740 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17de070-296b-4d91-959b-8f9d8815de3e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:59.568770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17de070-296b-4d91-959b-8f9d8815de3e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:59.581556 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187ebac-e5d2-47f0-9f39-1b57c6d1e3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:59.582968 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187ebac-e5d2-47f0-9f39-1b57c6d1e3c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:59.582968 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187ebac-e5d2-47f0-9f39-1b57c6d1e3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:59.583237 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187ebac-e5d2-47f0-9f39-1b57c6d1e3c2 admin admin] PATH_INFO: `/v3/projects/4a39221aba25449d94ba3646b857c9ac/users/16b851fee89540cc8fd371283a597aaa/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:59.617290 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187ebac-e5d2-47f0-9f39-1b57c6d1e3c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a39221aba25449d94ba3646b857c9ac, user_id=16b851fee89540cc8fd371283a597aaa, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:59.619998 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187ebac-e5d2-47f0-9f39-1b57c6d1e3c2 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:59.652166 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 809/1625] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:56:59 2022] PUT /identity/v3/projects/4a39221aba25449d94ba3646b857c9ac/users/16b851fee89540cc8fd371283a597aaa/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:56:59.653773 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5228baf-25f3-4d93-b62a-925dd3f2528a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:59.671127 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5228baf-25f3-4d93-b62a-925dd3f2528a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:59.849665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee02a2-764b-465c-9ca1-2b5ad009951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:59.850619 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee02a2-764b-465c-9ca1-2b5ad009951f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:59.851029 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee02a2-764b-465c-9ca1-2b5ad009951f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:59.851505 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee02a2-764b-465c-9ca1-2b5ad009951f admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:59.852444 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee02a2-764b-465c-9ca1-2b5ad009951f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:59.857063 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee02a2-764b-465c-9ca1-2b5ad009951f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:56:59.907132 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 817/1626] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:56:59.914021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187ebac-e5d2-47f0-9f39-1b57c6d1e3c2 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:56:59.955223 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187ebac-e5d2-47f0-9f39-1b57c6d1e3c2 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:56:59.978925 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe9f9d-5ee8-4c53-933e-4ebe20a1975b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:56:59.980416 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe9f9d-5ee8-4c53-933e-4ebe20a1975b admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:56:59.980890 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe9f9d-5ee8-4c53-933e-4ebe20a1975b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:56:59.981387 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe9f9d-5ee8-4c53-933e-4ebe20a1975b admin admin] PATH_INFO: `/v3/projects/4a39221aba25449d94ba3646b857c9ac/users/16b851fee89540cc8fd371283a597aaa/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:56:59.985640 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe9f9d-5ee8-4c53-933e-4ebe20a1975b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a39221aba25449d94ba3646b857c9ac, user_id=16b851fee89540cc8fd371283a597aaa, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:56:59.997659 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe9f9d-5ee8-4c53-933e-4ebe20a1975b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:00.070067 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9322d-cc81-490a-bfcd-0065d3d66805 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:00.070498 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9322d-cc81-490a-bfcd-0065d3d66805 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:00.070904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9322d-cc81-490a-bfcd-0065d3d66805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:00.077094 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 810/1627] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:56:59 2022] PUT /identity/v3/projects/4a39221aba25449d94ba3646b857c9ac/users/16b851fee89540cc8fd371283a597aaa/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:00.080181 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271727d-19b3-4e32-bfd1-05cf2657898b None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:00.080465 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271727d-19b3-4e32-bfd1-05cf2657898b None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:00.080748 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271727d-19b3-4e32-bfd1-05cf2657898b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:00.120862 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-3da9322d-cc81-490a-bfcd-0065d3d66805 None None] MFA Rules not processed for user `7b8f259580b84c1da7ccd7dd9391e406`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:00.122202 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-3da9322d-cc81-490a-bfcd-0065d3d66805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:00.138938 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-8271727d-19b3-4e32-bfd1-05cf2657898b None None] MFA Rules not processed for user `16b851fee89540cc8fd371283a597aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:00.140726 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-8271727d-19b3-4e32-bfd1-05cf2657898b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:00.217656 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 818/1628] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:00 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:00.219733 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef2002-9ea4-4c2d-b2f3-76f3b9e016c9 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:00.220065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef2002-9ea4-4c2d-b2f3-76f3b9e016c9 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:00.221520 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef2002-9ea4-4c2d-b2f3-76f3b9e016c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:00.268060 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-93ef2002-9ea4-4c2d-b2f3-76f3b9e016c9 None None] MFA Rules not processed for user `c34c05b7e55447f2a5ddf9c9b9299f44`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:00.268060 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-93ef2002-9ea4-4c2d-b2f3-76f3b9e016c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:00.293232 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 811/1629] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:00 2022] POST /identity/v3/auth/tokens => generated 3458 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:00.306596 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271727d-19b3-4e32-bfd1-05cf2657898b None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:00.310895 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-8271727d-19b3-4e32-bfd1-05cf2657898b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:00.445032 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271727d-19b3-4e32-bfd1-05cf2657898b None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:00.456094 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc91a7f-50e6-41d6-890e-da33f6e69444 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:00.457124 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 819/1630] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:00 2022] POST /identity/v3/auth/tokens => generated 3409 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:00.458211 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc91a7f-50e6-41d6-890e-da33f6e69444 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:00.458912 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc91a7f-50e6-41d6-890e-da33f6e69444 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:00.459430 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc91a7f-50e6-41d6-890e-da33f6e69444 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:00.486084 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc91a7f-50e6-41d6-890e-da33f6e69444 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:00.488842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc91a7f-50e6-41d6-890e-da33f6e69444 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:00.506822 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 812/1631] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:00 2022] GET /identity/v3/auth/tokens => generated 3458 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:57:00.541434 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef2002-9ea4-4c2d-b2f3-76f3b9e016c9 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:00.544370 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-93ef2002-9ea4-4c2d-b2f3-76f3b9e016c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:00.705855 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef2002-9ea4-4c2d-b2f3-76f3b9e016c9 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:00.714222 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dba78-ad5a-494d-9178-381682062db4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:00.716513 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dba78-ad5a-494d-9178-381682062db4 service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:00.717089 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dba78-ad5a-494d-9178-381682062db4 service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:00.717744 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dba78-ad5a-494d-9178-381682062db4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:00.730222 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3dba78-ad5a-494d-9178-381682062db4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:00.732740 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3dba78-ad5a-494d-9178-381682062db4 service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:00.770228 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 820/1632] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:00 2022] GET /identity/v3/auth/tokens => generated 3409 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:01.301659 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc91a7f-50e6-41d6-890e-da33f6e69444 service cinder] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:01.456477 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc91a7f-50e6-41d6-890e-da33f6e69444 service cinder] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:01.473702 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21674b86-6624-48bf-80bf-a6b1df7a1664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:01.475030 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21674b86-6624-48bf-80bf-a6b1df7a1664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:01.476609 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21674b86-6624-48bf-80bf-a6b1df7a1664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:01.480106 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21674b86-6624-48bf-80bf-a6b1df7a1664 admin admin] PATH_INFO: `/v3/users/61b1b91160e6468a988bcdfc12c4531a` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:01.483018 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21674b86-6624-48bf-80bf-a6b1df7a1664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b1b91160e6468a988bcdfc12c4531a)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:01.487942 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21674b86-6624-48bf-80bf-a6b1df7a1664 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:01.684719 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-21674b86-6624-48bf-80bf-a6b1df7a1664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b1b91160e6468a988bcdfc12c4531a'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:01.685643 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-21674b86-6624-48bf-80bf-a6b1df7a1664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b1b91160e6468a988bcdfc12c4531a'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:01.702361 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-21674b86-6624-48bf-80bf-a6b1df7a1664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b1b91160e6468a988bcdfc12c4531a'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:01.717327 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-21674b86-6624-48bf-80bf-a6b1df7a1664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b1b91160e6468a988bcdfc12c4531a'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:01.734998 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-21674b86-6624-48bf-80bf-a6b1df7a1664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b1b91160e6468a988bcdfc12c4531a'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:01.742204 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 813/1633] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:01 2022] DELETE /identity/v3/users/61b1b91160e6468a988bcdfc12c4531a => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:01.747431 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65d9e-e2a7-4f63-816f-be3368de2873 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:01.748577 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65d9e-e2a7-4f63-816f-be3368de2873 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:01.749210 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65d9e-e2a7-4f63-816f-be3368de2873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:01.802755 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-d9b65d9e-e2a7-4f63-816f-be3368de2873 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:01.805883 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-d9b65d9e-e2a7-4f63-816f-be3368de2873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:01.914980 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 821/1634] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:01 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:01.927816 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21674b86-6624-48bf-80bf-a6b1df7a1664 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:01.930070 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-21674b86-6624-48bf-80bf-a6b1df7a1664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:02.099033 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21674b86-6624-48bf-80bf-a6b1df7a1664 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:02.106455 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06607cb6-d958-4e8b-a161-e2645a96b120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:02.109458 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06607cb6-d958-4e8b-a161-e2645a96b120 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:02.109458 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06607cb6-d958-4e8b-a161-e2645a96b120 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:02.109458 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06607cb6-d958-4e8b-a161-e2645a96b120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:02.148822 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06607cb6-d958-4e8b-a161-e2645a96b120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:02.157406 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06607cb6-d958-4e8b-a161-e2645a96b120 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:02.182839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 814/1635] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:01 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:03.283231 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b65d9e-e2a7-4f63-816f-be3368de2873 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:03.284965 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-d9b65d9e-e2a7-4f63-816f-be3368de2873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:03.312659 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b65d9e-e2a7-4f63-816f-be3368de2873 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:03.332459 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e1145-0466-45ca-afe4-60cbcd492e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:03.336675 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e1145-0466-45ca-afe4-60cbcd492e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:03.337013 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e1145-0466-45ca-afe4-60cbcd492e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:03.337303 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e1145-0466-45ca-afe4-60cbcd492e20 admin admin] PATH_INFO: `/v3/projects/17607543dad9463e960a0c9494f97fef` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:03.340822 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e1145-0466-45ca-afe4-60cbcd492e20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17607543dad9463e960a0c9494f97fef)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:03.342920 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e1145-0466-45ca-afe4-60cbcd492e20 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:03.558200 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c12e1145-0466-45ca-afe4-60cbcd492e20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17607543dad9463e960a0c9494f97fef', 'request_id': 'req-c12e1145-0466-45ca-afe4-60cbcd492e20'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:03.599320 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c12e1145-0466-45ca-afe4-60cbcd492e20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17607543dad9463e960a0c9494f97fef', 'request_id': 'req-c12e1145-0466-45ca-afe4-60cbcd492e20'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:03.669788 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c12e1145-0466-45ca-afe4-60cbcd492e20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17607543dad9463e960a0c9494f97fef', 'request_id': 'req-c12e1145-0466-45ca-afe4-60cbcd492e20'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:03.699956 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c12e1145-0466-45ca-afe4-60cbcd492e20 admin admin] The token cache is being invalidate because project 17607543dad9463e960a0c9494f97fef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:03.701235 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c12e1145-0466-45ca-afe4-60cbcd492e20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:03.703788 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c12e1145-0466-45ca-afe4-60cbcd492e20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:03.713286 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 822/1636] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:03 2022] DELETE /identity/v3/projects/17607543dad9463e960a0c9494f97fef => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:03.717936 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06607cb6-d958-4e8b-a161-e2645a96b120 service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:03.758094 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06607cb6-d958-4e8b-a161-e2645a96b120 service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:03.888275 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e1145-0466-45ca-afe4-60cbcd492e20 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:03.905090 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c12e1145-0466-45ca-afe4-60cbcd492e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:04.069792 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e1145-0466-45ca-afe4-60cbcd492e20 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:04.082160 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427701ab-978c-4116-aec4-8d0776404c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:04.084134 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427701ab-978c-4116-aec4-8d0776404c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:04.084625 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427701ab-978c-4116-aec4-8d0776404c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:04.085069 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427701ab-978c-4116-aec4-8d0776404c9b admin admin] PATH_INFO: `/v3/users/e8a1b585e92e4eb28505883fa4936392` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:04.087315 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427701ab-978c-4116-aec4-8d0776404c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a1b585e92e4eb28505883fa4936392)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:04.089871 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c553f-1627-40f8-a204-2e535d777c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:04.091060 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c553f-1627-40f8-a204-2e535d777c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:04.091607 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427701ab-978c-4116-aec4-8d0776404c9b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:04.093460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c553f-1627-40f8-a204-2e535d777c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:04.101110 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c553f-1627-40f8-a204-2e535d777c01 admin admin] PATH_INFO: `/v3/users/16b851fee89540cc8fd371283a597aaa` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:04.112369 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c553f-1627-40f8-a204-2e535d777c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16b851fee89540cc8fd371283a597aaa)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:04.114763 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c553f-1627-40f8-a204-2e535d777c01 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:04.283380 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1f4c553f-1627-40f8-a204-2e535d777c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16b851fee89540cc8fd371283a597aaa'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:04.284186 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1f4c553f-1627-40f8-a204-2e535d777c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16b851fee89540cc8fd371283a597aaa'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:04.292562 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-427701ab-978c-4116-aec4-8d0776404c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a1b585e92e4eb28505883fa4936392'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:04.298498 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-427701ab-978c-4116-aec4-8d0776404c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a1b585e92e4eb28505883fa4936392'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:04.299941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-427701ab-978c-4116-aec4-8d0776404c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a1b585e92e4eb28505883fa4936392'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:04.313226 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1f4c553f-1627-40f8-a204-2e535d777c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16b851fee89540cc8fd371283a597aaa'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:04.323607 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-427701ab-978c-4116-aec4-8d0776404c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a1b585e92e4eb28505883fa4936392'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:04.338997 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1f4c553f-1627-40f8-a204-2e535d777c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16b851fee89540cc8fd371283a597aaa'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:04.374033 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1f4c553f-1627-40f8-a204-2e535d777c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16b851fee89540cc8fd371283a597aaa'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:04.378507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-427701ab-978c-4116-aec4-8d0776404c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a1b585e92e4eb28505883fa4936392'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:04.394651 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 815/1637] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:03 2022] DELETE /identity/v3/users/16b851fee89540cc8fd371283a597aaa => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:04.476302 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 823/1638] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:03 2022] DELETE /identity/v3/users/e8a1b585e92e4eb28505883fa4936392 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:04.481657 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f916e3-1e74-4e88-942d-9750cf03d07e None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:04.481994 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f916e3-1e74-4e88-942d-9750cf03d07e None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:04.482278 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f916e3-1e74-4e88-942d-9750cf03d07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:04.543829 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-e5f916e3-1e74-4e88-942d-9750cf03d07e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:04.549732 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-e5f916e3-1e74-4e88-942d-9750cf03d07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:04.708782 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff3950-bec8-438b-b579-19892fbc3ea4 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:04.710091 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff3950-bec8-438b-b579-19892fbc3ea4 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:04.712621 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff3950-bec8-438b-b579-19892fbc3ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:04.789626 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-a1ff3950-bec8-438b-b579-19892fbc3ea4 None None] MFA Rules not processed for user `591d508a3867412fac76d00134e58864`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:04.797411 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a1ff3950-bec8-438b-b579-19892fbc3ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:04.846944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 816/1639] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:04 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:04.980482 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 824/1640] 10.222.0.96 () {58 vars in 1009 bytes} [Fri Jan 28 01:57:04 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:04.983434 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f916e3-1e74-4e88-942d-9750cf03d07e None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:04.985797 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-e5f916e3-1e74-4e88-942d-9750cf03d07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:05.094310 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f916e3-1e74-4e88-942d-9750cf03d07e None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:05.098466 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e719e-5b3b-4819-89f0-b10415679fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:05.100037 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e719e-5b3b-4819-89f0-b10415679fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:05.100911 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e719e-5b3b-4819-89f0-b10415679fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:05.101742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e719e-5b3b-4819-89f0-b10415679fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:05.115745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e719e-5b3b-4819-89f0-b10415679fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:05.117511 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e719e-5b3b-4819-89f0-b10415679fb3 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:05.143957 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 817/1641] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:04 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:05.435129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff3950-bec8-438b-b579-19892fbc3ea4 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:05.438746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a1ff3950-bec8-438b-b579-19892fbc3ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:05.516326 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e719e-5b3b-4819-89f0-b10415679fb3 service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:05.519928 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-428e719e-5b3b-4819-89f0-b10415679fb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:05.569699 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e719e-5b3b-4819-89f0-b10415679fb3 service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:05.585343 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e932366-8a9f-45e8-898e-1cb8d5b2f63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:05.586317 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e932366-8a9f-45e8-898e-1cb8d5b2f63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:05.586843 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e932366-8a9f-45e8-898e-1cb8d5b2f63e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:05.587327 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e932366-8a9f-45e8-898e-1cb8d5b2f63e admin admin] PATH_INFO: `/v3/users/0f4d9ffbb8bb4c67b7d6c3f74ad3c137` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:05.595018 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e932366-8a9f-45e8-898e-1cb8d5b2f63e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f4d9ffbb8bb4c67b7d6c3f74ad3c137)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:05.597803 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e932366-8a9f-45e8-898e-1cb8d5b2f63e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:05.639837 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff3950-bec8-438b-b579-19892fbc3ea4 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:05.655187 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1f857-e23e-4fb3-8c8d-2b1251f1c630 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a2c3b2815f46b0ac27944f004c4821', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:05.656920 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1f857-e23e-4fb3-8c8d-2b1251f1c630 service swift] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:05.657262 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1f857-e23e-4fb3-8c8d-2b1251f1c630 service swift] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:05.657564 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1f857-e23e-4fb3-8c8d-2b1251f1c630 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:05.682171 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1f857-e23e-4fb3-8c8d-2b1251f1c630 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:05.683893 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1f857-e23e-4fb3-8c8d-2b1251f1c630 service swift] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:05.706199 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 825/1642] 10.222.0.96 () {60 vars in 1384 bytes} [Fri Jan 28 01:57:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:57:05.745048 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6e932366-8a9f-45e8-898e-1cb8d5b2f63e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f4d9ffbb8bb4c67b7d6c3f74ad3c137'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:05.747180 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6e932366-8a9f-45e8-898e-1cb8d5b2f63e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f4d9ffbb8bb4c67b7d6c3f74ad3c137'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:05.763131 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6e932366-8a9f-45e8-898e-1cb8d5b2f63e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f4d9ffbb8bb4c67b7d6c3f74ad3c137'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:05.791901 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6e932366-8a9f-45e8-898e-1cb8d5b2f63e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f4d9ffbb8bb4c67b7d6c3f74ad3c137'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:05.896673 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6e932366-8a9f-45e8-898e-1cb8d5b2f63e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f4d9ffbb8bb4c67b7d6c3f74ad3c137'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:05.931268 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 818/1643] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:05 2022] DELETE /identity/v3/users/0f4d9ffbb8bb4c67b7d6c3f74ad3c137 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:57:05.937393 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990d7a9-a775-476e-8ef2-df6df1cbe174 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:05.954846 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990d7a9-a775-476e-8ef2-df6df1cbe174 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:05.955408 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990d7a9-a775-476e-8ef2-df6df1cbe174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:06.000370 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-6990d7a9-a775-476e-8ef2-df6df1cbe174 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:06.002481 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-6990d7a9-a775-476e-8ef2-df6df1cbe174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:06.125550 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 826/1644] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:05 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:06.173295 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e932366-8a9f-45e8-898e-1cb8d5b2f63e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:06.176054 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-6e932366-8a9f-45e8-898e-1cb8d5b2f63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:06.323455 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e932366-8a9f-45e8-898e-1cb8d5b2f63e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:06.330236 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cd5ae-2eaa-4cf0-9173-0a60a43b9d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:06.330952 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cd5ae-2eaa-4cf0-9173-0a60a43b9d3f service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:06.331290 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cd5ae-2eaa-4cf0-9173-0a60a43b9d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:06.331646 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cd5ae-2eaa-4cf0-9173-0a60a43b9d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:06.349964 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cd5ae-2eaa-4cf0-9173-0a60a43b9d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:06.351651 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cd5ae-2eaa-4cf0-9173-0a60a43b9d3f service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:06.367984 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 819/1645] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:06 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:06.683176 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e3105-e8b7-4884-8de4-11d6372fcbb1 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:06.683651 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e3105-e8b7-4884-8de4-11d6372fcbb1 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:06.683651 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e3105-e8b7-4884-8de4-11d6372fcbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:06.719907 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-879e3105-e8b7-4884-8de4-11d6372fcbb1 None None] MFA Rules not processed for user `c34c05b7e55447f2a5ddf9c9b9299f44`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:06.721613 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-879e3105-e8b7-4884-8de4-11d6372fcbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:06.817623 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cd5ae-2eaa-4cf0-9173-0a60a43b9d3f service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:06.819708 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-be0cd5ae-2eaa-4cf0-9173-0a60a43b9d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:06.857788 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cd5ae-2eaa-4cf0-9173-0a60a43b9d3f service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:06.858000 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 827/1646] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:06 2022] POST /identity/v3/auth/tokens => generated 3409 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:06.879663 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4abc3d-d9b2-454f-969e-c3f324b12288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:06.881093 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4abc3d-d9b2-454f-969e-c3f324b12288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:06.881633 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4abc3d-d9b2-454f-969e-c3f324b12288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:06.882118 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4abc3d-d9b2-454f-969e-c3f324b12288 admin admin] PATH_INFO: `/v3/projects/4a39221aba25449d94ba3646b857c9ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:06.886310 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4abc3d-d9b2-454f-969e-c3f324b12288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a39221aba25449d94ba3646b857c9ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:06.888665 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4abc3d-d9b2-454f-969e-c3f324b12288 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:06.970226 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-bf4abc3d-d9b2-454f-969e-c3f324b12288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a39221aba25449d94ba3646b857c9ac', 'request_id': 'req-bf4abc3d-d9b2-454f-969e-c3f324b12288'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:06.985076 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-bf4abc3d-d9b2-454f-969e-c3f324b12288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a39221aba25449d94ba3646b857c9ac', 'request_id': 'req-bf4abc3d-d9b2-454f-969e-c3f324b12288'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:06.991596 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-bf4abc3d-d9b2-454f-969e-c3f324b12288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a39221aba25449d94ba3646b857c9ac', 'request_id': 'req-bf4abc3d-d9b2-454f-969e-c3f324b12288'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:07.017396 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-bf4abc3d-d9b2-454f-969e-c3f324b12288 admin admin] The token cache is being invalidate because project 4a39221aba25449d94ba3646b857c9ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:07.017890 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-bf4abc3d-d9b2-454f-969e-c3f324b12288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:07.018943 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-bf4abc3d-d9b2-454f-969e-c3f324b12288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:07.021026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 820/1647] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:06 2022] DELETE /identity/v3/projects/4a39221aba25449d94ba3646b857c9ac => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:57:07.030998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75910b2d-5970-402c-af06-fb3659a1ef14 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:07.031691 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75910b2d-5970-402c-af06-fb3659a1ef14 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:07.032213 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75910b2d-5970-402c-af06-fb3659a1ef14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:07.061500 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-75910b2d-5970-402c-af06-fb3659a1ef14 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:07.064398 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-75910b2d-5970-402c-af06-fb3659a1ef14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:07.141314 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4abc3d-d9b2-454f-969e-c3f324b12288 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:07.151387 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-bf4abc3d-d9b2-454f-969e-c3f324b12288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:07.293623 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 828/1648] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:07 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:07.301405 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d8ab-4b2d-4ee0-a35e-9357d8058161 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:07.302747 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d8ab-4b2d-4ee0-a35e-9357d8058161 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:07.304269 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d8ab-4b2d-4ee0-a35e-9357d8058161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:07.372001 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-54c0d8ab-4b2d-4ee0-a35e-9357d8058161 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:07.374109 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-54c0d8ab-4b2d-4ee0-a35e-9357d8058161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:07.379885 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4abc3d-d9b2-454f-969e-c3f324b12288 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:07.387097 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2073d-8118-46d2-a39c-305426671b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:07.388531 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2073d-8118-46d2-a39c-305426671b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:07.389037 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2073d-8118-46d2-a39c-305426671b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:07.389464 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2073d-8118-46d2-a39c-305426671b9b admin admin] PATH_INFO: `/v3/projects/e853f04a46b14da0837e79a2bfe4c971` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:07.391454 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2073d-8118-46d2-a39c-305426671b9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e853f04a46b14da0837e79a2bfe4c971)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:07.393864 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2073d-8118-46d2-a39c-305426671b9b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:07.430533 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 829/1649] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:07 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:07.432677 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0d8ab-4b2d-4ee0-a35e-9357d8058161 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:07.446312 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-54c0d8ab-4b2d-4ee0-a35e-9357d8058161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:07.462657 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0d8ab-4b2d-4ee0-a35e-9357d8058161 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:07.481218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a3e2073d-8118-46d2-a39c-305426671b9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e853f04a46b14da0837e79a2bfe4c971', 'request_id': 'req-a3e2073d-8118-46d2-a39c-305426671b9b'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:07.493834 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a3e2073d-8118-46d2-a39c-305426671b9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e853f04a46b14da0837e79a2bfe4c971', 'request_id': 'req-a3e2073d-8118-46d2-a39c-305426671b9b'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:07.503354 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a3e2073d-8118-46d2-a39c-305426671b9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e853f04a46b14da0837e79a2bfe4c971', 'request_id': 'req-a3e2073d-8118-46d2-a39c-305426671b9b'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:07.524516 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a3e2073d-8118-46d2-a39c-305426671b9b admin admin] The token cache is being invalidate because project e853f04a46b14da0837e79a2bfe4c971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:07.525304 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a3e2073d-8118-46d2-a39c-305426671b9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:07.526931 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a3e2073d-8118-46d2-a39c-305426671b9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:07.543244 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 821/1650] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:07 2022] DELETE /identity/v3/projects/e853f04a46b14da0837e79a2bfe4c971 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:07.555087 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2073d-8118-46d2-a39c-305426671b9b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:07.556852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8500c-9f04-4ab7-82b3-1101f28142c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:07.557553 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-a3e2073d-8118-46d2-a39c-305426671b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:07.557899 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8500c-9f04-4ab7-82b3-1101f28142c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:07.558184 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8500c-9f04-4ab7-82b3-1101f28142c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:07.558605 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8500c-9f04-4ab7-82b3-1101f28142c0 admin admin] PATH_INFO: `/v3/projects/bc2f6f78fa7d4ad89b4965d6823e3437` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:07.559995 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8500c-9f04-4ab7-82b3-1101f28142c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc2f6f78fa7d4ad89b4965d6823e3437)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:07.562815 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8500c-9f04-4ab7-82b3-1101f28142c0 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:07.575069 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2073d-8118-46d2-a39c-305426671b9b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:07.581994 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74dd7e-d980-4ba2-8c5e-5ffcade7a0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:07.582991 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74dd7e-d980-4ba2-8c5e-5ffcade7a0ab admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:07.583459 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74dd7e-d980-4ba2-8c5e-5ffcade7a0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:07.584073 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74dd7e-d980-4ba2-8c5e-5ffcade7a0ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:07.585267 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74dd7e-d980-4ba2-8c5e-5ffcade7a0ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:07.585993 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74dd7e-d980-4ba2-8c5e-5ffcade7a0ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:07.589187 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74dd7e-d980-4ba2-8c5e-5ffcade7a0ab admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:07.606012 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 822/1651] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:07.608188 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8825b6d-eeae-4f36-98cb-4a9e6cc28d56 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:07.609443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8825b6d-eeae-4f36-98cb-4a9e6cc28d56 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:07.609982 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8825b6d-eeae-4f36-98cb-4a9e6cc28d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:07.627019 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-39f8500c-9f04-4ab7-82b3-1101f28142c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc2f6f78fa7d4ad89b4965d6823e3437', 'request_id': 'req-39f8500c-9f04-4ab7-82b3-1101f28142c0'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:07.632091 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-f8825b6d-eeae-4f36-98cb-4a9e6cc28d56 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:07.633399 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-f8825b6d-eeae-4f36-98cb-4a9e6cc28d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:07.634805 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-39f8500c-9f04-4ab7-82b3-1101f28142c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc2f6f78fa7d4ad89b4965d6823e3437', 'request_id': 'req-39f8500c-9f04-4ab7-82b3-1101f28142c0'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:07.643204 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-39f8500c-9f04-4ab7-82b3-1101f28142c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc2f6f78fa7d4ad89b4965d6823e3437', 'request_id': 'req-39f8500c-9f04-4ab7-82b3-1101f28142c0'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:07.663102 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-39f8500c-9f04-4ab7-82b3-1101f28142c0 admin admin] The token cache is being invalidate because project bc2f6f78fa7d4ad89b4965d6823e3437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:07.663708 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-39f8500c-9f04-4ab7-82b3-1101f28142c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:07.664582 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-39f8500c-9f04-4ab7-82b3-1101f28142c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:07.667035 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 830/1652] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:07 2022] DELETE /identity/v3/projects/bc2f6f78fa7d4ad89b4965d6823e3437 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:07.668009 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8500c-9f04-4ab7-82b3-1101f28142c0 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:07.669624 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-39f8500c-9f04-4ab7-82b3-1101f28142c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:07.757028 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 823/1653] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:07 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:07.757028 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5813022-4470-4376-9f15-56cc14fa4969 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:07.757028 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5813022-4470-4376-9f15-56cc14fa4969 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:07.757817 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5813022-4470-4376-9f15-56cc14fa4969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:07.776973 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8500c-9f04-4ab7-82b3-1101f28142c0 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:07.784470 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc689f6-6d0f-4b33-902b-cc9dc0702bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:07.785296 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc689f6-6d0f-4b33-902b-cc9dc0702bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:07.785666 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc689f6-6d0f-4b33-902b-cc9dc0702bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:07.785970 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc689f6-6d0f-4b33-902b-cc9dc0702bf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:07.786840 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc689f6-6d0f-4b33-902b-cc9dc0702bf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:07.787694 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-c5813022-4470-4376-9f15-56cc14fa4969 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:07.789189 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c5813022-4470-4376-9f15-56cc14fa4969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:07.789535 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc689f6-6d0f-4b33-902b-cc9dc0702bf3 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:07.800274 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 824/1654] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:07 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:07.801979 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce510634-df9c-4e53-b4fb-dfb1d54c4609 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:07.802451 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce510634-df9c-4e53-b4fb-dfb1d54c4609 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:07.802850 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce510634-df9c-4e53-b4fb-dfb1d54c4609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:07.838626 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-ce510634-df9c-4e53-b4fb-dfb1d54c4609 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:07.841614 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ce510634-df9c-4e53-b4fb-dfb1d54c4609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:07.844767 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 831/1655] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:07 2022] POST /identity/v3/projects => generated 407 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:07.846737 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67181182-197e-4f21-9d78-f78ae763d330 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:07.847167 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67181182-197e-4f21-9d78-f78ae763d330 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:07.847464 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67181182-197e-4f21-9d78-f78ae763d330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:07.870281 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-67181182-197e-4f21-9d78-f78ae763d330 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:07.871639 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-67181182-197e-4f21-9d78-f78ae763d330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:07.946663 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 825/1656] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:07 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:07.947904 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce510634-df9c-4e53-b4fb-dfb1d54c4609 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:07.964492 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce510634-df9c-4e53-b4fb-dfb1d54c4609 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:07.975280 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e52d89-f704-4f15-933f-453ae20e9b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:07.975926 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 832/1657] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:07 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:07.976481 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67181182-197e-4f21-9d78-f78ae763d330 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:07.977223 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e52d89-f704-4f15-933f-453ae20e9b43 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:07.977578 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e52d89-f704-4f15-933f-453ae20e9b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:07.977966 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e52d89-f704-4f15-933f-453ae20e9b43 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:07.979077 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e52d89-f704-4f15-933f-453ae20e9b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:07.981291 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e52d89-f704-4f15-933f-453ae20e9b43 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:07.993189 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67181182-197e-4f21-9d78-f78ae763d330 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:08.001551 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331797f-aeee-4b22-bc3d-ab606a9ab14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:08.002252 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331797f-aeee-4b22-bc3d-ab606a9ab14c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:08.002598 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331797f-aeee-4b22-bc3d-ab606a9ab14c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:08.002981 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331797f-aeee-4b22-bc3d-ab606a9ab14c admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:08.004156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331797f-aeee-4b22-bc3d-ab606a9ab14c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:08.004397 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331797f-aeee-4b22-bc3d-ab606a9ab14c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:08.006559 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331797f-aeee-4b22-bc3d-ab606a9ab14c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:08.013070 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 826/1658] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:07 2022] POST /identity/v3/users => generated 304 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:08.014168 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e52d89-f704-4f15-933f-453ae20e9b43 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:08.029841 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e52d89-f704-4f15-933f-453ae20e9b43 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:08.030192 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 833/1659] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:08.030192 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331797f-aeee-4b22-bc3d-ab606a9ab14c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:08.031927 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d4e07-e515-43dc-9f0f-26b7857cce12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:08.032692 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d4e07-e515-43dc-9f0f-26b7857cce12 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:08.033113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d4e07-e515-43dc-9f0f-26b7857cce12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:08.034122 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d4e07-e515-43dc-9f0f-26b7857cce12 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:08.034245 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d4e07-e515-43dc-9f0f-26b7857cce12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:08.034654 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d4e07-e515-43dc-9f0f-26b7857cce12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:08.036502 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d4e07-e515-43dc-9f0f-26b7857cce12 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:08.049384 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331797f-aeee-4b22-bc3d-ab606a9ab14c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:08.051125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 827/1660] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:08.052013 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d4e07-e515-43dc-9f0f-26b7857cce12 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:08.055199 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf829275-1816-4ee1-be2c-8a97bcfc1b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:08.055952 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf829275-1816-4ee1-be2c-8a97bcfc1b0d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:08.056325 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf829275-1816-4ee1-be2c-8a97bcfc1b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:08.056670 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf829275-1816-4ee1-be2c-8a97bcfc1b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:08.057531 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf829275-1816-4ee1-be2c-8a97bcfc1b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:08.059228 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf829275-1816-4ee1-be2c-8a97bcfc1b0d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:08.062992 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d4e07-e515-43dc-9f0f-26b7857cce12 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:08.068292 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f824d-86ce-47be-b0ff-5698ee06dd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:08.069078 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f824d-86ce-47be-b0ff-5698ee06dd04 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:08.069430 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f824d-86ce-47be-b0ff-5698ee06dd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:08.069834 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f824d-86ce-47be-b0ff-5698ee06dd04 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:08.070598 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f824d-86ce-47be-b0ff-5698ee06dd04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:08.072554 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f824d-86ce-47be-b0ff-5698ee06dd04 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:08.077404 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 834/1661] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:08.078737 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf829275-1816-4ee1-be2c-8a97bcfc1b0d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:08.090148 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf829275-1816-4ee1-be2c-8a97bcfc1b0d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:08.098840 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f75ed-63ff-4aac-8628-d0ca07c9e6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:08.100767 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f75ed-63ff-4aac-8628-d0ca07c9e6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:08.101698 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f75ed-63ff-4aac-8628-d0ca07c9e6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:08.102384 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f75ed-63ff-4aac-8628-d0ca07c9e6d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:08.104287 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f75ed-63ff-4aac-8628-d0ca07c9e6d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:08.109592 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f75ed-63ff-4aac-8628-d0ca07c9e6d0 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:08.121202 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 828/1662] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:08 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:08.122641 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f824d-86ce-47be-b0ff-5698ee06dd04 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:08.161303 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 835/1663] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:08 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:08.162483 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f75ed-63ff-4aac-8628-d0ca07c9e6d0 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:08.222606 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f824d-86ce-47be-b0ff-5698ee06dd04 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:08.247691 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f75ed-63ff-4aac-8628-d0ca07c9e6d0 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:08.254106 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b6a55-fe05-4b04-bced-7f6349450075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:08.254828 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6a55-fe05-4b04-bced-7f6349450075 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:08.255165 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6a55-fe05-4b04-bced-7f6349450075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:08.255465 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6a55-fe05-4b04-bced-7f6349450075 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:08.256161 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b6a55-fe05-4b04-bced-7f6349450075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:08.258272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b6a55-fe05-4b04-bced-7f6349450075 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:08.289272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 836/1664] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:08 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:08.290276 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b6a55-fe05-4b04-bced-7f6349450075 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:08.302515 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5a8a6-e1fb-4855-a1fc-0ce7e81da650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:08.303290 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5a8a6-e1fb-4855-a1fc-0ce7e81da650 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:08.304499 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5a8a6-e1fb-4855-a1fc-0ce7e81da650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:08.304499 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5a8a6-e1fb-4855-a1fc-0ce7e81da650 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:08.304739 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b6a55-fe05-4b04-bced-7f6349450075 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:08.311385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932a0b3-88e7-4a26-bbf3-3ffaa74eb1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:08.313150 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932a0b3-88e7-4a26-bbf3-3ffaa74eb1ce admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:08.313384 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932a0b3-88e7-4a26-bbf3-3ffaa74eb1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:08.313705 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932a0b3-88e7-4a26-bbf3-3ffaa74eb1ce admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:08.314468 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932a0b3-88e7-4a26-bbf3-3ffaa74eb1ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:08.316719 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932a0b3-88e7-4a26-bbf3-3ffaa74eb1ce admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:08.330104 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5a8a6-e1fb-4855-a1fc-0ce7e81da650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:08.331699 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5a8a6-e1fb-4855-a1fc-0ce7e81da650 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:08.353431 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 829/1665] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:08.354679 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5a8a6-e1fb-4855-a1fc-0ce7e81da650 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:08.361439 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 837/1666] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:08 2022] POST /identity/v3/users => generated 283 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:08.361439 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932a0b3-88e7-4a26-bbf3-3ffaa74eb1ce admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:08.382126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932a0b3-88e7-4a26-bbf3-3ffaa74eb1ce admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:08.388421 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad9862-7ed3-4599-a320-fb95b00d5f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:08.389557 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad9862-7ed3-4599-a320-fb95b00d5f71 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:08.390417 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad9862-7ed3-4599-a320-fb95b00d5f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:08.391081 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad9862-7ed3-4599-a320-fb95b00d5f71 admin admin] PATH_INFO: `/v3/projects/23d9dfd720874aef9604f70a32c61bea/users/f5bd37f7714a4d03a46e7ac3fe6406d7/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:08.393152 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5a8a6-e1fb-4855-a1fc-0ce7e81da650 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:08.412010 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcb97d-c4da-4b85-954f-057bed84d1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:08.413676 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcb97d-c4da-4b85-954f-057bed84d1cc admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:08.415059 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcb97d-c4da-4b85-954f-057bed84d1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:08.415848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcb97d-c4da-4b85-954f-057bed84d1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:08.418400 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad9862-7ed3-4599-a320-fb95b00d5f71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d9dfd720874aef9604f70a32c61bea, user_id=f5bd37f7714a4d03a46e7ac3fe6406d7, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:08.418772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcb97d-c4da-4b85-954f-057bed84d1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:08.425643 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcb97d-c4da-4b85-954f-057bed84d1cc admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:08.427348 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad9862-7ed3-4599-a320-fb95b00d5f71 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:08.467462 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 830/1667] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:08.470589 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcb97d-c4da-4b85-954f-057bed84d1cc admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:08.472504 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 838/1668] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:08 2022] PUT /identity/v3/projects/23d9dfd720874aef9604f70a32c61bea/users/f5bd37f7714a4d03a46e7ac3fe6406d7/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:08.473592 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad9862-7ed3-4599-a320-fb95b00d5f71 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:08.521647 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcb97d-c4da-4b85-954f-057bed84d1cc admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:08.651546 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad9862-7ed3-4599-a320-fb95b00d5f71 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:08.654873 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e74cb-cbc7-4703-b188-17d0e3849944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:08.655842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e74cb-cbc7-4703-b188-17d0e3849944 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:08.656126 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e74cb-cbc7-4703-b188-17d0e3849944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:08.656403 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e74cb-cbc7-4703-b188-17d0e3849944 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:08.657187 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e74cb-cbc7-4703-b188-17d0e3849944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:08.660233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e74cb-cbc7-4703-b188-17d0e3849944 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:08.667661 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3765b-c9e1-4156-8f78-05f9d6fb127e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:08.669363 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3765b-c9e1-4156-8f78-05f9d6fb127e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:08.670102 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3765b-c9e1-4156-8f78-05f9d6fb127e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:08.670382 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3765b-c9e1-4156-8f78-05f9d6fb127e admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:08.671707 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3765b-c9e1-4156-8f78-05f9d6fb127e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:08.673852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3765b-c9e1-4156-8f78-05f9d6fb127e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:08.692860 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 831/1669] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:08.693323 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b4a2f-9973-4bf9-b3df-38a81f4e1a28 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:08.693933 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b4a2f-9973-4bf9-b3df-38a81f4e1a28 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:08.694489 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b4a2f-9973-4bf9-b3df-38a81f4e1a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:08.709014 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 839/1670] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:08.710067 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3765b-c9e1-4156-8f78-05f9d6fb127e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:08.736314 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3765b-c9e1-4156-8f78-05f9d6fb127e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:08.737963 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-a56b4a2f-9973-4bf9-b3df-38a81f4e1a28 None None] MFA Rules not processed for user `f5bd37f7714a4d03a46e7ac3fe6406d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:08.752335 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-a56b4a2f-9973-4bf9-b3df-38a81f4e1a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:08.753462 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58036186-931f-4ce0-ae83-c6900d12e2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:08.754390 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58036186-931f-4ce0-ae83-c6900d12e2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:08.754859 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58036186-931f-4ce0-ae83-c6900d12e2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:08.755337 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58036186-931f-4ce0-ae83-c6900d12e2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:08.756358 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58036186-931f-4ce0-ae83-c6900d12e2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:08.758695 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58036186-931f-4ce0-ae83-c6900d12e2d2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:08.816839 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 840/1671] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:08.820001 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58036186-931f-4ce0-ae83-c6900d12e2d2 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:08.844910 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58036186-931f-4ce0-ae83-c6900d12e2d2 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:08.862442 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e9c1d-e702-4139-85bf-d51441e64bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:08.863885 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e9c1d-e702-4139-85bf-d51441e64bff admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:08.864331 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e9c1d-e702-4139-85bf-d51441e64bff admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:08.864712 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e9c1d-e702-4139-85bf-d51441e64bff admin admin] PATH_INFO: `/v3/projects/70b0420870344caea06ecd7fa5412281/users/4258536cb5954dd4a49800a5c2f7f356/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:08.882244 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 832/1672] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:08 2022] POST /identity/v3/auth/tokens => generated 3427 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:08.883378 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b4a2f-9973-4bf9-b3df-38a81f4e1a28 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:08.899935 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e9c1d-e702-4139-85bf-d51441e64bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b0420870344caea06ecd7fa5412281, user_id=4258536cb5954dd4a49800a5c2f7f356, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:08.904121 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e9c1d-e702-4139-85bf-d51441e64bff admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:08.908060 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b4a2f-9973-4bf9-b3df-38a81f4e1a28 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:08.922824 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cb7d6-11cf-48c9-a7b3-7b2be930cdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:08.923634 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cb7d6-11cf-48c9-a7b3-7b2be930cdb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:08.924095 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cb7d6-11cf-48c9-a7b3-7b2be930cdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:08.924370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cb7d6-11cf-48c9-a7b3-7b2be930cdb4 admin admin] PATH_INFO: `/v3/projects/3409056a152d4abb8a9dc5166eea70e1/users/4b0a04fce1ca4d20b942592bff39cf7c/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:08.925961 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 841/1673] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:08 2022] PUT /identity/v3/projects/70b0420870344caea06ecd7fa5412281/users/4258536cb5954dd4a49800a5c2f7f356/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:08.926910 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e9c1d-e702-4139-85bf-d51441e64bff admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:08.985662 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cb7d6-11cf-48c9-a7b3-7b2be930cdb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3409056a152d4abb8a9dc5166eea70e1, user_id=4b0a04fce1ca4d20b942592bff39cf7c, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:08.988381 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cb7d6-11cf-48c9-a7b3-7b2be930cdb4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:09.008788 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e9c1d-e702-4139-85bf-d51441e64bff admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:09.019168 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e8293-2dc3-410e-a5f6-27ffc5e1f7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:09.021191 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e8293-2dc3-410e-a5f6-27ffc5e1f7c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:09.022765 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e8293-2dc3-410e-a5f6-27ffc5e1f7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:09.023190 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e8293-2dc3-410e-a5f6-27ffc5e1f7c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:09.024506 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e8293-2dc3-410e-a5f6-27ffc5e1f7c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:09.028213 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e8293-2dc3-410e-a5f6-27ffc5e1f7c0 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:09.029272 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 833/1674] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:08 2022] PUT /identity/v3/projects/3409056a152d4abb8a9dc5166eea70e1/users/4b0a04fce1ca4d20b942592bff39cf7c/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:09.038757 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a9397-b19a-42b3-8a6e-97e891d0db72 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:09.039040 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a9397-b19a-42b3-8a6e-97e891d0db72 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:09.039314 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a9397-b19a-42b3-8a6e-97e891d0db72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:09.075594 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 842/1675] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:08 2022] POST /identity/v3/projects => generated 409 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:09.077979 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec276639-b754-4eda-8bce-95d470d12ff0 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:09.078278 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec276639-b754-4eda-8bce-95d470d12ff0 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:09.078611 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec276639-b754-4eda-8bce-95d470d12ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:09.108881 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-ec276639-b754-4eda-8bce-95d470d12ff0 None None] MFA Rules not processed for user `4acc32735f0a418ba5620f6225500402`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:09.110524 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-ec276639-b754-4eda-8bce-95d470d12ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:09.171923 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-bc9a9397-b19a-42b3-8a6e-97e891d0db72 None None] MFA Rules not processed for user `4258536cb5954dd4a49800a5c2f7f356`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:09.173493 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-bc9a9397-b19a-42b3-8a6e-97e891d0db72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:09.320965 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 843/1676] 10.222.0.100 () {58 vars in 1016 bytes} [Fri Jan 28 01:57:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:09.329013 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f805bb-d742-44da-add8-99215bea4fdc None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:09.329857 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f805bb-d742-44da-add8-99215bea4fdc None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:09.331181 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f805bb-d742-44da-add8-99215bea4fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:09.379579 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 834/1677] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:09 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:09.388291 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a9397-b19a-42b3-8a6e-97e891d0db72 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:09.444433 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-28f805bb-d742-44da-add8-99215bea4fdc None None] MFA Rules not processed for user `4b0a04fce1ca4d20b942592bff39cf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:09.453334 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-28f805bb-d742-44da-add8-99215bea4fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:09.694757 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a9397-b19a-42b3-8a6e-97e891d0db72 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:09.727995 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee17407-7348-4b83-8791-cbde540e0f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:09.728923 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee17407-7348-4b83-8791-cbde540e0f53 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:09.729358 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee17407-7348-4b83-8791-cbde540e0f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:09.729779 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee17407-7348-4b83-8791-cbde540e0f53 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:09.730620 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee17407-7348-4b83-8791-cbde540e0f53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:09.732706 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee17407-7348-4b83-8791-cbde540e0f53 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:09.748977 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 844/1678] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:09 2022] POST /identity/v3/auth/tokens => generated 3385 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:09.753645 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f805bb-d742-44da-add8-99215bea4fdc None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:09.756060 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-28f805bb-d742-44da-add8-99215bea4fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:09.769531 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f805bb-d742-44da-add8-99215bea4fdc None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:09.783534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee1a44-bc8c-458e-8ddc-eec2d48900d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:09.787967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee1a44-bc8c-458e-8ddc-eec2d48900d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:09.788321 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee1a44-bc8c-458e-8ddc-eec2d48900d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:09.790085 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 835/1679] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:09 2022] POST /identity/v3/users => generated 311 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:09.790229 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee1a44-bc8c-458e-8ddc-eec2d48900d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:09.791665 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee17407-7348-4b83-8791-cbde540e0f53 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:09.808609 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee1a44-bc8c-458e-8ddc-eec2d48900d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:09.810136 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee1a44-bc8c-458e-8ddc-eec2d48900d0 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:09.868912 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee17407-7348-4b83-8791-cbde540e0f53 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:09.884441 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 845/1680] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:09.885478 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee1a44-bc8c-458e-8ddc-eec2d48900d0 service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:09.890401 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b713ae5-9868-4942-ba95-acc0e3c5fcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:09.894852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b713ae5-9868-4942-ba95-acc0e3c5fcdd admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:09.895241 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b713ae5-9868-4942-ba95-acc0e3c5fcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:09.895557 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b713ae5-9868-4942-ba95-acc0e3c5fcdd admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:09.896328 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b713ae5-9868-4942-ba95-acc0e3c5fcdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:09.898983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b713ae5-9868-4942-ba95-acc0e3c5fcdd admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:09.926092 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee1a44-bc8c-458e-8ddc-eec2d48900d0 service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:09.934172 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15571e76-6c33-4c91-9bbd-1861affe547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:09.934904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15571e76-6c33-4c91-9bbd-1861affe547d admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:09.935283 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15571e76-6c33-4c91-9bbd-1861affe547d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:09.935544 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15571e76-6c33-4c91-9bbd-1861affe547d admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:09.936415 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15571e76-6c33-4c91-9bbd-1861affe547d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:09.940555 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15571e76-6c33-4c91-9bbd-1861affe547d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:09.996863 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 846/1681] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:09 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:09.999144 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15571e76-6c33-4c91-9bbd-1861affe547d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:10.001467 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 836/1682] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:09 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:10.002450 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b713ae5-9868-4942-ba95-acc0e3c5fcdd admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:10.144468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b713ae5-9868-4942-ba95-acc0e3c5fcdd admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:10.169427 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dc0c8-96e8-407c-b87d-635eb8b6fed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:10.170469 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dc0c8-96e8-407c-b87d-635eb8b6fed1 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:10.170849 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dc0c8-96e8-407c-b87d-635eb8b6fed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:10.171757 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dc0c8-96e8-407c-b87d-635eb8b6fed1 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:10.173156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dc0c8-96e8-407c-b87d-635eb8b6fed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:10.175678 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dc0c8-96e8-407c-b87d-635eb8b6fed1 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:10.214748 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 837/1683] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:10 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:10.214748 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dc0c8-96e8-407c-b87d-635eb8b6fed1 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:10.229742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dc0c8-96e8-407c-b87d-635eb8b6fed1 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:10.237297 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15571e76-6c33-4c91-9bbd-1861affe547d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:10.252467 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf3dad-a1d5-4245-89e9-6d055de0c2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:10.252946 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200b778-3424-45c8-8714-807ea9603e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:10.254025 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200b778-3424-45c8-8714-807ea9603e09 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:10.254025 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200b778-3424-45c8-8714-807ea9603e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:10.254437 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200b778-3424-45c8-8714-807ea9603e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:10.255444 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200b778-3424-45c8-8714-807ea9603e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:10.255967 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf3dad-a1d5-4245-89e9-6d055de0c2d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:10.256587 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf3dad-a1d5-4245-89e9-6d055de0c2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:10.257291 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf3dad-a1d5-4245-89e9-6d055de0c2d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:10.260365 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf3dad-a1d5-4245-89e9-6d055de0c2d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:10.261684 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200b778-3424-45c8-8714-807ea9603e09 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:10.268822 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf3dad-a1d5-4245-89e9-6d055de0c2d5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:10.286894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 847/1684] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:10.302479 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200b778-3424-45c8-8714-807ea9603e09 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:10.320944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 838/1685] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:10 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:10.320944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf3dad-a1d5-4245-89e9-6d055de0c2d5 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:10.336131 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200b778-3424-45c8-8714-807ea9603e09 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:10.350277 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf3dad-a1d5-4245-89e9-6d055de0c2d5 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:10.350891 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef3281-5926-4e4b-a287-fecf0ca246a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:10.351705 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef3281-5926-4e4b-a287-fecf0ca246a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:10.352292 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef3281-5926-4e4b-a287-fecf0ca246a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:10.352671 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef3281-5926-4e4b-a287-fecf0ca246a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:10.353621 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef3281-5926-4e4b-a287-fecf0ca246a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:10.355405 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef3281-5926-4e4b-a287-fecf0ca246a9 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:10.369492 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6837a97-27bd-43d0-96b1-35918096e011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:10.370595 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6837a97-27bd-43d0-96b1-35918096e011 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:10.370881 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6837a97-27bd-43d0-96b1-35918096e011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:10.371157 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6837a97-27bd-43d0-96b1-35918096e011 admin admin] PATH_INFO: `/v3/projects/9810917292df421aa3f771e37011131b/users/747178727b6943cca525880273fce974/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:10.374524 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 848/1686] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:10.375579 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef3281-5926-4e4b-a287-fecf0ca246a9 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:10.397573 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef3281-5926-4e4b-a287-fecf0ca246a9 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:10.406448 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6837a97-27bd-43d0-96b1-35918096e011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9810917292df421aa3f771e37011131b, user_id=747178727b6943cca525880273fce974, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:10.411770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6837a97-27bd-43d0-96b1-35918096e011 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:10.423626 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5428966-1fce-4f95-aaf2-6ae164284f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:10.424630 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5428966-1fce-4f95-aaf2-6ae164284f95 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:10.425103 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5428966-1fce-4f95-aaf2-6ae164284f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:10.425479 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5428966-1fce-4f95-aaf2-6ae164284f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:10.426513 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5428966-1fce-4f95-aaf2-6ae164284f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:10.428259 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5428966-1fce-4f95-aaf2-6ae164284f95 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:10.453700 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 849/1687] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:10.460222 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 839/1688] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:10 2022] PUT /identity/v3/projects/9810917292df421aa3f771e37011131b/users/747178727b6943cca525880273fce974/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:10.461246 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6837a97-27bd-43d0-96b1-35918096e011 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:10.464676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5428966-1fce-4f95-aaf2-6ae164284f95 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:10.508491 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5428966-1fce-4f95-aaf2-6ae164284f95 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:10.604662 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6837a97-27bd-43d0-96b1-35918096e011 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:10.610224 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5395c-90de-4433-8684-d35ad6117876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:10.611144 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4cae4-4419-45f8-8e50-97630e5c30bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:10.612241 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4cae4-4419-45f8-8e50-97630e5c30bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:10.613161 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4cae4-4419-45f8-8e50-97630e5c30bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:10.613762 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4cae4-4419-45f8-8e50-97630e5c30bd admin admin] PATH_INFO: `/v3/projects/c31d0e40cc9b491896c3646ee4fb116f/users/14961a444b5d4f369486d399e048f0fa/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:10.622811 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5395c-90de-4433-8684-d35ad6117876 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:10.623106 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5395c-90de-4433-8684-d35ad6117876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:10.623376 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5395c-90de-4433-8684-d35ad6117876 admin admin] PATH_INFO: `/v3/projects/fe18ac2508874f69919aa1d572a821f8/users/e7ec0e935b56471896b9eba15c34cfe2/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:10.635944 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4cae4-4419-45f8-8e50-97630e5c30bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31d0e40cc9b491896c3646ee4fb116f, user_id=14961a444b5d4f369486d399e048f0fa, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:10.638628 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4cae4-4419-45f8-8e50-97630e5c30bd admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:10.652369 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5395c-90de-4433-8684-d35ad6117876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe18ac2508874f69919aa1d572a821f8, user_id=e7ec0e935b56471896b9eba15c34cfe2, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:10.658930 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5395c-90de-4433-8684-d35ad6117876 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:10.680990 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 850/1689] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:10 2022] PUT /identity/v3/projects/c31d0e40cc9b491896c3646ee4fb116f/users/14961a444b5d4f369486d399e048f0fa/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:10.680990 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4cae4-4419-45f8-8e50-97630e5c30bd admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:10.709983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 840/1690] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:10 2022] PUT /identity/v3/projects/fe18ac2508874f69919aa1d572a821f8/users/e7ec0e935b56471896b9eba15c34cfe2/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:10.709983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5395c-90de-4433-8684-d35ad6117876 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:10.820440 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4cae4-4419-45f8-8e50-97630e5c30bd admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:10.833869 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc33975-b520-4950-ba24-56054d6b5b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:10.835354 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc33975-b520-4950-ba24-56054d6b5b40 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:10.835845 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc33975-b520-4950-ba24-56054d6b5b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:10.836302 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc33975-b520-4950-ba24-56054d6b5b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:10.838266 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc33975-b520-4950-ba24-56054d6b5b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:10.842180 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc33975-b520-4950-ba24-56054d6b5b40 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:10.847649 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5395c-90de-4433-8684-d35ad6117876 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:10.863417 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b42b7f-e0b9-4c7a-9198-5612f7035d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:10.864169 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b42b7f-e0b9-4c7a-9198-5612f7035d04 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:10.864443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b42b7f-e0b9-4c7a-9198-5612f7035d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:10.864709 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b42b7f-e0b9-4c7a-9198-5612f7035d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:10.865615 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b42b7f-e0b9-4c7a-9198-5612f7035d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:10.867221 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b42b7f-e0b9-4c7a-9198-5612f7035d04 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:10.887061 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 851/1691] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:10.889358 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc33975-b520-4950-ba24-56054d6b5b40 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:10.906591 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 841/1692] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:10.908112 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b42b7f-e0b9-4c7a-9198-5612f7035d04 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:10.920051 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc33975-b520-4950-ba24-56054d6b5b40 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:10.932666 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b42b7f-e0b9-4c7a-9198-5612f7035d04 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:10.948306 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0468dfc-28cc-4cb9-a2c4-c701037f43a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:10.950330 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0468dfc-28cc-4cb9-a2c4-c701037f43a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:10.950608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0468dfc-28cc-4cb9-a2c4-c701037f43a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:10.951653 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0468dfc-28cc-4cb9-a2c4-c701037f43a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:10.960957 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0468dfc-28cc-4cb9-a2c4-c701037f43a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:10.964957 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0468dfc-28cc-4cb9-a2c4-c701037f43a8 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:10.971592 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5ba2f-351c-442b-b3b6-243a77aa2ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:10.989132 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5ba2f-351c-442b-b3b6-243a77aa2ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:10.991948 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5ba2f-351c-442b-b3b6-243a77aa2ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:10.993780 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5ba2f-351c-442b-b3b6-243a77aa2ab1 admin admin] PATH_INFO: `/v3/projects/9810917292df421aa3f771e37011131b/users/747178727b6943cca525880273fce974/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:10.998829 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5ba2f-351c-442b-b3b6-243a77aa2ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9810917292df421aa3f771e37011131b, user_id=747178727b6943cca525880273fce974, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:11.003083 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5ba2f-351c-442b-b3b6-243a77aa2ab1 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:11.024865 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 852/1693] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:11.024865 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0468dfc-28cc-4cb9-a2c4-c701037f43a8 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:11.033213 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 842/1694] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:10 2022] PUT /identity/v3/projects/9810917292df421aa3f771e37011131b/users/747178727b6943cca525880273fce974/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:11.038374 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5ba2f-351c-442b-b3b6-243a77aa2ab1 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:11.050198 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0468dfc-28cc-4cb9-a2c4-c701037f43a8 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:11.157608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d0f3e-fc6d-4947-94a1-f8d58a356fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:11.158953 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d0f3e-fc6d-4947-94a1-f8d58a356fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:11.159393 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d0f3e-fc6d-4947-94a1-f8d58a356fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:11.159821 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d0f3e-fc6d-4947-94a1-f8d58a356fa8 admin admin] PATH_INFO: `/v3/projects/c31d0e40cc9b491896c3646ee4fb116f/users/14961a444b5d4f369486d399e048f0fa/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:11.162138 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d0f3e-fc6d-4947-94a1-f8d58a356fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31d0e40cc9b491896c3646ee4fb116f, user_id=14961a444b5d4f369486d399e048f0fa, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:11.165909 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d0f3e-fc6d-4947-94a1-f8d58a356fa8 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:11.233069 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5ba2f-351c-442b-b3b6-243a77aa2ab1 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:11.252696 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 853/1695] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:11 2022] PUT /identity/v3/projects/c31d0e40cc9b491896c3646ee4fb116f/users/14961a444b5d4f369486d399e048f0fa/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:11.254329 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b28a3-2dde-4979-9820-4c0a0f4ce07c None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:11.254618 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b28a3-2dde-4979-9820-4c0a0f4ce07c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:11.259813 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b28a3-2dde-4979-9820-4c0a0f4ce07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:11.355000 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-827b28a3-2dde-4979-9820-4c0a0f4ce07c None None] MFA Rules not processed for user `747178727b6943cca525880273fce974`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:11.359159 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-827b28a3-2dde-4979-9820-4c0a0f4ce07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:11.413225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a913c-1dc7-4dc5-af19-63cc39ac8208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:11.415456 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a913c-1dc7-4dc5-af19-63cc39ac8208 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:11.415747 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a913c-1dc7-4dc5-af19-63cc39ac8208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:11.431176 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a913c-1dc7-4dc5-af19-63cc39ac8208 admin admin] PATH_INFO: `/v3/projects/fe18ac2508874f69919aa1d572a821f8/users/e7ec0e935b56471896b9eba15c34cfe2/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:11.434168 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a913c-1dc7-4dc5-af19-63cc39ac8208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe18ac2508874f69919aa1d572a821f8, user_id=e7ec0e935b56471896b9eba15c34cfe2, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:11.441181 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a913c-1dc7-4dc5-af19-63cc39ac8208 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:11.475874 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 843/1696] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:11 2022] PUT /identity/v3/projects/fe18ac2508874f69919aa1d572a821f8/users/e7ec0e935b56471896b9eba15c34cfe2/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:11.478231 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c77f50-458b-4d35-a739-eea66cba5427 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:11.478611 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c77f50-458b-4d35-a739-eea66cba5427 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:11.478896 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c77f50-458b-4d35-a739-eea66cba5427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:11.533114 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-f9c77f50-458b-4d35-a739-eea66cba5427 None None] MFA Rules not processed for user `14961a444b5d4f369486d399e048f0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:11.534772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-f9c77f50-458b-4d35-a739-eea66cba5427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:11.635969 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 854/1697] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:11 2022] POST /identity/v3/auth/tokens => generated 3496 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:11.637540 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3520a-7bc7-4586-99ba-b65c2a48d2a5 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:11.638296 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3520a-7bc7-4586-99ba-b65c2a48d2a5 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:11.638575 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3520a-7bc7-4586-99ba-b65c2a48d2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:11.675212 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 844/1698] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:11 2022] POST /identity/v3/auth/tokens => generated 3452 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:11.676537 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c77f50-458b-4d35-a739-eea66cba5427 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:11.679982 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-f9c77f50-458b-4d35-a739-eea66cba5427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:11.740344 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-87c3520a-7bc7-4586-99ba-b65c2a48d2a5 None None] MFA Rules not processed for user `e7ec0e935b56471896b9eba15c34cfe2`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:11.744786 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-87c3520a-7bc7-4586-99ba-b65c2a48d2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:11.820872 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c77f50-458b-4d35-a739-eea66cba5427 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:11.828520 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe9501-0c35-48fa-99fe-562a2b337bc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:11.829633 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe9501-0c35-48fa-99fe-562a2b337bc9 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:11.830151 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe9501-0c35-48fa-99fe-562a2b337bc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:11.830573 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe9501-0c35-48fa-99fe-562a2b337bc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:11.871595 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 855/1699] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:11 2022] POST /identity/v3/auth/tokens => generated 3466 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:11.873074 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3520a-7bc7-4586-99ba-b65c2a48d2a5 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:11.874781 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-87c3520a-7bc7-4586-99ba-b65c2a48d2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:11.887728 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3520a-7bc7-4586-99ba-b65c2a48d2a5 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:11.893155 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c493f-2a6d-4d7b-9b4a-03e957830506 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:11.893921 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c493f-2a6d-4d7b-9b4a-03e957830506 service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:11.894341 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c493f-2a6d-4d7b-9b4a-03e957830506 service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:11.894719 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c493f-2a6d-4d7b-9b4a-03e957830506 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:11.926841 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c493f-2a6d-4d7b-9b4a-03e957830506 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:11.929148 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c493f-2a6d-4d7b-9b4a-03e957830506 service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:11.941527 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe9501-0c35-48fa-99fe-562a2b337bc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:11.944593 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe9501-0c35-48fa-99fe-562a2b337bc9 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:11.959664 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 856/1700] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:11 2022] GET /identity/v3/auth/tokens => generated 3452 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:11.969715 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 845/1701] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:11 2022] GET /identity/v3/auth/tokens => generated 3496 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:12.053516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c493f-2a6d-4d7b-9b4a-03e957830506 service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:12.063967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c493f-2a6d-4d7b-9b4a-03e957830506 service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:12.076789 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f87a5-6084-478c-95a6-8bfe2ec81463 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:12.078083 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f87a5-6084-478c-95a6-8bfe2ec81463 service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:12.078674 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f87a5-6084-478c-95a6-8bfe2ec81463 service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:12.079235 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f87a5-6084-478c-95a6-8bfe2ec81463 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:12.102908 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f87a5-6084-478c-95a6-8bfe2ec81463 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:12.104713 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f87a5-6084-478c-95a6-8bfe2ec81463 service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:12.131960 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 857/1702] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:12 2022] GET /identity/v3/auth/tokens => generated 3466 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:12.208715 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe9501-0c35-48fa-99fe-562a2b337bc9 service cinder] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:12.218859 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe9501-0c35-48fa-99fe-562a2b337bc9 service cinder] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:12.229365 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d092c-6cf9-4bb3-9673-b88ed640f675 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:12.230341 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d092c-6cf9-4bb3-9673-b88ed640f675 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:12.230628 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d092c-6cf9-4bb3-9673-b88ed640f675 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:12.232515 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d092c-6cf9-4bb3-9673-b88ed640f675 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:12.385692 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d092c-6cf9-4bb3-9673-b88ed640f675 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:12.388319 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d092c-6cf9-4bb3-9673-b88ed640f675 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:12.424482 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 846/1703] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:12 2022] GET /identity/v3/auth/tokens => generated 3385 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:12.473592 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f87a5-6084-478c-95a6-8bfe2ec81463 service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:12.495116 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f87a5-6084-478c-95a6-8bfe2ec81463 service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:12.505926 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4bab3-fa92-488f-b25a-37674d639f73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:12.509128 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4bab3-fa92-488f-b25a-37674d639f73 service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:12.509905 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4bab3-fa92-488f-b25a-37674d639f73 service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:12.510190 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4bab3-fa92-488f-b25a-37674d639f73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:12.623725 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d092c-6cf9-4bb3-9673-b88ed640f675 service cinder] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:12.636815 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d092c-6cf9-4bb3-9673-b88ed640f675 service cinder] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:12.647919 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2919f8-9a2f-4912-a28a-00b4045b5da7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:12.648670 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2919f8-9a2f-4912-a28a-00b4045b5da7 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:12.649263 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2919f8-9a2f-4912-a28a-00b4045b5da7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:12.649804 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2919f8-9a2f-4912-a28a-00b4045b5da7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:12.654466 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4bab3-fa92-488f-b25a-37674d639f73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:12.656619 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4bab3-fa92-488f-b25a-37674d639f73 service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:12.666593 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 858/1704] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:12 2022] GET /identity/v3/auth/tokens => generated 3427 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:12.732857 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2919f8-9a2f-4912-a28a-00b4045b5da7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:12.735081 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2919f8-9a2f-4912-a28a-00b4045b5da7 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:12.749236 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 847/1705] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:12 2022] GET /identity/v3/auth/tokens => generated 3399 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:57:13.361427 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c7760-cf8d-4e14-9620-7f0a663af6df None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:13.361922 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c7760-cf8d-4e14-9620-7f0a663af6df None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:13.362000 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c7760-cf8d-4e14-9620-7f0a663af6df None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:13.364073 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 859/1706] 10.222.0.96 () {54 vars in 921 bytes} [Fri Jan 28 01:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:57:13.371952 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badff1df-d9af-4d43-9d80-90268f5dc59d None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:13.372415 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badff1df-d9af-4d43-9d80-90268f5dc59d None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:13.372570 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badff1df-d9af-4d43-9d80-90268f5dc59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:13.396146 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-badff1df-d9af-4d43-9d80-90268f5dc59d None None] MFA Rules not processed for user `cc85f5db9c3c47fca68ebab33b0bb73c`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:13.397666 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-badff1df-d9af-4d43-9d80-90268f5dc59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:13.431998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b160d7-e9cf-479d-b183-6c861ed9d7c8 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:13.432547 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b160d7-e9cf-479d-b183-6c861ed9d7c8 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:13.432836 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b160d7-e9cf-479d-b183-6c861ed9d7c8 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:13.434636 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 860/1707] 10.222.0.96 () {54 vars in 921 bytes} [Fri Jan 28 01:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:57:13.468415 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1d77f-64c6-48c7-8e6b-4901434fbefe None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:13.468985 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1d77f-64c6-48c7-8e6b-4901434fbefe None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:13.469463 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1d77f-64c6-48c7-8e6b-4901434fbefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:13.474204 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 848/1708] 10.222.0.96 () {58 vars in 1018 bytes} [Fri Jan 28 01:57:13 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:57:13.492226 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-45b1d77f-64c6-48c7-8e6b-4901434fbefe None None] MFA Rules not processed for user `cc85f5db9c3c47fca68ebab33b0bb73c`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:13.493629 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-45b1d77f-64c6-48c7-8e6b-4901434fbefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:13.504817 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 861/1709] 10.222.0.96 () {58 vars in 1018 bytes} [Fri Jan 28 01:57:13 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:57:13.554141 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badff1df-d9af-4d43-9d80-90268f5dc59d None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:13.555849 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-badff1df-d9af-4d43-9d80-90268f5dc59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:13.570383 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badff1df-d9af-4d43-9d80-90268f5dc59d None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:13.576071 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48c24b-4dec-4843-905b-a041fb060d05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:13.576724 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48c24b-4dec-4843-905b-a041fb060d05 service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:13.577052 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48c24b-4dec-4843-905b-a041fb060d05 service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:13.577675 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48c24b-4dec-4843-905b-a041fb060d05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:13.588388 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48c24b-4dec-4843-905b-a041fb060d05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:13.590002 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48c24b-4dec-4843-905b-a041fb060d05 service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:13.600842 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1d77f-64c6-48c7-8e6b-4901434fbefe None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:13.603559 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-45b1d77f-64c6-48c7-8e6b-4901434fbefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:13.608108 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 849/1710] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:13 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:13.619136 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1d77f-64c6-48c7-8e6b-4901434fbefe None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:13.626703 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd53772-bf1f-481f-8191-8804504d7bf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:13.627360 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd53772-bf1f-481f-8191-8804504d7bf7 service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:13.627647 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd53772-bf1f-481f-8191-8804504d7bf7 service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:13.627920 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd53772-bf1f-481f-8191-8804504d7bf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:13.638265 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd53772-bf1f-481f-8191-8804504d7bf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:13.640708 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd53772-bf1f-481f-8191-8804504d7bf7 service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:13.652720 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 862/1711] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:13 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:15.735651 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48c24b-4dec-4843-905b-a041fb060d05 service nova] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:15.855505 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48c24b-4dec-4843-905b-a041fb060d05 service nova] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:15.861710 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7ce1a-c287-4250-8797-62ad736b9d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:15.862931 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7ce1a-c287-4250-8797-62ad736b9d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:15.863396 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7ce1a-c287-4250-8797-62ad736b9d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:15.863851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7ce1a-c287-4250-8797-62ad736b9d0f admin admin] PATH_INFO: `/v3/users/4b0a04fce1ca4d20b942592bff39cf7c` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:15.865387 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7ce1a-c287-4250-8797-62ad736b9d0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b0a04fce1ca4d20b942592bff39cf7c)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:15.867775 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7ce1a-c287-4250-8797-62ad736b9d0f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:15.940624 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fac7ce1a-c287-4250-8797-62ad736b9d0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b0a04fce1ca4d20b942592bff39cf7c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:15.943270 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fac7ce1a-c287-4250-8797-62ad736b9d0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b0a04fce1ca4d20b942592bff39cf7c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:15.952353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fac7ce1a-c287-4250-8797-62ad736b9d0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b0a04fce1ca4d20b942592bff39cf7c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:15.961932 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fac7ce1a-c287-4250-8797-62ad736b9d0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b0a04fce1ca4d20b942592bff39cf7c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:15.977118 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fac7ce1a-c287-4250-8797-62ad736b9d0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b0a04fce1ca4d20b942592bff39cf7c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:15.988885 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 850/1712] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:15 2022] DELETE /identity/v3/users/4b0a04fce1ca4d20b942592bff39cf7c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:15.992368 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218a9c6-20d3-4f2b-bd51-f1e2a60eda7c None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:15.992906 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218a9c6-20d3-4f2b-bd51-f1e2a60eda7c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:15.992998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218a9c6-20d3-4f2b-bd51-f1e2a60eda7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:16.025647 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-6218a9c6-20d3-4f2b-bd51-f1e2a60eda7c None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:16.031384 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-6218a9c6-20d3-4f2b-bd51-f1e2a60eda7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:16.129844 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 863/1713] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:15 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:16.142091 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7ce1a-c287-4250-8797-62ad736b9d0f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:16.143930 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-fac7ce1a-c287-4250-8797-62ad736b9d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:16.244096 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7ce1a-c287-4250-8797-62ad736b9d0f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:16.248704 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4610d5-21b1-4804-ab32-3c72f550218f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:16.250260 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4610d5-21b1-4804-ab32-3c72f550218f service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:16.250650 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4610d5-21b1-4804-ab32-3c72f550218f service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:16.251219 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4610d5-21b1-4804-ab32-3c72f550218f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:16.304310 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4610d5-21b1-4804-ab32-3c72f550218f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:16.305987 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4610d5-21b1-4804-ab32-3c72f550218f service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:16.320569 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 851/1714] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:16 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:17.145519 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218a9c6-20d3-4f2b-bd51-f1e2a60eda7c None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:17.147340 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-6218a9c6-20d3-4f2b-bd51-f1e2a60eda7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:17.180327 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218a9c6-20d3-4f2b-bd51-f1e2a60eda7c None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:17.188310 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1406a-0dbf-4136-a83b-c9aa0a3424be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:17.189367 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1406a-0dbf-4136-a83b-c9aa0a3424be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:17.189640 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1406a-0dbf-4136-a83b-c9aa0a3424be admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:17.190284 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1406a-0dbf-4136-a83b-c9aa0a3424be admin admin] PATH_INFO: `/v3/projects/3409056a152d4abb8a9dc5166eea70e1` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:17.191792 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1406a-0dbf-4136-a83b-c9aa0a3424be admin admin] RBAC: Authorizing `identity:delete_project(project_id=3409056a152d4abb8a9dc5166eea70e1)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:17.193904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1406a-0dbf-4136-a83b-c9aa0a3424be admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:17.461271 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4dc1406a-0dbf-4136-a83b-c9aa0a3424be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3409056a152d4abb8a9dc5166eea70e1', 'request_id': 'req-4dc1406a-0dbf-4136-a83b-c9aa0a3424be'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:17.469705 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4dc1406a-0dbf-4136-a83b-c9aa0a3424be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3409056a152d4abb8a9dc5166eea70e1', 'request_id': 'req-4dc1406a-0dbf-4136-a83b-c9aa0a3424be'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:17.478237 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4dc1406a-0dbf-4136-a83b-c9aa0a3424be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3409056a152d4abb8a9dc5166eea70e1', 'request_id': 'req-4dc1406a-0dbf-4136-a83b-c9aa0a3424be'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:17.495219 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4dc1406a-0dbf-4136-a83b-c9aa0a3424be admin admin] The token cache is being invalidate because project 3409056a152d4abb8a9dc5166eea70e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:17.495752 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4dc1406a-0dbf-4136-a83b-c9aa0a3424be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:17.496438 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4dc1406a-0dbf-4136-a83b-c9aa0a3424be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:17.498365 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 864/1715] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:17 2022] DELETE /identity/v3/projects/3409056a152d4abb8a9dc5166eea70e1 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:17.503875 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4610d5-21b1-4804-ab32-3c72f550218f service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:17.517135 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4610d5-21b1-4804-ab32-3c72f550218f service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:17.594259 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13870cf2-c428-4b57-abd4-fbff68b27499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:17.595509 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13870cf2-c428-4b57-abd4-fbff68b27499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:17.595864 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13870cf2-c428-4b57-abd4-fbff68b27499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:17.596224 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13870cf2-c428-4b57-abd4-fbff68b27499 admin admin] PATH_INFO: `/v3/users/14961a444b5d4f369486d399e048f0fa` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:17.597701 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13870cf2-c428-4b57-abd4-fbff68b27499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14961a444b5d4f369486d399e048f0fa)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:17.599720 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13870cf2-c428-4b57-abd4-fbff68b27499 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:17.651175 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-13870cf2-c428-4b57-abd4-fbff68b27499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14961a444b5d4f369486d399e048f0fa'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:17.652121 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-13870cf2-c428-4b57-abd4-fbff68b27499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14961a444b5d4f369486d399e048f0fa'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:17.659369 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-13870cf2-c428-4b57-abd4-fbff68b27499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14961a444b5d4f369486d399e048f0fa'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:17.667875 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-13870cf2-c428-4b57-abd4-fbff68b27499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14961a444b5d4f369486d399e048f0fa'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:17.680624 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-13870cf2-c428-4b57-abd4-fbff68b27499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14961a444b5d4f369486d399e048f0fa'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:17.688405 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 852/1716] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:17 2022] DELETE /identity/v3/users/14961a444b5d4f369486d399e048f0fa => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:17.990129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1406a-0dbf-4136-a83b-c9aa0a3424be admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:17.991713 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-4dc1406a-0dbf-4136-a83b-c9aa0a3424be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:18.011843 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1406a-0dbf-4136-a83b-c9aa0a3424be admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:18.080430 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bedcb1-76a3-4eed-aaa3-40a2fe3f3aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:18.081404 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bedcb1-76a3-4eed-aaa3-40a2fe3f3aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:18.081678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bedcb1-76a3-4eed-aaa3-40a2fe3f3aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:18.081951 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bedcb1-76a3-4eed-aaa3-40a2fe3f3aa8 admin admin] PATH_INFO: `/v3/projects/c31d0e40cc9b491896c3646ee4fb116f` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:18.083732 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bedcb1-76a3-4eed-aaa3-40a2fe3f3aa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31d0e40cc9b491896c3646ee4fb116f)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:18.085751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bedcb1-76a3-4eed-aaa3-40a2fe3f3aa8 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:18.155670 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-48bedcb1-76a3-4eed-aaa3-40a2fe3f3aa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31d0e40cc9b491896c3646ee4fb116f', 'request_id': 'req-48bedcb1-76a3-4eed-aaa3-40a2fe3f3aa8'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:18.166719 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-48bedcb1-76a3-4eed-aaa3-40a2fe3f3aa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31d0e40cc9b491896c3646ee4fb116f', 'request_id': 'req-48bedcb1-76a3-4eed-aaa3-40a2fe3f3aa8'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:18.173470 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-48bedcb1-76a3-4eed-aaa3-40a2fe3f3aa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31d0e40cc9b491896c3646ee4fb116f', 'request_id': 'req-48bedcb1-76a3-4eed-aaa3-40a2fe3f3aa8'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:18.191348 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-48bedcb1-76a3-4eed-aaa3-40a2fe3f3aa8 admin admin] The token cache is being invalidate because project c31d0e40cc9b491896c3646ee4fb116f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:18.191775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-48bedcb1-76a3-4eed-aaa3-40a2fe3f3aa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:18.192561 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-48bedcb1-76a3-4eed-aaa3-40a2fe3f3aa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:18.198373 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 865/1717] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:17 2022] DELETE /identity/v3/projects/c31d0e40cc9b491896c3646ee4fb116f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:18.203393 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2bffd-2703-4a44-8f06-4ef8b8b3a2be None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:18.203393 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2bffd-2703-4a44-8f06-4ef8b8b3a2be None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:18.203393 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2bffd-2703-4a44-8f06-4ef8b8b3a2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:18.220757 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-84f2bffd-2703-4a44-8f06-4ef8b8b3a2be None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:18.222024 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-84f2bffd-2703-4a44-8f06-4ef8b8b3a2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:18.298128 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 853/1718] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:18 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:18.307622 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19265a-8bce-495e-8740-7525752cc005 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:18.307904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19265a-8bce-495e-8740-7525752cc005 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:18.308174 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19265a-8bce-495e-8740-7525752cc005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:18.326737 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-3b19265a-8bce-495e-8740-7525752cc005 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:18.327962 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-3b19265a-8bce-495e-8740-7525752cc005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:18.336995 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 866/1719] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:18 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:18.341384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2bffd-2703-4a44-8f06-4ef8b8b3a2be None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:18.351666 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2bffd-2703-4a44-8f06-4ef8b8b3a2be None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:18.356434 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a2c81-4e68-4b45-a629-84517087e6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:18.357136 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a2c81-4e68-4b45-a629-84517087e6dc admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:18.357412 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a2c81-4e68-4b45-a629-84517087e6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:18.357684 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a2c81-4e68-4b45-a629-84517087e6dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:18.359335 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a2c81-4e68-4b45-a629-84517087e6dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:18.359560 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a2c81-4e68-4b45-a629-84517087e6dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:18.361210 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a2c81-4e68-4b45-a629-84517087e6dc admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:18.374333 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 854/1720] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:18.378500 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19265a-8bce-495e-8740-7525752cc005 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:18.388272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19265a-8bce-495e-8740-7525752cc005 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:18.394088 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f5deb-8a1f-444a-8a1c-da684cd30047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:18.395045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f5deb-8a1f-444a-8a1c-da684cd30047 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:18.395495 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f5deb-8a1f-444a-8a1c-da684cd30047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:18.395880 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f5deb-8a1f-444a-8a1c-da684cd30047 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:18.396594 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f5deb-8a1f-444a-8a1c-da684cd30047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:18.398597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f5deb-8a1f-444a-8a1c-da684cd30047 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:18.434569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 867/1721] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:18 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:18.436045 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a2c81-4e68-4b45-a629-84517087e6dc admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:18.447399 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a2c81-4e68-4b45-a629-84517087e6dc admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:18.523881 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac3a20-a147-4f22-9a14-86612e6d5b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:18.524854 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac3a20-a147-4f22-9a14-86612e6d5b11 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:18.525173 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac3a20-a147-4f22-9a14-86612e6d5b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:18.525703 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac3a20-a147-4f22-9a14-86612e6d5b11 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:18.526752 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac3a20-a147-4f22-9a14-86612e6d5b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:18.529189 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac3a20-a147-4f22-9a14-86612e6d5b11 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:18.556257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 855/1722] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:18 2022] POST /identity/v3/users => generated 284 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:18.561818 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f5deb-8a1f-444a-8a1c-da684cd30047 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:18.573309 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f5deb-8a1f-444a-8a1c-da684cd30047 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:18.579310 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66907e57-9b9e-4dad-a8f5-84dc4f0f4b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:18.580000 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66907e57-9b9e-4dad-a8f5-84dc4f0f4b21 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:18.580304 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66907e57-9b9e-4dad-a8f5-84dc4f0f4b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:18.580577 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66907e57-9b9e-4dad-a8f5-84dc4f0f4b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:18.581357 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66907e57-9b9e-4dad-a8f5-84dc4f0f4b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:18.583045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66907e57-9b9e-4dad-a8f5-84dc4f0f4b21 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:18.597280 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 868/1723] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:57:18.600196 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac3a20-a147-4f22-9a14-86612e6d5b11 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:18.614799 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac3a20-a147-4f22-9a14-86612e6d5b11 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:18.621209 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94273646-dae0-4df9-bc12-2804a75c15a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:18.621881 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94273646-dae0-4df9-bc12-2804a75c15a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:18.622155 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94273646-dae0-4df9-bc12-2804a75c15a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:18.622427 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94273646-dae0-4df9-bc12-2804a75c15a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:18.623287 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94273646-dae0-4df9-bc12-2804a75c15a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:18.624979 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94273646-dae0-4df9-bc12-2804a75c15a0 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:18.636442 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 856/1724] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:18.641226 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66907e57-9b9e-4dad-a8f5-84dc4f0f4b21 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:18.651724 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66907e57-9b9e-4dad-a8f5-84dc4f0f4b21 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:18.658394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f781e1-08eb-4070-9048-3958f1729ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:18.659425 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f781e1-08eb-4070-9048-3958f1729ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:18.659775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f781e1-08eb-4070-9048-3958f1729ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:18.660134 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f781e1-08eb-4070-9048-3958f1729ddc admin admin] PATH_INFO: `/v3/projects/3b198d07e0a641d9bee77e1ad3cec6ac/users/14db56f43aa546ba97b2624199dd56b4/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:18.676375 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f781e1-08eb-4070-9048-3958f1729ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b198d07e0a641d9bee77e1ad3cec6ac, user_id=14db56f43aa546ba97b2624199dd56b4, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:18.679052 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f781e1-08eb-4070-9048-3958f1729ddc admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:18.694457 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 869/1725] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:18 2022] PUT /identity/v3/projects/3b198d07e0a641d9bee77e1ad3cec6ac/users/14db56f43aa546ba97b2624199dd56b4/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:57:18.706857 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9012eb8-1345-4541-b4c6-76f48fac18e1 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:18.707194 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9012eb8-1345-4541-b4c6-76f48fac18e1 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:18.707424 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9012eb8-1345-4541-b4c6-76f48fac18e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:18.739730 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-f9012eb8-1345-4541-b4c6-76f48fac18e1 None None] MFA Rules not processed for user `14db56f43aa546ba97b2624199dd56b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:18.741012 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-f9012eb8-1345-4541-b4c6-76f48fac18e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:18.814127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 857/1726] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:18 2022] POST /identity/v3/auth/tokens => generated 3387 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:57:18.818345 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f781e1-08eb-4070-9048-3958f1729ddc admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:18.908392 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f781e1-08eb-4070-9048-3958f1729ddc admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:18.909824 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69df9b-6d04-41e6-84b2-a7e03be151a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:18.910489 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69df9b-6d04-41e6-84b2-a7e03be151a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:18.910762 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69df9b-6d04-41e6-84b2-a7e03be151a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:18.911029 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69df9b-6d04-41e6-84b2-a7e03be151a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:18.911718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69df9b-6d04-41e6-84b2-a7e03be151a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:18.913664 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69df9b-6d04-41e6-84b2-a7e03be151a2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:18.956277 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 870/1727] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:18 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:57:18.958858 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9012eb8-1345-4541-b4c6-76f48fac18e1 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:18.970633 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9012eb8-1345-4541-b4c6-76f48fac18e1 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:19.037616 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c067d-c8da-4c85-9694-bb4269e1ce0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:19.038402 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c067d-c8da-4c85-9694-bb4269e1ce0c admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:19.038660 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c067d-c8da-4c85-9694-bb4269e1ce0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:19.038940 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c067d-c8da-4c85-9694-bb4269e1ce0c admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:19.039636 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c067d-c8da-4c85-9694-bb4269e1ce0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:19.041617 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c067d-c8da-4c85-9694-bb4269e1ce0c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:19.071209 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 858/1728] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:18 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:19.072661 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69df9b-6d04-41e6-84b2-a7e03be151a2 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:19.084429 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69df9b-6d04-41e6-84b2-a7e03be151a2 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:19.089456 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2b6e9-950d-49e9-89ac-dcad0e210cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:19.090187 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2b6e9-950d-49e9-89ac-dcad0e210cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:19.090496 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2b6e9-950d-49e9-89ac-dcad0e210cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:19.090767 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2b6e9-950d-49e9-89ac-dcad0e210cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:19.091516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2b6e9-950d-49e9-89ac-dcad0e210cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:19.094043 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2b6e9-950d-49e9-89ac-dcad0e210cfe admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:19.105353 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 871/1729] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:19.110404 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c067d-c8da-4c85-9694-bb4269e1ce0c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:19.120957 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c067d-c8da-4c85-9694-bb4269e1ce0c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:19.125914 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402a947-e8f4-4039-9550-781810941d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:19.126805 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402a947-e8f4-4039-9550-781810941d7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:19.127083 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402a947-e8f4-4039-9550-781810941d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:19.127373 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402a947-e8f4-4039-9550-781810941d7a admin admin] PATH_INFO: `/v3/projects/b47b949cb6ea43e2814b7132358f7c81/users/1d1c784817234b47a5208397de7e77b9/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:19.144002 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402a947-e8f4-4039-9550-781810941d7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b47b949cb6ea43e2814b7132358f7c81, user_id=1d1c784817234b47a5208397de7e77b9, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:19.146750 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402a947-e8f4-4039-9550-781810941d7a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:19.162150 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 859/1730] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:19 2022] PUT /identity/v3/projects/b47b949cb6ea43e2814b7132358f7c81/users/1d1c784817234b47a5208397de7e77b9/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:57:19.166414 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2b6e9-950d-49e9-89ac-dcad0e210cfe admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:19.177796 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2b6e9-950d-49e9-89ac-dcad0e210cfe admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:19.249262 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3d553-ee35-498a-b31a-548f05de0e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:19.250146 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3d553-ee35-498a-b31a-548f05de0e71 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:19.250524 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3d553-ee35-498a-b31a-548f05de0e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:19.251081 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3d553-ee35-498a-b31a-548f05de0e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:19.251925 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3d553-ee35-498a-b31a-548f05de0e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:19.253955 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3d553-ee35-498a-b31a-548f05de0e71 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:19.265334 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 872/1731] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:19.270508 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402a947-e8f4-4039-9550-781810941d7a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:19.282075 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402a947-e8f4-4039-9550-781810941d7a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:19.288933 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2f14c-956f-494f-a7c2-3d56d4eba97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:19.290774 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2f14c-956f-494f-a7c2-3d56d4eba97d admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:19.291325 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2f14c-956f-494f-a7c2-3d56d4eba97d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:19.291829 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2f14c-956f-494f-a7c2-3d56d4eba97d admin admin] PATH_INFO: `/v3/projects/b47b949cb6ea43e2814b7132358f7c81/users/1d1c784817234b47a5208397de7e77b9/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:19.295375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2f14c-956f-494f-a7c2-3d56d4eba97d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b47b949cb6ea43e2814b7132358f7c81, user_id=1d1c784817234b47a5208397de7e77b9, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:19.300771 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2f14c-956f-494f-a7c2-3d56d4eba97d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:19.311594 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 860/1732] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:19 2022] PUT /identity/v3/projects/b47b949cb6ea43e2814b7132358f7c81/users/1d1c784817234b47a5208397de7e77b9/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:19.322861 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d1f7a-b773-4171-96ef-f9e267a73f01 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:19.323212 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d1f7a-b773-4171-96ef-f9e267a73f01 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:19.323542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d1f7a-b773-4171-96ef-f9e267a73f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:19.352411 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-0e8d1f7a-b773-4171-96ef-f9e267a73f01 None None] MFA Rules not processed for user `1d1c784817234b47a5208397de7e77b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:19.353665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-0e8d1f7a-b773-4171-96ef-f9e267a73f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:19.421624 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 873/1733] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:19 2022] POST /identity/v3/auth/tokens => generated 3454 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:19.431770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2f14c-956f-494f-a7c2-3d56d4eba97d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:19.433844 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c9e2f14c-956f-494f-a7c2-3d56d4eba97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:19.494151 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2f14c-956f-494f-a7c2-3d56d4eba97d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:19.497904 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef6e88-d196-4a87-91dd-8e3daee2125b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:19.498552 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef6e88-d196-4a87-91dd-8e3daee2125b service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:19.498837 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef6e88-d196-4a87-91dd-8e3daee2125b service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:19.499142 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef6e88-d196-4a87-91dd-8e3daee2125b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:19.508715 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef6e88-d196-4a87-91dd-8e3daee2125b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:19.510205 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef6e88-d196-4a87-91dd-8e3daee2125b service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:19.520495 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 861/1734] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:19 2022] GET /identity/v3/auth/tokens => generated 3454 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:22.731881 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d1f7a-b773-4171-96ef-f9e267a73f01 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:22.810953 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d1f7a-b773-4171-96ef-f9e267a73f01 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:22.815901 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882da0b-c470-4419-bf79-69e46d093313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:22.816849 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882da0b-c470-4419-bf79-69e46d093313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:22.817130 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882da0b-c470-4419-bf79-69e46d093313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:22.817397 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882da0b-c470-4419-bf79-69e46d093313 admin admin] PATH_INFO: `/v3/users/14db56f43aa546ba97b2624199dd56b4` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:22.818620 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882da0b-c470-4419-bf79-69e46d093313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14db56f43aa546ba97b2624199dd56b4)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:22.820559 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882da0b-c470-4419-bf79-69e46d093313 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:22.877628 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f882da0b-c470-4419-bf79-69e46d093313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14db56f43aa546ba97b2624199dd56b4'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:22.878357 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f882da0b-c470-4419-bf79-69e46d093313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14db56f43aa546ba97b2624199dd56b4'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:22.878994 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f882da0b-c470-4419-bf79-69e46d093313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14db56f43aa546ba97b2624199dd56b4'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:22.887926 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f882da0b-c470-4419-bf79-69e46d093313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14db56f43aa546ba97b2624199dd56b4'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:22.897304 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f882da0b-c470-4419-bf79-69e46d093313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14db56f43aa546ba97b2624199dd56b4'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:22.917509 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 874/1735] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:22 2022] DELETE /identity/v3/users/14db56f43aa546ba97b2624199dd56b4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:22.922108 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24164a56-560e-4c56-b2ba-c0149f6624d4 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:22.922722 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24164a56-560e-4c56-b2ba-c0149f6624d4 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:22.922722 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24164a56-560e-4c56-b2ba-c0149f6624d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:22.950409 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-24164a56-560e-4c56-b2ba-c0149f6624d4 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:22.950409 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-24164a56-560e-4c56-b2ba-c0149f6624d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:23.017883 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 862/1736] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:22 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:57:23.028619 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882da0b-c470-4419-bf79-69e46d093313 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:23.030283 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-f882da0b-c470-4419-bf79-69e46d093313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:23.095850 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882da0b-c470-4419-bf79-69e46d093313 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:23.099572 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70595246-7eb6-4d61-b49d-df573778d918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:23.100223 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70595246-7eb6-4d61-b49d-df573778d918 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:23.100505 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70595246-7eb6-4d61-b49d-df573778d918 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:23.100775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70595246-7eb6-4d61-b49d-df573778d918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:23.111061 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70595246-7eb6-4d61-b49d-df573778d918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:23.112518 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70595246-7eb6-4d61-b49d-df573778d918 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:23.123934 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 875/1737] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:23 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:23.606112 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24164a56-560e-4c56-b2ba-c0149f6624d4 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:23.608048 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-24164a56-560e-4c56-b2ba-c0149f6624d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:23.629329 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24164a56-560e-4c56-b2ba-c0149f6624d4 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:23.639505 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2516ac-ffe8-42e0-8b1c-06cdb80f8931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:23.641851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2516ac-ffe8-42e0-8b1c-06cdb80f8931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:23.642297 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2516ac-ffe8-42e0-8b1c-06cdb80f8931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:23.642765 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2516ac-ffe8-42e0-8b1c-06cdb80f8931 admin admin] PATH_INFO: `/v3/projects/3b198d07e0a641d9bee77e1ad3cec6ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:23.644776 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2516ac-ffe8-42e0-8b1c-06cdb80f8931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b198d07e0a641d9bee77e1ad3cec6ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:23.648707 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2516ac-ffe8-42e0-8b1c-06cdb80f8931 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:23.720361 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-5b2516ac-ffe8-42e0-8b1c-06cdb80f8931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b198d07e0a641d9bee77e1ad3cec6ac', 'request_id': 'req-5b2516ac-ffe8-42e0-8b1c-06cdb80f8931'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:23.728220 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-5b2516ac-ffe8-42e0-8b1c-06cdb80f8931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b198d07e0a641d9bee77e1ad3cec6ac', 'request_id': 'req-5b2516ac-ffe8-42e0-8b1c-06cdb80f8931'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:23.735508 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-5b2516ac-ffe8-42e0-8b1c-06cdb80f8931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b198d07e0a641d9bee77e1ad3cec6ac', 'request_id': 'req-5b2516ac-ffe8-42e0-8b1c-06cdb80f8931'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:23.755628 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-5b2516ac-ffe8-42e0-8b1c-06cdb80f8931 admin admin] The token cache is being invalidate because project 3b198d07e0a641d9bee77e1ad3cec6ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:23.755914 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-5b2516ac-ffe8-42e0-8b1c-06cdb80f8931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:23.756569 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-5b2516ac-ffe8-42e0-8b1c-06cdb80f8931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:23.758302 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 863/1738] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:23 2022] DELETE /identity/v3/projects/3b198d07e0a641d9bee77e1ad3cec6ac => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:23.762629 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70595246-7eb6-4d61-b49d-df573778d918 service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:23.772868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70595246-7eb6-4d61-b49d-df573778d918 service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:23.851126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c75d4-46a2-420b-92b5-d03ba14f2b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:23.852000 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c75d4-46a2-420b-92b5-d03ba14f2b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:23.852289 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c75d4-46a2-420b-92b5-d03ba14f2b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:23.852545 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c75d4-46a2-420b-92b5-d03ba14f2b19 admin admin] PATH_INFO: `/v3/users/1d1c784817234b47a5208397de7e77b9` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:23.853835 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c75d4-46a2-420b-92b5-d03ba14f2b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d1c784817234b47a5208397de7e77b9)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:23.855866 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c75d4-46a2-420b-92b5-d03ba14f2b19 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:23.906770 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-092c75d4-46a2-420b-92b5-d03ba14f2b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d1c784817234b47a5208397de7e77b9'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:23.907356 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-092c75d4-46a2-420b-92b5-d03ba14f2b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d1c784817234b47a5208397de7e77b9'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:23.908029 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-092c75d4-46a2-420b-92b5-d03ba14f2b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d1c784817234b47a5208397de7e77b9'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:23.915757 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-092c75d4-46a2-420b-92b5-d03ba14f2b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d1c784817234b47a5208397de7e77b9'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:23.923598 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-092c75d4-46a2-420b-92b5-d03ba14f2b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d1c784817234b47a5208397de7e77b9'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:23.942454 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 876/1739] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:23 2022] DELETE /identity/v3/users/1d1c784817234b47a5208397de7e77b9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:57:24.927298 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2516ac-ffe8-42e0-8b1c-06cdb80f8931 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:24.928955 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-5b2516ac-ffe8-42e0-8b1c-06cdb80f8931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:24.950825 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2516ac-ffe8-42e0-8b1c-06cdb80f8931 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:25.020207 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d67e2e-d427-4a51-95c8-e4ecaac44ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:25.021822 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d67e2e-d427-4a51-95c8-e4ecaac44ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:25.022308 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d67e2e-d427-4a51-95c8-e4ecaac44ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:25.022730 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d67e2e-d427-4a51-95c8-e4ecaac44ad6 admin admin] PATH_INFO: `/v3/projects/b47b949cb6ea43e2814b7132358f7c81` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:25.024873 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d67e2e-d427-4a51-95c8-e4ecaac44ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b47b949cb6ea43e2814b7132358f7c81)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:25.028647 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d67e2e-d427-4a51-95c8-e4ecaac44ad6 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:25.104777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-40d67e2e-d427-4a51-95c8-e4ecaac44ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b47b949cb6ea43e2814b7132358f7c81', 'request_id': 'req-40d67e2e-d427-4a51-95c8-e4ecaac44ad6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:25.117471 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-40d67e2e-d427-4a51-95c8-e4ecaac44ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b47b949cb6ea43e2814b7132358f7c81', 'request_id': 'req-40d67e2e-d427-4a51-95c8-e4ecaac44ad6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:25.131039 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-40d67e2e-d427-4a51-95c8-e4ecaac44ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b47b949cb6ea43e2814b7132358f7c81', 'request_id': 'req-40d67e2e-d427-4a51-95c8-e4ecaac44ad6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:25.157752 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-40d67e2e-d427-4a51-95c8-e4ecaac44ad6 admin admin] The token cache is being invalidate because project b47b949cb6ea43e2814b7132358f7c81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:25.158118 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-40d67e2e-d427-4a51-95c8-e4ecaac44ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:25.158817 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-40d67e2e-d427-4a51-95c8-e4ecaac44ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:25.160636 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 864/1740] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:24 2022] DELETE /identity/v3/projects/b47b949cb6ea43e2814b7132358f7c81 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:25.168093 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffec79-2afc-4441-95fd-0ad3ca0c6999 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:25.168657 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffec79-2afc-4441-95fd-0ad3ca0c6999 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:25.168995 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffec79-2afc-4441-95fd-0ad3ca0c6999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:25.200443 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-34ffec79-2afc-4441-95fd-0ad3ca0c6999 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:25.202701 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-34ffec79-2afc-4441-95fd-0ad3ca0c6999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:25.290575 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 877/1741] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:25 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:25.300340 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8661c-f758-4551-87a7-ded6c1fd041f None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:25.300702 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8661c-f758-4551-87a7-ded6c1fd041f None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:25.301005 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8661c-f758-4551-87a7-ded6c1fd041f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:25.335933 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-c2c8661c-f758-4551-87a7-ded6c1fd041f None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:25.335933 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c2c8661c-f758-4551-87a7-ded6c1fd041f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:25.343778 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 865/1742] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:25 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:57:25.347847 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffec79-2afc-4441-95fd-0ad3ca0c6999 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:25.360027 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffec79-2afc-4441-95fd-0ad3ca0c6999 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:25.367220 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a998a-af29-40f7-b766-0452cf9ba251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:25.368239 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a998a-af29-40f7-b766-0452cf9ba251 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:25.368538 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a998a-af29-40f7-b766-0452cf9ba251 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:25.368926 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a998a-af29-40f7-b766-0452cf9ba251 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:25.370059 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a998a-af29-40f7-b766-0452cf9ba251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:25.370437 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a998a-af29-40f7-b766-0452cf9ba251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:25.372756 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a998a-af29-40f7-b766-0452cf9ba251 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:25.387775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 878/1743] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:25.393997 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8661c-f758-4551-87a7-ded6c1fd041f None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:25.405435 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8661c-f758-4551-87a7-ded6c1fd041f None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:25.412473 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fb934-686d-4913-b4b5-cbaa70dcb345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:25.413178 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fb934-686d-4913-b4b5-cbaa70dcb345 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:25.413463 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fb934-686d-4913-b4b5-cbaa70dcb345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:25.413738 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fb934-686d-4913-b4b5-cbaa70dcb345 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:25.414433 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fb934-686d-4913-b4b5-cbaa70dcb345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:25.416392 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fb934-686d-4913-b4b5-cbaa70dcb345 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:25.459086 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 866/1744] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:25 2022] POST /identity/v3/projects => generated 391 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:25.460197 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a998a-af29-40f7-b766-0452cf9ba251 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:25.473012 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a998a-af29-40f7-b766-0452cf9ba251 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:25.595917 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0a9bd-7d35-45ac-9df5-83e7cff23764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:25.596834 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0a9bd-7d35-45ac-9df5-83e7cff23764 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:25.597134 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0a9bd-7d35-45ac-9df5-83e7cff23764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:25.597419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0a9bd-7d35-45ac-9df5-83e7cff23764 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:25.598152 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0a9bd-7d35-45ac-9df5-83e7cff23764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:25.600411 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0a9bd-7d35-45ac-9df5-83e7cff23764 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:25.637453 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 879/1745] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:25 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:25.641908 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fb934-686d-4913-b4b5-cbaa70dcb345 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:25.659012 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fb934-686d-4913-b4b5-cbaa70dcb345 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:25.673428 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824daf6-9b29-4322-894e-4e8488425261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:25.674280 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824daf6-9b29-4322-894e-4e8488425261 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:25.676079 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824daf6-9b29-4322-894e-4e8488425261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:25.676508 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824daf6-9b29-4322-894e-4e8488425261 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:25.677488 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824daf6-9b29-4322-894e-4e8488425261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:25.682066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824daf6-9b29-4322-894e-4e8488425261 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:25.719674 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 867/1746] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:25.721398 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0a9bd-7d35-45ac-9df5-83e7cff23764 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:25.746766 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0a9bd-7d35-45ac-9df5-83e7cff23764 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:25.755841 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ba49d-dfb8-48a3-abb4-1e7c8e280360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:25.756532 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ba49d-dfb8-48a3-abb4-1e7c8e280360 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:25.756827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ba49d-dfb8-48a3-abb4-1e7c8e280360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:25.757228 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ba49d-dfb8-48a3-abb4-1e7c8e280360 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:25.758109 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ba49d-dfb8-48a3-abb4-1e7c8e280360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:25.760077 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ba49d-dfb8-48a3-abb4-1e7c8e280360 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:25.779343 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 880/1747] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:25.788278 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824daf6-9b29-4322-894e-4e8488425261 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:25.802440 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824daf6-9b29-4322-894e-4e8488425261 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:25.808285 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94414e3c-5880-463e-a0f6-f70af4a9bd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:25.809302 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94414e3c-5880-463e-a0f6-f70af4a9bd27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:25.809588 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94414e3c-5880-463e-a0f6-f70af4a9bd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:25.809856 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94414e3c-5880-463e-a0f6-f70af4a9bd27 admin admin] PATH_INFO: `/v3/projects/cc3fa786a2d14a6c8fb3206383579b31/users/d287c57958a0409ead944dee8cc04d8b/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:25.834882 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94414e3c-5880-463e-a0f6-f70af4a9bd27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3fa786a2d14a6c8fb3206383579b31, user_id=d287c57958a0409ead944dee8cc04d8b, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:25.837895 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94414e3c-5880-463e-a0f6-f70af4a9bd27 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:25.857878 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 868/1748] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:25 2022] PUT /identity/v3/projects/cc3fa786a2d14a6c8fb3206383579b31/users/d287c57958a0409ead944dee8cc04d8b/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:25.881355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e01420-d922-492b-acac-48e933a9d171 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:25.881355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e01420-d922-492b-acac-48e933a9d171 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:25.881355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e01420-d922-492b-acac-48e933a9d171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:25.917292 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-80e01420-d922-492b-acac-48e933a9d171 None None] MFA Rules not processed for user `d287c57958a0409ead944dee8cc04d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:25.919071 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-80e01420-d922-492b-acac-48e933a9d171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:26.045029 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 881/1749] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:25 2022] POST /identity/v3/auth/tokens => generated 3411 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:57:26.047978 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94414e3c-5880-463e-a0f6-f70af4a9bd27 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:26.128963 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94414e3c-5880-463e-a0f6-f70af4a9bd27 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:26.136412 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeebf8a-48ea-4df3-b376-dd8421e08e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:26.137413 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeebf8a-48ea-4df3-b376-dd8421e08e7f admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:26.137720 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeebf8a-48ea-4df3-b376-dd8421e08e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:26.138015 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeebf8a-48ea-4df3-b376-dd8421e08e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:26.138732 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeebf8a-48ea-4df3-b376-dd8421e08e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:26.141248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeebf8a-48ea-4df3-b376-dd8421e08e7f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:26.178167 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 869/1750] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:26 2022] POST /identity/v3/projects => generated 393 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:26.179164 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e01420-d922-492b-acac-48e933a9d171 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:26.194281 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e01420-d922-492b-acac-48e933a9d171 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:26.284498 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef6ec2-e052-47f5-87d9-c680f95e0143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:26.285525 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef6ec2-e052-47f5-87d9-c680f95e0143 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:26.286013 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef6ec2-e052-47f5-87d9-c680f95e0143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:26.286492 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef6ec2-e052-47f5-87d9-c680f95e0143 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:26.287656 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef6ec2-e052-47f5-87d9-c680f95e0143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:26.290696 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef6ec2-e052-47f5-87d9-c680f95e0143 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:26.321379 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 882/1751] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:26 2022] POST /identity/v3/users => generated 303 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:57:26.325749 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeebf8a-48ea-4df3-b376-dd8421e08e7f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:26.337790 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeebf8a-48ea-4df3-b376-dd8421e08e7f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:26.345491 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2178a-7a76-43de-a4da-779a6671280c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:26.345491 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2178a-7a76-43de-a4da-779a6671280c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:26.345491 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2178a-7a76-43de-a4da-779a6671280c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:26.346479 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2178a-7a76-43de-a4da-779a6671280c admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:26.346479 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2178a-7a76-43de-a4da-779a6671280c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:26.348263 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2178a-7a76-43de-a4da-779a6671280c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:26.370295 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 870/1752] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:26.375672 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef6ec2-e052-47f5-87d9-c680f95e0143 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:26.386617 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef6ec2-e052-47f5-87d9-c680f95e0143 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:26.391980 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c6cf0-b652-4827-812f-32403609e719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:26.393000 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c6cf0-b652-4827-812f-32403609e719 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:26.393383 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c6cf0-b652-4827-812f-32403609e719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:26.393683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c6cf0-b652-4827-812f-32403609e719 admin admin] PATH_INFO: `/v3/projects/9aa12ab8118c4a9a8bfbe4cee0a4bcbf/users/5d87ae4778644bc8bc70133ee1a64fea/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:26.410878 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c6cf0-b652-4827-812f-32403609e719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa12ab8118c4a9a8bfbe4cee0a4bcbf, user_id=5d87ae4778644bc8bc70133ee1a64fea, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:26.413814 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c6cf0-b652-4827-812f-32403609e719 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:26.431915 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 883/1753] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:26 2022] PUT /identity/v3/projects/9aa12ab8118c4a9a8bfbe4cee0a4bcbf/users/5d87ae4778644bc8bc70133ee1a64fea/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:57:26.443217 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2178a-7a76-43de-a4da-779a6671280c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:26.464096 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2178a-7a76-43de-a4da-779a6671280c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:26.538556 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d498580-46b9-4617-a577-e1d1cc5106ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:26.539158 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d498580-46b9-4617-a577-e1d1cc5106ea admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:26.539435 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d498580-46b9-4617-a577-e1d1cc5106ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:26.539710 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d498580-46b9-4617-a577-e1d1cc5106ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:26.540429 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d498580-46b9-4617-a577-e1d1cc5106ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:26.542380 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d498580-46b9-4617-a577-e1d1cc5106ea admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:26.556239 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 871/1754] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:26.562158 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c6cf0-b652-4827-812f-32403609e719 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:26.574247 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c6cf0-b652-4827-812f-32403609e719 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:26.580137 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7beabf-27da-497b-a586-5db9bb8046a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:26.581150 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7beabf-27da-497b-a586-5db9bb8046a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:26.581455 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7beabf-27da-497b-a586-5db9bb8046a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:26.581773 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7beabf-27da-497b-a586-5db9bb8046a6 admin admin] PATH_INFO: `/v3/projects/9aa12ab8118c4a9a8bfbe4cee0a4bcbf/users/5d87ae4778644bc8bc70133ee1a64fea/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:26.583915 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7beabf-27da-497b-a586-5db9bb8046a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa12ab8118c4a9a8bfbe4cee0a4bcbf, user_id=5d87ae4778644bc8bc70133ee1a64fea, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:26.587003 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7beabf-27da-497b-a586-5db9bb8046a6 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:26.598933 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 884/1755] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:26 2022] PUT /identity/v3/projects/9aa12ab8118c4a9a8bfbe4cee0a4bcbf/users/5d87ae4778644bc8bc70133ee1a64fea/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:26.610684 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a9b0b-e549-4c59-ae00-bf7dbe7ade8a None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:26.610966 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a9b0b-e549-4c59-ae00-bf7dbe7ade8a None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:26.611241 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a9b0b-e549-4c59-ae00-bf7dbe7ade8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:26.643748 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-b90a9b0b-e549-4c59-ae00-bf7dbe7ade8a None None] MFA Rules not processed for user `5d87ae4778644bc8bc70133ee1a64fea`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:26.645125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b90a9b0b-e549-4c59-ae00-bf7dbe7ade8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:26.730157 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 872/1756] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:26 2022] POST /identity/v3/auth/tokens => generated 3480 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:57:26.740939 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7beabf-27da-497b-a586-5db9bb8046a6 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:26.742714 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-cf7beabf-27da-497b-a586-5db9bb8046a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:26.807940 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7beabf-27da-497b-a586-5db9bb8046a6 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:26.812401 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c928ed-8f22-4171-9e53-b90dea0fec9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:26.813101 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c928ed-8f22-4171-9e53-b90dea0fec9a service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:26.813372 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c928ed-8f22-4171-9e53-b90dea0fec9a service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:26.813701 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c928ed-8f22-4171-9e53-b90dea0fec9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:26.824100 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c928ed-8f22-4171-9e53-b90dea0fec9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:26.825689 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c928ed-8f22-4171-9e53-b90dea0fec9a service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:26.837676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 885/1757] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:26 2022] GET /identity/v3/auth/tokens => generated 3480 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:57:26.893434 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a9b0b-e549-4c59-ae00-bf7dbe7ade8a None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:26.904185 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a9b0b-e549-4c59-ae00-bf7dbe7ade8a None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:26.912044 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13eb16b-7b4a-43c4-9dfc-24357955892c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:26.913139 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eb16b-7b4a-43c4-9dfc-24357955892c service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:26.913603 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eb16b-7b4a-43c4-9dfc-24357955892c service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:26.914093 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13eb16b-7b4a-43c4-9dfc-24357955892c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:26.983878 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13eb16b-7b4a-43c4-9dfc-24357955892c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:26.985525 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13eb16b-7b4a-43c4-9dfc-24357955892c service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:26.996079 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 873/1758] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:26 2022] GET /identity/v3/auth/tokens => generated 3411 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:29.810169 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c928ed-8f22-4171-9e53-b90dea0fec9a service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:29.813685 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b1c928ed-8f22-4171-9e53-b90dea0fec9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:29.960557 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c928ed-8f22-4171-9e53-b90dea0fec9a service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:29.966371 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7693c1b-7fc5-4fad-bf3f-d9289ea09357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:29.967466 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7693c1b-7fc5-4fad-bf3f-d9289ea09357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:29.967861 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7693c1b-7fc5-4fad-bf3f-d9289ea09357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:29.968255 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7693c1b-7fc5-4fad-bf3f-d9289ea09357 admin admin] PATH_INFO: `/v3/users/f5bd37f7714a4d03a46e7ac3fe6406d7` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:29.970320 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7693c1b-7fc5-4fad-bf3f-d9289ea09357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5bd37f7714a4d03a46e7ac3fe6406d7)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:29.972752 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7693c1b-7fc5-4fad-bf3f-d9289ea09357 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:30.062158 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f7693c1b-7fc5-4fad-bf3f-d9289ea09357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5bd37f7714a4d03a46e7ac3fe6406d7'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:30.063487 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f7693c1b-7fc5-4fad-bf3f-d9289ea09357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5bd37f7714a4d03a46e7ac3fe6406d7'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:30.064668 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f7693c1b-7fc5-4fad-bf3f-d9289ea09357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5bd37f7714a4d03a46e7ac3fe6406d7'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:30.078378 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f7693c1b-7fc5-4fad-bf3f-d9289ea09357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5bd37f7714a4d03a46e7ac3fe6406d7'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:30.095379 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f7693c1b-7fc5-4fad-bf3f-d9289ea09357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5bd37f7714a4d03a46e7ac3fe6406d7'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:30.127170 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 886/1759] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:29 2022] DELETE /identity/v3/users/f5bd37f7714a4d03a46e7ac3fe6406d7 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:30.129308 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0bb9b-c58f-4321-9b2b-9d49e8f6f360 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:30.129877 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0bb9b-c58f-4321-9b2b-9d49e8f6f360 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:30.130349 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0bb9b-c58f-4321-9b2b-9d49e8f6f360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:30.159667 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-4ce0bb9b-c58f-4321-9b2b-9d49e8f6f360 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:30.161139 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-4ce0bb9b-c58f-4321-9b2b-9d49e8f6f360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:30.227906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 874/1760] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:30 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:30.242067 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7693c1b-7fc5-4fad-bf3f-d9289ea09357 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:30.244191 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-f7693c1b-7fc5-4fad-bf3f-d9289ea09357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:30.324230 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7693c1b-7fc5-4fad-bf3f-d9289ea09357 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:30.328826 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9437e38-9628-4bcd-94d1-0d645e06c09b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:30.329523 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9437e38-9628-4bcd-94d1-0d645e06c09b service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:30.329902 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9437e38-9628-4bcd-94d1-0d645e06c09b service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:30.330251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9437e38-9628-4bcd-94d1-0d645e06c09b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:30.344475 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9437e38-9628-4bcd-94d1-0d645e06c09b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:30.347597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9437e38-9628-4bcd-94d1-0d645e06c09b service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:30.373440 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 887/1761] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:30 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:30.620503 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0bb9b-c58f-4321-9b2b-9d49e8f6f360 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:30.623362 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-4ce0bb9b-c58f-4321-9b2b-9d49e8f6f360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:30.696291 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0bb9b-c58f-4321-9b2b-9d49e8f6f360 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:30.710151 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858bc75-186c-4a03-bd21-188d5f2e17e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:30.719939 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858bc75-186c-4a03-bd21-188d5f2e17e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:30.722748 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858bc75-186c-4a03-bd21-188d5f2e17e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:30.725338 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858bc75-186c-4a03-bd21-188d5f2e17e5 admin admin] PATH_INFO: `/v3/users/4258536cb5954dd4a49800a5c2f7f356` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:30.727314 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858bc75-186c-4a03-bd21-188d5f2e17e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4258536cb5954dd4a49800a5c2f7f356)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:30.729721 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858bc75-186c-4a03-bd21-188d5f2e17e5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:30.806487 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6858bc75-186c-4a03-bd21-188d5f2e17e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4258536cb5954dd4a49800a5c2f7f356'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:30.807571 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6858bc75-186c-4a03-bd21-188d5f2e17e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4258536cb5954dd4a49800a5c2f7f356'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:30.819463 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9437e38-9628-4bcd-94d1-0d645e06c09b service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:30.823760 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a9437e38-9628-4bcd-94d1-0d645e06c09b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:30.849151 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6858bc75-186c-4a03-bd21-188d5f2e17e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4258536cb5954dd4a49800a5c2f7f356'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:30.862197 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6858bc75-186c-4a03-bd21-188d5f2e17e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4258536cb5954dd4a49800a5c2f7f356'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:30.869831 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9437e38-9628-4bcd-94d1-0d645e06c09b service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:30.878746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdc0a3-f3cf-4319-82bf-73c6a75317fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:30.880220 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdc0a3-f3cf-4319-82bf-73c6a75317fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:30.880595 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdc0a3-f3cf-4319-82bf-73c6a75317fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:30.880997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdc0a3-f3cf-4319-82bf-73c6a75317fe admin admin] PATH_INFO: `/v3/projects/23d9dfd720874aef9604f70a32c61bea` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:30.883739 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bdc0a3-f3cf-4319-82bf-73c6a75317fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=23d9dfd720874aef9604f70a32c61bea)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:30.885129 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6858bc75-186c-4a03-bd21-188d5f2e17e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4258536cb5954dd4a49800a5c2f7f356'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:30.888282 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bdc0a3-f3cf-4319-82bf-73c6a75317fe admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:30.897420 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 875/1762] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:30 2022] DELETE /identity/v3/users/4258536cb5954dd4a49800a5c2f7f356 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:30.904115 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8abc4-11f7-4e1f-ba39-24040667e35e None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:30.904660 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8abc4-11f7-4e1f-ba39-24040667e35e None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:30.905895 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8abc4-11f7-4e1f-ba39-24040667e35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:30.934074 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-b1d8abc4-11f7-4e1f-ba39-24040667e35e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:30.936660 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b1d8abc4-11f7-4e1f-ba39-24040667e35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:30.986962 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f8bdc0a3-f3cf-4319-82bf-73c6a75317fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23d9dfd720874aef9604f70a32c61bea', 'request_id': 'req-f8bdc0a3-f3cf-4319-82bf-73c6a75317fe'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:30.996382 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f8bdc0a3-f3cf-4319-82bf-73c6a75317fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23d9dfd720874aef9604f70a32c61bea', 'request_id': 'req-f8bdc0a3-f3cf-4319-82bf-73c6a75317fe'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:31.004650 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f8bdc0a3-f3cf-4319-82bf-73c6a75317fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23d9dfd720874aef9604f70a32c61bea', 'request_id': 'req-f8bdc0a3-f3cf-4319-82bf-73c6a75317fe'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:31.028542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f8bdc0a3-f3cf-4319-82bf-73c6a75317fe admin admin] The token cache is being invalidate because project 23d9dfd720874aef9604f70a32c61bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:31.029142 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f8bdc0a3-f3cf-4319-82bf-73c6a75317fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:31.030971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f8bdc0a3-f3cf-4319-82bf-73c6a75317fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:31.032994 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 888/1763] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:30 2022] DELETE /identity/v3/projects/23d9dfd720874aef9604f70a32c61bea => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:31.037274 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdc0a3-f3cf-4319-82bf-73c6a75317fe admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:31.039550 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-f8bdc0a3-f3cf-4319-82bf-73c6a75317fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:31.083329 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 876/1764] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:30 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:31.085087 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8abc4-11f7-4e1f-ba39-24040667e35e None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:31.089657 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b1d8abc4-11f7-4e1f-ba39-24040667e35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:31.108140 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8abc4-11f7-4e1f-ba39-24040667e35e None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:31.126617 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdc0a3-f3cf-4319-82bf-73c6a75317fe admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:31.131938 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540cd43-9b10-4a76-9dbb-cd258e231fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:31.132899 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540cd43-9b10-4a76-9dbb-cd258e231fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:31.133130 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540cd43-9b10-4a76-9dbb-cd258e231fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:31.133408 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540cd43-9b10-4a76-9dbb-cd258e231fa7 admin admin] PATH_INFO: `/v3/users/747178727b6943cca525880273fce974` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:31.134655 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540cd43-9b10-4a76-9dbb-cd258e231fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=747178727b6943cca525880273fce974)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:31.136599 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540cd43-9b10-4a76-9dbb-cd258e231fa7 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:31.176204 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eefd2a-b014-4459-a574-b56dee574f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:31.177153 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eefd2a-b014-4459-a574-b56dee574f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:31.177375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eefd2a-b014-4459-a574-b56dee574f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:31.177674 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eefd2a-b014-4459-a574-b56dee574f4e admin admin] PATH_INFO: `/v3/users/d287c57958a0409ead944dee8cc04d8b` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:31.178956 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eefd2a-b014-4459-a574-b56dee574f4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d287c57958a0409ead944dee8cc04d8b)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:31.180958 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eefd2a-b014-4459-a574-b56dee574f4e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:31.210190 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3540cd43-9b10-4a76-9dbb-cd258e231fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '747178727b6943cca525880273fce974'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:31.211062 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3540cd43-9b10-4a76-9dbb-cd258e231fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '747178727b6943cca525880273fce974'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:31.211884 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3540cd43-9b10-4a76-9dbb-cd258e231fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '747178727b6943cca525880273fce974'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:31.223032 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3540cd43-9b10-4a76-9dbb-cd258e231fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '747178727b6943cca525880273fce974'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:31.235356 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3540cd43-9b10-4a76-9dbb-cd258e231fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '747178727b6943cca525880273fce974'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:31.246743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-51eefd2a-b014-4459-a574-b56dee574f4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd287c57958a0409ead944dee8cc04d8b'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:31.248183 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-51eefd2a-b014-4459-a574-b56dee574f4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd287c57958a0409ead944dee8cc04d8b'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:31.259422 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-51eefd2a-b014-4459-a574-b56dee574f4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd287c57958a0409ead944dee8cc04d8b'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:31.263155 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 889/1765] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:31 2022] DELETE /identity/v3/users/747178727b6943cca525880273fce974 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:57:31.263972 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540cd43-9b10-4a76-9dbb-cd258e231fa7 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:31.276062 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-3540cd43-9b10-4a76-9dbb-cd258e231fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:31.281489 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-51eefd2a-b014-4459-a574-b56dee574f4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd287c57958a0409ead944dee8cc04d8b'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:31.306099 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-51eefd2a-b014-4459-a574-b56dee574f4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd287c57958a0409ead944dee8cc04d8b'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:31.320235 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 877/1766] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:31 2022] DELETE /identity/v3/users/d287c57958a0409ead944dee8cc04d8b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:31.328610 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0791037-5e59-4633-a2b3-83d8f807c00f None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:31.330370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0791037-5e59-4633-a2b3-83d8f807c00f None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:31.330899 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0791037-5e59-4633-a2b3-83d8f807c00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:31.378647 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-b0791037-5e59-4633-a2b3-83d8f807c00f None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:31.380535 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b0791037-5e59-4633-a2b3-83d8f807c00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:31.409274 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540cd43-9b10-4a76-9dbb-cd258e231fa7 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:31.466004 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 878/1767] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:31 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:57:31.482925 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0791037-5e59-4633-a2b3-83d8f807c00f None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:31.487669 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b0791037-5e59-4633-a2b3-83d8f807c00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:31.487873 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf488a-f3a3-40ae-bac6-509c1e91ad62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:31.489361 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf488a-f3a3-40ae-bac6-509c1e91ad62 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:31.489361 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf488a-f3a3-40ae-bac6-509c1e91ad62 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:31.489715 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf488a-f3a3-40ae-bac6-509c1e91ad62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:31.492231 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-5bbf488a-f3a3-40ae-bac6-509c1e91ad62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:31.506922 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf488a-f3a3-40ae-bac6-509c1e91ad62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:31.509804 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf488a-f3a3-40ae-bac6-509c1e91ad62 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:31.511735 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0791037-5e59-4633-a2b3-83d8f807c00f None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:31.521564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480bf59-31f8-4a86-9378-bc6d23d34b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:31.522880 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480bf59-31f8-4a86-9378-bc6d23d34b31 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:31.523397 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480bf59-31f8-4a86-9378-bc6d23d34b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:31.523867 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480bf59-31f8-4a86-9378-bc6d23d34b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:31.527459 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 890/1768] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:31 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:31.564558 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480bf59-31f8-4a86-9378-bc6d23d34b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:31.566739 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480bf59-31f8-4a86-9378-bc6d23d34b31 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:31.583362 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 879/1769] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:31 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:32.070759 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf488a-f3a3-40ae-bac6-509c1e91ad62 service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:32.072548 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-5bbf488a-f3a3-40ae-bac6-509c1e91ad62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:32.090804 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf488a-f3a3-40ae-bac6-509c1e91ad62 service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:32.104522 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e3d44-b768-4f45-b74d-1563eeaf6c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:32.105884 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e3d44-b768-4f45-b74d-1563eeaf6c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:32.106419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e3d44-b768-4f45-b74d-1563eeaf6c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:32.106923 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e3d44-b768-4f45-b74d-1563eeaf6c5c admin admin] PATH_INFO: `/v3/projects/9810917292df421aa3f771e37011131b` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:32.110792 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e3d44-b768-4f45-b74d-1563eeaf6c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9810917292df421aa3f771e37011131b)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:32.113032 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e3d44-b768-4f45-b74d-1563eeaf6c5c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:32.206307 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480bf59-31f8-4a86-9378-bc6d23d34b31 service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:32.208125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-7480bf59-31f8-4a86-9378-bc6d23d34b31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:32.216545 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4a1e3d44-b768-4f45-b74d-1563eeaf6c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9810917292df421aa3f771e37011131b', 'request_id': 'req-4a1e3d44-b768-4f45-b74d-1563eeaf6c5c'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.226129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4a1e3d44-b768-4f45-b74d-1563eeaf6c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9810917292df421aa3f771e37011131b', 'request_id': 'req-4a1e3d44-b768-4f45-b74d-1563eeaf6c5c'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.230501 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480bf59-31f8-4a86-9378-bc6d23d34b31 service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:32.250099 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4a1e3d44-b768-4f45-b74d-1563eeaf6c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9810917292df421aa3f771e37011131b', 'request_id': 'req-4a1e3d44-b768-4f45-b74d-1563eeaf6c5c'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.268688 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4a1e3d44-b768-4f45-b74d-1563eeaf6c5c admin admin] The token cache is being invalidate because project 9810917292df421aa3f771e37011131b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:32.269060 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4a1e3d44-b768-4f45-b74d-1563eeaf6c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.269885 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4a1e3d44-b768-4f45-b74d-1563eeaf6c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.273207 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 891/1770] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:32 2022] DELETE /identity/v3/projects/9810917292df421aa3f771e37011131b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:57:32.279723 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06411a44-ad0a-463f-8504-f89f753e645b None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:32.280714 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06411a44-ad0a-463f-8504-f89f753e645b None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:32.280925 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06411a44-ad0a-463f-8504-f89f753e645b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:32.303538 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-06411a44-ad0a-463f-8504-f89f753e645b None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:32.305012 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-06411a44-ad0a-463f-8504-f89f753e645b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:32.329670 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c5ee3-41e3-4452-844f-ee3a465f1f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:32.330846 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c5ee3-41e3-4452-844f-ee3a465f1f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:32.331411 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c5ee3-41e3-4452-844f-ee3a465f1f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:32.331875 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c5ee3-41e3-4452-844f-ee3a465f1f22 admin admin] PATH_INFO: `/v3/projects/70b0420870344caea06ecd7fa5412281` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:32.333755 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c5ee3-41e3-4452-844f-ee3a465f1f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b0420870344caea06ecd7fa5412281)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:32.336533 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c5ee3-41e3-4452-844f-ee3a465f1f22 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:32.460476 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 892/1771] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:32.462815 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06411a44-ad0a-463f-8504-f89f753e645b None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:32.469276 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-06411a44-ad0a-463f-8504-f89f753e645b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:32.494484 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06411a44-ad0a-463f-8504-f89f753e645b None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:32.503215 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a24c5ee3-41e3-4452-844f-ee3a465f1f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b0420870344caea06ecd7fa5412281', 'request_id': 'req-a24c5ee3-41e3-4452-844f-ee3a465f1f22'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.515203 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a24c5ee3-41e3-4452-844f-ee3a465f1f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b0420870344caea06ecd7fa5412281', 'request_id': 'req-a24c5ee3-41e3-4452-844f-ee3a465f1f22'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.533186 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a24c5ee3-41e3-4452-844f-ee3a465f1f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b0420870344caea06ecd7fa5412281', 'request_id': 'req-a24c5ee3-41e3-4452-844f-ee3a465f1f22'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.562132 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a24c5ee3-41e3-4452-844f-ee3a465f1f22 admin admin] The token cache is being invalidate because project 70b0420870344caea06ecd7fa5412281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:32.562437 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a24c5ee3-41e3-4452-844f-ee3a465f1f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.563218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a24c5ee3-41e3-4452-844f-ee3a465f1f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.565219 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 880/1772] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:32 2022] DELETE /identity/v3/projects/70b0420870344caea06ecd7fa5412281 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:32.567062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2f5d5-517b-482e-be61-99740c45d710 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:32.567384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2f5d5-517b-482e-be61-99740c45d710 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:32.567711 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2f5d5-517b-482e-be61-99740c45d710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:32.590560 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-6bb2f5d5-517b-482e-be61-99740c45d710 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:32.591935 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-6bb2f5d5-517b-482e-be61-99740c45d710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:32.592518 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b404252-4bef-4331-b75d-af4d6b05a61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:32.593733 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b404252-4bef-4331-b75d-af4d6b05a61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:32.594013 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b404252-4bef-4331-b75d-af4d6b05a61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:32.594349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b404252-4bef-4331-b75d-af4d6b05a61b admin admin] PATH_INFO: `/v3/users/9e6ab8c8aff74d059615850548d95770` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:32.595745 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b404252-4bef-4331-b75d-af4d6b05a61b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e6ab8c8aff74d059615850548d95770)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:32.598019 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b404252-4bef-4331-b75d-af4d6b05a61b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:32.603902 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 881/1773] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:32.605305 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2f5d5-517b-482e-be61-99740c45d710 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:32.607711 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-6bb2f5d5-517b-482e-be61-99740c45d710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:32.628772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2f5d5-517b-482e-be61-99740c45d710 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:32.638461 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d400ec9-076a-4d7d-bb46-d30fc858cc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:32.641305 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d400ec9-076a-4d7d-bb46-d30fc858cc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:32.642126 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d400ec9-076a-4d7d-bb46-d30fc858cc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:32.642703 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d400ec9-076a-4d7d-bb46-d30fc858cc92 admin admin] PATH_INFO: `/v3/projects/cc3fa786a2d14a6c8fb3206383579b31` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:32.645025 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d400ec9-076a-4d7d-bb46-d30fc858cc92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc3fa786a2d14a6c8fb3206383579b31)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:32.648155 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d400ec9-076a-4d7d-bb46-d30fc858cc92 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:32.663327 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9b404252-4bef-4331-b75d-af4d6b05a61b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e6ab8c8aff74d059615850548d95770'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.664552 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9b404252-4bef-4331-b75d-af4d6b05a61b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e6ab8c8aff74d059615850548d95770'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.665289 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9b404252-4bef-4331-b75d-af4d6b05a61b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e6ab8c8aff74d059615850548d95770'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.674062 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9b404252-4bef-4331-b75d-af4d6b05a61b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e6ab8c8aff74d059615850548d95770'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.682402 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9b404252-4bef-4331-b75d-af4d6b05a61b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e6ab8c8aff74d059615850548d95770'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.704529 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 893/1774] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:32 2022] DELETE /identity/v3/users/9e6ab8c8aff74d059615850548d95770 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:32.705549 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b404252-4bef-4331-b75d-af4d6b05a61b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:32.705821 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1d400ec9-076a-4d7d-bb46-d30fc858cc92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc3fa786a2d14a6c8fb3206383579b31', 'request_id': 'req-1d400ec9-076a-4d7d-bb46-d30fc858cc92'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.707117 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-9b404252-4bef-4331-b75d-af4d6b05a61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:32.715117 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1d400ec9-076a-4d7d-bb46-d30fc858cc92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc3fa786a2d14a6c8fb3206383579b31', 'request_id': 'req-1d400ec9-076a-4d7d-bb46-d30fc858cc92'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.724085 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1d400ec9-076a-4d7d-bb46-d30fc858cc92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc3fa786a2d14a6c8fb3206383579b31', 'request_id': 'req-1d400ec9-076a-4d7d-bb46-d30fc858cc92'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.745369 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1d400ec9-076a-4d7d-bb46-d30fc858cc92 admin admin] The token cache is being invalidate because project cc3fa786a2d14a6c8fb3206383579b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:32.745742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1d400ec9-076a-4d7d-bb46-d30fc858cc92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.746827 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1d400ec9-076a-4d7d-bb46-d30fc858cc92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.749926 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 882/1775] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:32 2022] DELETE /identity/v3/projects/cc3fa786a2d14a6c8fb3206383579b31 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:32.751659 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d400ec9-076a-4d7d-bb46-d30fc858cc92 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:32.754233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1d400ec9-076a-4d7d-bb46-d30fc858cc92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:32.783808 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b404252-4bef-4331-b75d-af4d6b05a61b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:32.789185 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407ba91-f1bc-4f8a-a921-0046cc2fc060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:32.790138 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407ba91-f1bc-4f8a-a921-0046cc2fc060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:32.790482 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407ba91-f1bc-4f8a-a921-0046cc2fc060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:32.790772 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407ba91-f1bc-4f8a-a921-0046cc2fc060 admin admin] PATH_INFO: `/v3/users/e7ec0e935b56471896b9eba15c34cfe2` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:32.792291 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407ba91-f1bc-4f8a-a921-0046cc2fc060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ec0e935b56471896b9eba15c34cfe2)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:32.794269 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407ba91-f1bc-4f8a-a921-0046cc2fc060 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:32.832853 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d400ec9-076a-4d7d-bb46-d30fc858cc92 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:32.838896 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d832b6-bdf7-42c8-83ab-d8465e7aa494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:32.839618 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d832b6-bdf7-42c8-83ab-d8465e7aa494 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:32.839922 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d832b6-bdf7-42c8-83ab-d8465e7aa494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:32.840468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d832b6-bdf7-42c8-83ab-d8465e7aa494 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:32.841465 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d832b6-bdf7-42c8-83ab-d8465e7aa494 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:32.841684 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d832b6-bdf7-42c8-83ab-d8465e7aa494 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:32.843911 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d832b6-bdf7-42c8-83ab-d8465e7aa494 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:32.860174 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 883/1776] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:32.862246 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872172d-4cdf-4a71-98f1-913f3c383540 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:32.862647 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872172d-4cdf-4a71-98f1-913f3c383540 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:32.863060 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872172d-4cdf-4a71-98f1-913f3c383540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:32.866204 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7407ba91-f1bc-4f8a-a921-0046cc2fc060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ec0e935b56471896b9eba15c34cfe2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.867104 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7407ba91-f1bc-4f8a-a921-0046cc2fc060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ec0e935b56471896b9eba15c34cfe2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.867786 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7407ba91-f1bc-4f8a-a921-0046cc2fc060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ec0e935b56471896b9eba15c34cfe2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.876765 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7407ba91-f1bc-4f8a-a921-0046cc2fc060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ec0e935b56471896b9eba15c34cfe2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.883830 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7407ba91-f1bc-4f8a-a921-0046cc2fc060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ec0e935b56471896b9eba15c34cfe2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:32.885309 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-7872172d-4cdf-4a71-98f1-913f3c383540 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:32.886686 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-7872172d-4cdf-4a71-98f1-913f3c383540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:32.897113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 884/1777] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:32.897953 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872172d-4cdf-4a71-98f1-913f3c383540 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:32.899353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-7872172d-4cdf-4a71-98f1-913f3c383540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:32.908679 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 894/1778] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:32 2022] DELETE /identity/v3/users/e7ec0e935b56471896b9eba15c34cfe2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:32.909706 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407ba91-f1bc-4f8a-a921-0046cc2fc060 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:32.911311 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-7407ba91-f1bc-4f8a-a921-0046cc2fc060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:32.913743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872172d-4cdf-4a71-98f1-913f3c383540 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:32.994428 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407ba91-f1bc-4f8a-a921-0046cc2fc060 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:32.996738 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11191c4-f725-4fe7-b781-e848dc545abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:32.997984 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11191c4-f725-4fe7-b781-e848dc545abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:32.999449 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11191c4-f725-4fe7-b781-e848dc545abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:32.999449 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11191c4-f725-4fe7-b781-e848dc545abb admin admin] PATH_INFO: `/v3/users/5d87ae4778644bc8bc70133ee1a64fea` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:33.001929 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11191c4-f725-4fe7-b781-e848dc545abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d87ae4778644bc8bc70133ee1a64fea)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:33.002872 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628fe25-5bd9-4aae-92c6-100fe0d8a6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:33.003681 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628fe25-5bd9-4aae-92c6-100fe0d8a6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:33.003992 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628fe25-5bd9-4aae-92c6-100fe0d8a6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:33.004385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628fe25-5bd9-4aae-92c6-100fe0d8a6b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:33.004534 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11191c4-f725-4fe7-b781-e848dc545abb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:33.005178 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628fe25-5bd9-4aae-92c6-100fe0d8a6b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:33.007850 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628fe25-5bd9-4aae-92c6-100fe0d8a6b2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:33.043986 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 895/1779] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:32 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:33.050126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628fe25-5bd9-4aae-92c6-100fe0d8a6b2 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:33.052134 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-9628fe25-5bd9-4aae-92c6-100fe0d8a6b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:33.072901 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-d11191c4-f725-4fe7-b781-e848dc545abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d87ae4778644bc8bc70133ee1a64fea'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:33.073798 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-d11191c4-f725-4fe7-b781-e848dc545abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d87ae4778644bc8bc70133ee1a64fea'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:33.083333 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-d11191c4-f725-4fe7-b781-e848dc545abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d87ae4778644bc8bc70133ee1a64fea'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:33.092918 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-d11191c4-f725-4fe7-b781-e848dc545abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d87ae4778644bc8bc70133ee1a64fea'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:33.109124 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-d11191c4-f725-4fe7-b781-e848dc545abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d87ae4778644bc8bc70133ee1a64fea'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:33.117419 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 885/1780] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:32 2022] DELETE /identity/v3/users/5d87ae4778644bc8bc70133ee1a64fea => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:33.118357 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11191c4-f725-4fe7-b781-e848dc545abb admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:33.119870 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-d11191c4-f725-4fe7-b781-e848dc545abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:33.129630 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628fe25-5bd9-4aae-92c6-100fe0d8a6b2 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:33.219850 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3dba5-9ec8-43f1-9346-3a1f97211689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:33.220929 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3dba5-9ec8-43f1-9346-3a1f97211689 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:33.221355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3dba5-9ec8-43f1-9346-3a1f97211689 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:33.221800 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3dba5-9ec8-43f1-9346-3a1f97211689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:33.224126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-79f3dba5-9ec8-43f1-9346-3a1f97211689 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:33.237302 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11191c4-f725-4fe7-b781-e848dc545abb admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:33.243315 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3dba5-9ec8-43f1-9346-3a1f97211689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:33.244642 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a336415-4f6d-44d3-a39d-66e0e1393f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:33.244837 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3dba5-9ec8-43f1-9346-3a1f97211689 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:33.245682 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a336415-4f6d-44d3-a39d-66e0e1393f37 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:33.246161 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a336415-4f6d-44d3-a39d-66e0e1393f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:33.246591 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a336415-4f6d-44d3-a39d-66e0e1393f37 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:33.247470 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a336415-4f6d-44d3-a39d-66e0e1393f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:33.251604 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a336415-4f6d-44d3-a39d-66e0e1393f37 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:33.259467 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 896/1781] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:33 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:33.292537 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 886/1782] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:33 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:33.298986 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3dba5-9ec8-43f1-9346-3a1f97211689 service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:33.321307 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3dba5-9ec8-43f1-9346-3a1f97211689 service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:33.333111 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53e008-fb2c-4d24-9ebc-7846fde17fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:33.333111 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53e008-fb2c-4d24-9ebc-7846fde17fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:33.333316 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53e008-fb2c-4d24-9ebc-7846fde17fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:33.333610 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53e008-fb2c-4d24-9ebc-7846fde17fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:33.334284 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53e008-fb2c-4d24-9ebc-7846fde17fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:33.336260 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53e008-fb2c-4d24-9ebc-7846fde17fb6 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:33.349207 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 897/1783] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:33.357200 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a336415-4f6d-44d3-a39d-66e0e1393f37 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:33.369713 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a336415-4f6d-44d3-a39d-66e0e1393f37 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:33.377107 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613c0f7-4b84-42b9-9568-0c036ca2185e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:33.377976 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613c0f7-4b84-42b9-9568-0c036ca2185e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:33.378088 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613c0f7-4b84-42b9-9568-0c036ca2185e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:33.378352 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613c0f7-4b84-42b9-9568-0c036ca2185e admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:33.379453 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613c0f7-4b84-42b9-9568-0c036ca2185e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:33.381419 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613c0f7-4b84-42b9-9568-0c036ca2185e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:33.399477 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 887/1784] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:33.404538 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53e008-fb2c-4d24-9ebc-7846fde17fb6 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:33.417844 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53e008-fb2c-4d24-9ebc-7846fde17fb6 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:33.423983 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5de33-1d8b-4888-8f44-e75ce250821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:33.424979 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5de33-1d8b-4888-8f44-e75ce250821d admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:33.425267 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5de33-1d8b-4888-8f44-e75ce250821d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:33.425651 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5de33-1d8b-4888-8f44-e75ce250821d admin admin] PATH_INFO: `/v3/projects/ac64597db67e42e5812e3e77d34e11b5/users/f96dab5e1fb24480ba270fbdb7254481/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:33.449851 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5de33-1d8b-4888-8f44-e75ce250821d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac64597db67e42e5812e3e77d34e11b5, user_id=f96dab5e1fb24480ba270fbdb7254481, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:33.455156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5de33-1d8b-4888-8f44-e75ce250821d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:33.499522 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 898/1785] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:33 2022] PUT /identity/v3/projects/ac64597db67e42e5812e3e77d34e11b5/users/f96dab5e1fb24480ba270fbdb7254481/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:33.504666 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852c055-dc18-4718-8220-92db037ec5e0 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:33.505502 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852c055-dc18-4718-8220-92db037ec5e0 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:33.505821 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852c055-dc18-4718-8220-92db037ec5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:33.576402 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-2852c055-dc18-4718-8220-92db037ec5e0 None None] MFA Rules not processed for user `f96dab5e1fb24480ba270fbdb7254481`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:33.579671 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2852c055-dc18-4718-8220-92db037ec5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:33.736864 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 888/1786] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:33 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:33.749902 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5de33-1d8b-4888-8f44-e75ce250821d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:33.863997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5de33-1d8b-4888-8f44-e75ce250821d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:33.876715 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c0ef0-35a5-4e8b-b314-298e09f6de17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:33.878171 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c0ef0-35a5-4e8b-b314-298e09f6de17 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:33.878294 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c0ef0-35a5-4e8b-b314-298e09f6de17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:33.878841 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c0ef0-35a5-4e8b-b314-298e09f6de17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:33.880774 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c0ef0-35a5-4e8b-b314-298e09f6de17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:33.883361 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc2279-d374-4d44-bf1a-e44710ccb393 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:33.883772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc2279-d374-4d44-bf1a-e44710ccb393 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:33.883882 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c0ef0-35a5-4e8b-b314-298e09f6de17 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:33.884226 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc2279-d374-4d44-bf1a-e44710ccb393 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:33.887417 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 889/1787] 10.222.0.96 () {54 vars in 921 bytes} [Fri Jan 28 01:57:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:57:33.924060 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6904b5-47e6-4f07-b772-6314fac96b76 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:33.928297 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 899/1788] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:33 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:33.929863 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6904b5-47e6-4f07-b772-6314fac96b76 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:33.930698 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6904b5-47e6-4f07-b772-6314fac96b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:33.937224 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c0ef0-35a5-4e8b-b314-298e09f6de17 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:33.983375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-8a6904b5-47e6-4f07-b772-6314fac96b76 None None] MFA Rules not processed for user `cc85f5db9c3c47fca68ebab33b0bb73c`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:33.988458 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-8a6904b5-47e6-4f07-b772-6314fac96b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:34.043980 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c0ef0-35a5-4e8b-b314-298e09f6de17 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:34.053883 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f5fb8-2a62-48b5-8100-4609a625b674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:34.055397 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f5fb8-2a62-48b5-8100-4609a625b674 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:34.056285 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f5fb8-2a62-48b5-8100-4609a625b674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:34.056285 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f5fb8-2a62-48b5-8100-4609a625b674 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:34.058207 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f5fb8-2a62-48b5-8100-4609a625b674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:34.060702 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f5fb8-2a62-48b5-8100-4609a625b674 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:34.101768 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 900/1789] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:33 2022] POST /identity/v3/users => generated 300 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:34.101768 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f5fb8-2a62-48b5-8100-4609a625b674 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:34.102178 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-267f5fb8-2a62-48b5-8100-4609a625b674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:34.121388 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f5fb8-2a62-48b5-8100-4609a625b674 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:34.128831 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f60db-4a25-4671-91de-c58800854586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:34.130039 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f60db-4a25-4671-91de-c58800854586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:34.130593 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f60db-4a25-4671-91de-c58800854586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:34.130593 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f60db-4a25-4671-91de-c58800854586 admin admin] PATH_INFO: `/v3/projects/fe18ac2508874f69919aa1d572a821f8` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:34.132457 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f60db-4a25-4671-91de-c58800854586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe18ac2508874f69919aa1d572a821f8)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:34.134880 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f60db-4a25-4671-91de-c58800854586 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:34.158645 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 890/1790] 10.222.0.96 () {58 vars in 1018 bytes} [Fri Jan 28 01:57:33 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:57:34.166071 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6904b5-47e6-4f07-b772-6314fac96b76 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:34.184506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6904b5-47e6-4f07-b772-6314fac96b76 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:34.192780 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c5023-ce36-4f66-b1b4-65eb2a76441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:34.193666 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c5023-ce36-4f66-b1b4-65eb2a76441c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:34.194215 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c5023-ce36-4f66-b1b4-65eb2a76441c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:34.194520 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c5023-ce36-4f66-b1b4-65eb2a76441c admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:34.195515 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c5023-ce36-4f66-b1b4-65eb2a76441c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:34.197393 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c5023-ce36-4f66-b1b4-65eb2a76441c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:34.211045 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 891/1791] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:34.211167 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3c4f60db-4a25-4671-91de-c58800854586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe18ac2508874f69919aa1d572a821f8', 'request_id': 'req-3c4f60db-4a25-4671-91de-c58800854586'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:34.214688 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c5023-ce36-4f66-b1b4-65eb2a76441c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:34.218792 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b13c5023-ce36-4f66-b1b4-65eb2a76441c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:34.236394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3c4f60db-4a25-4671-91de-c58800854586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe18ac2508874f69919aa1d572a821f8', 'request_id': 'req-3c4f60db-4a25-4671-91de-c58800854586'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:34.241655 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c5023-ce36-4f66-b1b4-65eb2a76441c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:34.253176 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3c4f60db-4a25-4671-91de-c58800854586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe18ac2508874f69919aa1d572a821f8', 'request_id': 'req-3c4f60db-4a25-4671-91de-c58800854586'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:34.283272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3c4f60db-4a25-4671-91de-c58800854586 admin admin] The token cache is being invalidate because project fe18ac2508874f69919aa1d572a821f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:34.285147 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3c4f60db-4a25-4671-91de-c58800854586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:34.294895 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3c4f60db-4a25-4671-91de-c58800854586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:34.298303 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 901/1792] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:34 2022] DELETE /identity/v3/projects/fe18ac2508874f69919aa1d572a821f8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:34.299793 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f60db-4a25-4671-91de-c58800854586 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:34.301600 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-3c4f60db-4a25-4671-91de-c58800854586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:34.318869 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e074d8-8af1-4b39-ad80-15696935262c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:34.319738 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e074d8-8af1-4b39-ad80-15696935262c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:34.320017 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e074d8-8af1-4b39-ad80-15696935262c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:34.320289 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e074d8-8af1-4b39-ad80-15696935262c admin admin] PATH_INFO: `/v3/projects/9aa12ab8118c4a9a8bfbe4cee0a4bcbf` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:34.321513 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e074d8-8af1-4b39-ad80-15696935262c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa12ab8118c4a9a8bfbe4cee0a4bcbf)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:34.323816 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e074d8-8af1-4b39-ad80-15696935262c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:34.383867 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-16e074d8-8af1-4b39-ad80-15696935262c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa12ab8118c4a9a8bfbe4cee0a4bcbf', 'request_id': 'req-16e074d8-8af1-4b39-ad80-15696935262c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:34.391711 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-16e074d8-8af1-4b39-ad80-15696935262c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa12ab8118c4a9a8bfbe4cee0a4bcbf', 'request_id': 'req-16e074d8-8af1-4b39-ad80-15696935262c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:34.393892 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f60db-4a25-4671-91de-c58800854586 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:34.399737 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-16e074d8-8af1-4b39-ad80-15696935262c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa12ab8118c4a9a8bfbe4cee0a4bcbf', 'request_id': 'req-16e074d8-8af1-4b39-ad80-15696935262c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:34.414188 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-16e074d8-8af1-4b39-ad80-15696935262c admin admin] The token cache is being invalidate because project 9aa12ab8118c4a9a8bfbe4cee0a4bcbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:34.414706 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-16e074d8-8af1-4b39-ad80-15696935262c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:34.415371 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-16e074d8-8af1-4b39-ad80-15696935262c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:34.421570 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 892/1793] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:34 2022] DELETE /identity/v3/projects/9aa12ab8118c4a9a8bfbe4cee0a4bcbf => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:34.421570 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e074d8-8af1-4b39-ad80-15696935262c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:34.421570 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-16e074d8-8af1-4b39-ad80-15696935262c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:34.467885 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2fe98-00dd-4d32-9686-77fc5223d5f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:34.469886 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2fe98-00dd-4d32-9686-77fc5223d5f2 service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:34.470373 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2fe98-00dd-4d32-9686-77fc5223d5f2 service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:34.471384 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2fe98-00dd-4d32-9686-77fc5223d5f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:34.473541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-cfe2fe98-00dd-4d32-9686-77fc5223d5f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:34.492634 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2fe98-00dd-4d32-9686-77fc5223d5f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:34.495085 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2fe98-00dd-4d32-9686-77fc5223d5f2 service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:34.499747 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e074d8-8af1-4b39-ad80-15696935262c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:34.504906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c632c1-3ace-4cd5-aa98-714c8a137e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:34.505947 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c632c1-3ace-4cd5-aa98-714c8a137e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:34.506329 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c632c1-3ace-4cd5-aa98-714c8a137e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:34.506858 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c632c1-3ace-4cd5-aa98-714c8a137e39 admin admin] PATH_INFO: `/v3/projects/d63ef65b70504b3ba4057a7adc54807e/users/af9ac2737a6f4124bb9eb371b6eeaaa8/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:34.510312 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 902/1794] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:34 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:34.511433 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2fe98-00dd-4d32-9686-77fc5223d5f2 service nova] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:34.513871 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-cfe2fe98-00dd-4d32-9686-77fc5223d5f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:34.526862 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c632c1-3ace-4cd5-aa98-714c8a137e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63ef65b70504b3ba4057a7adc54807e, user_id=af9ac2737a6f4124bb9eb371b6eeaaa8, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:34.535986 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c632c1-3ace-4cd5-aa98-714c8a137e39 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:34.539461 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2fe98-00dd-4d32-9686-77fc5223d5f2 service nova] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:34.549578 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37382036-5366-4af1-ae3e-2985f4ea386b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:34.551752 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37382036-5366-4af1-ae3e-2985f4ea386b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:34.552111 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37382036-5366-4af1-ae3e-2985f4ea386b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:34.552502 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37382036-5366-4af1-ae3e-2985f4ea386b admin admin] PATH_INFO: `/v3/projects/a894e08c57954c6bad11b7c9e4cd33f7` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:34.554217 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 893/1795] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:34 2022] PUT /identity/v3/projects/d63ef65b70504b3ba4057a7adc54807e/users/af9ac2737a6f4124bb9eb371b6eeaaa8/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:34.555262 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37382036-5366-4af1-ae3e-2985f4ea386b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a894e08c57954c6bad11b7c9e4cd33f7)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:34.556953 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a236f7-5e45-4840-b69b-f7dd9067fa1f None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:34.557603 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a236f7-5e45-4840-b69b-f7dd9067fa1f None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:34.558113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a236f7-5e45-4840-b69b-f7dd9067fa1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:34.559114 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37382036-5366-4af1-ae3e-2985f4ea386b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:34.588236 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-51a236f7-5e45-4840-b69b-f7dd9067fa1f None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:34.589842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-51a236f7-5e45-4840-b69b-f7dd9067fa1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:34.631150 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-37382036-5366-4af1-ae3e-2985f4ea386b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a894e08c57954c6bad11b7c9e4cd33f7', 'request_id': 'req-37382036-5366-4af1-ae3e-2985f4ea386b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:34.639011 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-37382036-5366-4af1-ae3e-2985f4ea386b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a894e08c57954c6bad11b7c9e4cd33f7', 'request_id': 'req-37382036-5366-4af1-ae3e-2985f4ea386b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:34.645478 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-37382036-5366-4af1-ae3e-2985f4ea386b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a894e08c57954c6bad11b7c9e4cd33f7', 'request_id': 'req-37382036-5366-4af1-ae3e-2985f4ea386b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:34.681602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-37382036-5366-4af1-ae3e-2985f4ea386b admin admin] The token cache is being invalidate because project a894e08c57954c6bad11b7c9e4cd33f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:34.681899 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-37382036-5366-4af1-ae3e-2985f4ea386b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:34.683909 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-37382036-5366-4af1-ae3e-2985f4ea386b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:34.688598 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 903/1796] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:34 2022] DELETE /identity/v3/projects/a894e08c57954c6bad11b7c9e4cd33f7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:34.696395 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 894/1797] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:34.697099 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5d810-d9da-45cd-b397-112dbd34574f None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:34.697438 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5d810-d9da-45cd-b397-112dbd34574f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:34.698416 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a236f7-5e45-4840-b69b-f7dd9067fa1f None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:34.699014 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5d810-d9da-45cd-b397-112dbd34574f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:34.725545 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a236f7-5e45-4840-b69b-f7dd9067fa1f None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:34.742803 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-b6d5d810-d9da-45cd-b397-112dbd34574f None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:34.744400 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b6d5d810-d9da-45cd-b397-112dbd34574f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:34.809914 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0385d19-646d-472d-bd58-3332ad3010d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:34.810527 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0385d19-646d-472d-bd58-3332ad3010d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:34.810806 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0385d19-646d-472d-bd58-3332ad3010d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:34.812191 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0385d19-646d-472d-bd58-3332ad3010d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:34.813617 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0385d19-646d-472d-bd58-3332ad3010d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:34.815238 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0385d19-646d-472d-bd58-3332ad3010d5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:34.817458 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 904/1798] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:34.818330 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5d810-d9da-45cd-b397-112dbd34574f None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:34.824679 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b6d5d810-d9da-45cd-b397-112dbd34574f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:34.835677 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 895/1799] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:34.835677 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d28f9-3c9a-492e-9798-4ac7f8f1143f None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:34.835906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d28f9-3c9a-492e-9798-4ac7f8f1143f None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:34.836395 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d28f9-3c9a-492e-9798-4ac7f8f1143f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:34.839222 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5d810-d9da-45cd-b397-112dbd34574f None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:34.846612 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d74f84-b057-4dc7-a756-e1d2b58a696d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:34.847608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d74f84-b057-4dc7-a756-e1d2b58a696d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:34.847841 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d74f84-b057-4dc7-a756-e1d2b58a696d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:34.848080 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d74f84-b057-4dc7-a756-e1d2b58a696d admin admin] PATH_INFO: `/v3/users/be77a6cef367428e92080741f60520a2` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:34.849442 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d74f84-b057-4dc7-a756-e1d2b58a696d admin admin] RBAC: Authorizing `identity:delete_user(user_id=be77a6cef367428e92080741f60520a2)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:34.851515 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d74f84-b057-4dc7-a756-e1d2b58a696d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:34.867128 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-c04d28f9-3c9a-492e-9798-4ac7f8f1143f None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:34.870095 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c04d28f9-3c9a-492e-9798-4ac7f8f1143f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:34.881671 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 896/1800] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:34.883504 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c57bd-58ba-4cc2-b289-c43519b15cdb None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:34.883961 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c57bd-58ba-4cc2-b289-c43519b15cdb None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:34.884238 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c57bd-58ba-4cc2-b289-c43519b15cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:34.910354 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-5f1c57bd-58ba-4cc2-b289-c43519b15cdb None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:34.911565 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-5f1c57bd-58ba-4cc2-b289-c43519b15cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:34.923746 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 897/1801] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:34.923746 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c57bd-58ba-4cc2-b289-c43519b15cdb None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:34.923746 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-5f1c57bd-58ba-4cc2-b289-c43519b15cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:34.934086 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c57bd-58ba-4cc2-b289-c43519b15cdb None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:34.939201 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a96d4f-387b-4eea-97c6-d8bf1390c7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:34.940098 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a96d4f-387b-4eea-97c6-d8bf1390c7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:34.940373 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a96d4f-387b-4eea-97c6-d8bf1390c7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:34.940715 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d7d74f84-b057-4dc7-a756-e1d2b58a696d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be77a6cef367428e92080741f60520a2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:34.940869 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a96d4f-387b-4eea-97c6-d8bf1390c7cc admin admin] PATH_INFO: `/v3/projects/d63ef65b70504b3ba4057a7adc54807e/users/af9ac2737a6f4124bb9eb371b6eeaaa8/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:34.941819 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d7d74f84-b057-4dc7-a756-e1d2b58a696d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be77a6cef367428e92080741f60520a2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:34.942656 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d7d74f84-b057-4dc7-a756-e1d2b58a696d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be77a6cef367428e92080741f60520a2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:34.942866 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a96d4f-387b-4eea-97c6-d8bf1390c7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63ef65b70504b3ba4057a7adc54807e, user_id=af9ac2737a6f4124bb9eb371b6eeaaa8, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:34.946804 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a96d4f-387b-4eea-97c6-d8bf1390c7cc admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:34.960750 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 898/1802] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:34 2022] PUT /identity/v3/projects/d63ef65b70504b3ba4057a7adc54807e/users/af9ac2737a6f4124bb9eb371b6eeaaa8/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:34.962483 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a96d4f-387b-4eea-97c6-d8bf1390c7cc admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:34.964237 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-30a96d4f-387b-4eea-97c6-d8bf1390c7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:34.984057 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d7d74f84-b057-4dc7-a756-e1d2b58a696d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be77a6cef367428e92080741f60520a2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:34.994932 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d7d74f84-b057-4dc7-a756-e1d2b58a696d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be77a6cef367428e92080741f60520a2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:35.019795 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 905/1803] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:34 2022] DELETE /identity/v3/users/be77a6cef367428e92080741f60520a2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:35.020634 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d74f84-b057-4dc7-a756-e1d2b58a696d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:35.022018 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-d7d74f84-b057-4dc7-a756-e1d2b58a696d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:35.051163 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a96d4f-387b-4eea-97c6-d8bf1390c7cc admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:35.143011 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d74f84-b057-4dc7-a756-e1d2b58a696d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:35.147665 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a56d75-0f7d-499a-b034-64e32b3b8481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:35.148826 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5635b2c-3b4c-4971-8590-bf16a54db5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:35.149079 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a56d75-0f7d-499a-b034-64e32b3b8481 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.149586 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a56d75-0f7d-499a-b034-64e32b3b8481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.150052 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5635b2c-3b4c-4971-8590-bf16a54db5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.150278 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a56d75-0f7d-499a-b034-64e32b3b8481 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.150376 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5635b2c-3b4c-4971-8590-bf16a54db5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.150852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5635b2c-3b4c-4971-8590-bf16a54db5d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.151844 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a56d75-0f7d-499a-b034-64e32b3b8481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:35.151962 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5635b2c-3b4c-4971-8590-bf16a54db5d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:35.152257 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5635b2c-3b4c-4971-8590-bf16a54db5d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:35.152749 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a56d75-0f7d-499a-b034-64e32b3b8481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:35.155666 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5635b2c-3b4c-4971-8590-bf16a54db5d4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:35.156118 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a56d75-0f7d-499a-b034-64e32b3b8481 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:35.175839 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 906/1804] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:35.177521 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 899/1805] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:35.179270 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef19a08-f25f-48c0-95e6-e327d885fd6a None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.179765 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef19a08-f25f-48c0-95e6-e327d885fd6a None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.180430 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef19a08-f25f-48c0-95e6-e327d885fd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.181988 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5635b2c-3b4c-4971-8590-bf16a54db5d4 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:35.196219 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5635b2c-3b4c-4971-8590-bf16a54db5d4 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:35.201694 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d5792-962e-4c91-9319-4caa18129176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:35.202988 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d5792-962e-4c91-9319-4caa18129176 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.203462 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d5792-962e-4c91-9319-4caa18129176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.204130 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d5792-962e-4c91-9319-4caa18129176 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.205040 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d5792-962e-4c91-9319-4caa18129176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:35.207370 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d5792-962e-4c91-9319-4caa18129176 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:35.224652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-4ef19a08-f25f-48c0-95e6-e327d885fd6a None None] MFA Rules not processed for user `af9ac2737a6f4124bb9eb371b6eeaaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:35.226650 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-4ef19a08-f25f-48c0-95e6-e327d885fd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:35.245474 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 907/1806] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:35 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:35.246618 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d5792-962e-4c91-9319-4caa18129176 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:35.308568 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 900/1807] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:35 2022] POST /identity/v3/auth/tokens => generated 3474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:35.313827 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef19a08-f25f-48c0-95e6-e327d885fd6a None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:35.325449 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef19a08-f25f-48c0-95e6-e327d885fd6a None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:35.344101 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d5792-962e-4c91-9319-4caa18129176 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:35.349230 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7d663-4c6f-469c-bf0d-d7d8e80e74f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:35.349820 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7d663-4c6f-469c-bf0d-d7d8e80e74f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.350099 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7d663-4c6f-469c-bf0d-d7d8e80e74f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.350370 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7d663-4c6f-469c-bf0d-d7d8e80e74f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.351050 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7d663-4c6f-469c-bf0d-d7d8e80e74f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:35.353354 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7d663-4c6f-469c-bf0d-d7d8e80e74f5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:35.390638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76910b0-0dee-40af-90d3-2adf6bd5e847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:35.391650 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76910b0-0dee-40af-90d3-2adf6bd5e847 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.392038 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76910b0-0dee-40af-90d3-2adf6bd5e847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.392421 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76910b0-0dee-40af-90d3-2adf6bd5e847 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.393246 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76910b0-0dee-40af-90d3-2adf6bd5e847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:35.395443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76910b0-0dee-40af-90d3-2adf6bd5e847 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:35.405580 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 908/1808] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:35 2022] POST /identity/v3/projects => generated 401 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:35.408935 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7d663-4c6f-469c-bf0d-d7d8e80e74f5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:35.408935 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-11d7d663-4c6f-469c-bf0d-d7d8e80e74f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:35.429910 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 901/1809] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:35 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:35.431190 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76910b0-0dee-40af-90d3-2adf6bd5e847 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:35.441198 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76910b0-0dee-40af-90d3-2adf6bd5e847 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:35.495443 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7d663-4c6f-469c-bf0d-d7d8e80e74f5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:35.500937 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed508f1-8a56-4997-82f6-d804bf912e41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:35.501935 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed508f1-8a56-4997-82f6-d804bf912e41 service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.502407 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed508f1-8a56-4997-82f6-d804bf912e41 service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.502760 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed508f1-8a56-4997-82f6-d804bf912e41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.512216 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9686-7033-49fe-99b5-3f17c5b555a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:35.513200 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9686-7033-49fe-99b5-3f17c5b555a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.513652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9686-7033-49fe-99b5-3f17c5b555a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.514054 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9686-7033-49fe-99b5-3f17c5b555a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.515299 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca9686-7033-49fe-99b5-3f17c5b555a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:35.517697 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca9686-7033-49fe-99b5-3f17c5b555a6 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:35.550654 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 902/1810] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:35 2022] POST /identity/v3/users => generated 301 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:35.551588 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9686-7033-49fe-99b5-3f17c5b555a6 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:35.563337 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9686-7033-49fe-99b5-3f17c5b555a6 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:35.568705 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94449ad3-ed49-4059-aed5-f8851eba1d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:35.569524 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94449ad3-ed49-4059-aed5-f8851eba1d93 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.569882 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94449ad3-ed49-4059-aed5-f8851eba1d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.570239 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94449ad3-ed49-4059-aed5-f8851eba1d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.571061 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94449ad3-ed49-4059-aed5-f8851eba1d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:35.572783 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94449ad3-ed49-4059-aed5-f8851eba1d93 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:35.587872 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 903/1811] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:35.587872 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94449ad3-ed49-4059-aed5-f8851eba1d93 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:35.590139 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-94449ad3-ed49-4059-aed5-f8851eba1d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:35.590731 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed508f1-8a56-4997-82f6-d804bf912e41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:35.592856 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed508f1-8a56-4997-82f6-d804bf912e41 service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:35.603498 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94449ad3-ed49-4059-aed5-f8851eba1d93 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:35.604313 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 909/1812] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:35 2022] GET /identity/v3/auth/tokens => generated 3474 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:35.605265 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed508f1-8a56-4997-82f6-d804bf912e41 service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:35.611011 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07274c95-598c-47c4-a64f-d3f90a10cc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:35.611889 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07274c95-598c-47c4-a64f-d3f90a10cc20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.612169 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07274c95-598c-47c4-a64f-d3f90a10cc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.612442 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07274c95-598c-47c4-a64f-d3f90a10cc20 admin admin] PATH_INFO: `/v3/projects/aaa19bacb8874596aa41cfda5442516e` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.613777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07274c95-598c-47c4-a64f-d3f90a10cc20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa19bacb8874596aa41cfda5442516e)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:35.615745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07274c95-598c-47c4-a64f-d3f90a10cc20 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:35.619511 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed508f1-8a56-4997-82f6-d804bf912e41 service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:35.626256 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31a35f-7147-4c25-85f9-95281d1a814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:35.627534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31a35f-7147-4c25-85f9-95281d1a814f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.628005 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31a35f-7147-4c25-85f9-95281d1a814f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.629058 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31a35f-7147-4c25-85f9-95281d1a814f admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.630605 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31a35f-7147-4c25-85f9-95281d1a814f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:35.632484 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31a35f-7147-4c25-85f9-95281d1a814f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:35.644633 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 910/1813] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:35.645793 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31a35f-7147-4c25-85f9-95281d1a814f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:35.661093 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31a35f-7147-4c25-85f9-95281d1a814f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:35.668273 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810c246-6368-44a8-9fde-bb854c7d6362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:35.669025 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810c246-6368-44a8-9fde-bb854c7d6362 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.669321 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810c246-6368-44a8-9fde-bb854c7d6362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.669894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810c246-6368-44a8-9fde-bb854c7d6362 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.671307 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810c246-6368-44a8-9fde-bb854c7d6362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:35.673873 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810c246-6368-44a8-9fde-bb854c7d6362 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:35.687787 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-07274c95-598c-47c4-a64f-d3f90a10cc20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa19bacb8874596aa41cfda5442516e', 'request_id': 'req-07274c95-598c-47c4-a64f-d3f90a10cc20'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:35.691694 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 911/1814] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:35.693536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810c246-6368-44a8-9fde-bb854c7d6362 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:35.701043 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-07274c95-598c-47c4-a64f-d3f90a10cc20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa19bacb8874596aa41cfda5442516e', 'request_id': 'req-07274c95-598c-47c4-a64f-d3f90a10cc20'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:35.705828 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810c246-6368-44a8-9fde-bb854c7d6362 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:35.713264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-07274c95-598c-47c4-a64f-d3f90a10cc20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa19bacb8874596aa41cfda5442516e', 'request_id': 'req-07274c95-598c-47c4-a64f-d3f90a10cc20'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:35.735618 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-07274c95-598c-47c4-a64f-d3f90a10cc20 admin admin] The token cache is being invalidate because project aaa19bacb8874596aa41cfda5442516e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:35.736145 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-07274c95-598c-47c4-a64f-d3f90a10cc20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:35.737284 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-07274c95-598c-47c4-a64f-d3f90a10cc20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:35.740012 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 904/1815] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:35 2022] DELETE /identity/v3/projects/aaa19bacb8874596aa41cfda5442516e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:35.745871 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07274c95-598c-47c4-a64f-d3f90a10cc20 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:35.750598 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-07274c95-598c-47c4-a64f-d3f90a10cc20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:35.793368 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f7461-a6c5-42a2-bbae-8985ec92d65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:35.794411 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f7461-a6c5-42a2-bbae-8985ec92d65f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.794867 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f7461-a6c5-42a2-bbae-8985ec92d65f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.795149 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f7461-a6c5-42a2-bbae-8985ec92d65f admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.796842 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f7461-a6c5-42a2-bbae-8985ec92d65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:35.800786 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f7461-a6c5-42a2-bbae-8985ec92d65f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:35.820114 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 912/1816] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:35.820114 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114156f9-5de8-42eb-98f5-65bd42c07362 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.820114 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114156f9-5de8-42eb-98f5-65bd42c07362 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.820114 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114156f9-5de8-42eb-98f5-65bd42c07362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.844921 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-114156f9-5de8-42eb-98f5-65bd42c07362 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:35.847029 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-114156f9-5de8-42eb-98f5-65bd42c07362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:35.851328 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07274c95-598c-47c4-a64f-d3f90a10cc20 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:35.857095 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 913/1817] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:35 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:35.859138 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114156f9-5de8-42eb-98f5-65bd42c07362 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:35.860275 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-114156f9-5de8-42eb-98f5-65bd42c07362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:35.867680 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d945eaf-a40b-41ef-912b-7fcbaae7b39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:35.868791 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d945eaf-a40b-41ef-912b-7fcbaae7b39f admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.869121 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d945eaf-a40b-41ef-912b-7fcbaae7b39f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.869398 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d945eaf-a40b-41ef-912b-7fcbaae7b39f admin admin] PATH_INFO: `/v3/projects/c7f06fe6fe1c4040a4056bf4971aa3ed/users/3d33107f43ca413ebf82a8db67790cb6/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.876894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114156f9-5de8-42eb-98f5-65bd42c07362 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:35.884915 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd603e-4e18-4483-8fd1-ccb95c358002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:35.886464 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd603e-4e18-4483-8fd1-ccb95c358002 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.887186 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd603e-4e18-4483-8fd1-ccb95c358002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.887569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd603e-4e18-4483-8fd1-ccb95c358002 admin admin] PATH_INFO: `/v3/projects/454ce786396046ad95893a259902d7b6/users/c861ab94572d4e62892a2b7068f8df1f/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.891553 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d945eaf-a40b-41ef-912b-7fcbaae7b39f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f06fe6fe1c4040a4056bf4971aa3ed, user_id=3d33107f43ca413ebf82a8db67790cb6, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:35.894416 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d945eaf-a40b-41ef-912b-7fcbaae7b39f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:35.911065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd603e-4e18-4483-8fd1-ccb95c358002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=454ce786396046ad95893a259902d7b6, user_id=c861ab94572d4e62892a2b7068f8df1f, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:35.914293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd603e-4e18-4483-8fd1-ccb95c358002 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:35.916736 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 905/1818] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:35 2022] PUT /identity/v3/projects/c7f06fe6fe1c4040a4056bf4971aa3ed/users/3d33107f43ca413ebf82a8db67790cb6/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:35.918342 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e2141-efd6-4f72-b665-1edd8197ccc7 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.919318 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e2141-efd6-4f72-b665-1edd8197ccc7 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.919735 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e2141-efd6-4f72-b665-1edd8197ccc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.950679 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 914/1819] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:35 2022] PUT /identity/v3/projects/454ce786396046ad95893a259902d7b6/users/c861ab94572d4e62892a2b7068f8df1f/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:35.952758 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6eb3e9-1c71-4b82-a2e1-01f3f2e27d26 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.953099 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-a26e2141-efd6-4f72-b665-1edd8197ccc7 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:35.953215 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6eb3e9-1c71-4b82-a2e1-01f3f2e27d26 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.953603 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6eb3e9-1c71-4b82-a2e1-01f3f2e27d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.954852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-a26e2141-efd6-4f72-b665-1edd8197ccc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:35.993023 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-1f6eb3e9-1c71-4b82-a2e1-01f3f2e27d26 None None] MFA Rules not processed for user `3d33107f43ca413ebf82a8db67790cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:35.995010 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-1f6eb3e9-1c71-4b82-a2e1-01f3f2e27d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:36.093181 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 915/1820] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:35 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:36.095239 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7505b3-c7e7-4f5c-997c-bcd93354f1d7 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:36.095536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7505b3-c7e7-4f5c-997c-bcd93354f1d7 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:36.095903 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7505b3-c7e7-4f5c-997c-bcd93354f1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:36.103004 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 906/1821] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:35 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:36.104397 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e2141-efd6-4f72-b665-1edd8197ccc7 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:36.130418 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e2141-efd6-4f72-b665-1edd8197ccc7 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:36.133841 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-ac7505b3-c7e7-4f5c-997c-bcd93354f1d7 None None] MFA Rules not processed for user `c861ab94572d4e62892a2b7068f8df1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:36.136444 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-ac7505b3-c7e7-4f5c-997c-bcd93354f1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:36.149727 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70167cd0-c970-46a9-b1a7-c180b2792d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:36.153374 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70167cd0-c970-46a9-b1a7-c180b2792d1c admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:36.153861 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70167cd0-c970-46a9-b1a7-c180b2792d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:36.154287 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70167cd0-c970-46a9-b1a7-c180b2792d1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:36.157804 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70167cd0-c970-46a9-b1a7-c180b2792d1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:36.163492 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70167cd0-c970-46a9-b1a7-c180b2792d1c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:36.228839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 907/1822] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:36 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:36.229905 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70167cd0-c970-46a9-b1a7-c180b2792d1c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:36.278609 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 916/1823] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:36 2022] POST /identity/v3/auth/tokens => generated 3421 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:36.278609 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7505b3-c7e7-4f5c-997c-bcd93354f1d7 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:36.290195 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7505b3-c7e7-4f5c-997c-bcd93354f1d7 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:36.326003 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70167cd0-c970-46a9-b1a7-c180b2792d1c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:36.333003 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a1dca-cb6e-425a-83a7-7adef14ed27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:36.333743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a1dca-cb6e-425a-83a7-7adef14ed27a admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:36.334170 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a1dca-cb6e-425a-83a7-7adef14ed27a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:36.334455 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a1dca-cb6e-425a-83a7-7adef14ed27a admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:36.335198 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a1dca-cb6e-425a-83a7-7adef14ed27a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:36.335505 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a1dca-cb6e-425a-83a7-7adef14ed27a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:36.337151 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a1dca-cb6e-425a-83a7-7adef14ed27a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:36.353174 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 908/1824] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:36.353174 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a1dca-cb6e-425a-83a7-7adef14ed27a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:36.360930 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a1dca-cb6e-425a-83a7-7adef14ed27a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:36.365925 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63127eae-b341-4453-9b94-96fbce0236cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:36.366302 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e09dc-edfa-4b72-aa86-439af7d75dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:36.366771 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63127eae-b341-4453-9b94-96fbce0236cf admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:36.366958 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e09dc-edfa-4b72-aa86-439af7d75dbf admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:36.367123 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63127eae-b341-4453-9b94-96fbce0236cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:36.367255 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e09dc-edfa-4b72-aa86-439af7d75dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:36.367513 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e09dc-edfa-4b72-aa86-439af7d75dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:36.367752 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63127eae-b341-4453-9b94-96fbce0236cf admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:36.368270 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e09dc-edfa-4b72-aa86-439af7d75dbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:36.368855 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63127eae-b341-4453-9b94-96fbce0236cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:36.370370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e09dc-edfa-4b72-aa86-439af7d75dbf admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:36.370807 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63127eae-b341-4453-9b94-96fbce0236cf admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:36.394886 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 917/1825] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:36 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:36.395821 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63127eae-b341-4453-9b94-96fbce0236cf admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:36.407071 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 909/1826] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:36 2022] POST /identity/v3/projects => generated 401 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:36.407493 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63127eae-b341-4453-9b94-96fbce0236cf admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:36.407921 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e09dc-edfa-4b72-aa86-439af7d75dbf admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:36.409520 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-610e09dc-edfa-4b72-aa86-439af7d75dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:36.489031 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4da1d8-577b-49f1-817c-1399c23ba8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:36.490405 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4da1d8-577b-49f1-817c-1399c23ba8c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:36.490932 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4da1d8-577b-49f1-817c-1399c23ba8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:36.491310 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4da1d8-577b-49f1-817c-1399c23ba8c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:36.492147 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4da1d8-577b-49f1-817c-1399c23ba8c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:36.494312 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e09dc-edfa-4b72-aa86-439af7d75dbf admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:36.494461 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4da1d8-577b-49f1-817c-1399c23ba8c7 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:36.501391 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55462d-2102-4100-9bac-5b2e53c45b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:36.502606 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55462d-2102-4100-9bac-5b2e53c45b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:36.503051 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55462d-2102-4100-9bac-5b2e53c45b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:36.503458 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55462d-2102-4100-9bac-5b2e53c45b78 admin admin] PATH_INFO: `/v3/users/f96dab5e1fb24480ba270fbdb7254481` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:36.505029 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55462d-2102-4100-9bac-5b2e53c45b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f96dab5e1fb24480ba270fbdb7254481)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:36.507278 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55462d-2102-4100-9bac-5b2e53c45b78 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:36.534605 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 918/1827] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:36 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:36.534605 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4da1d8-577b-49f1-817c-1399c23ba8c7 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:36.583871 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-ba55462d-2102-4100-9bac-5b2e53c45b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f96dab5e1fb24480ba270fbdb7254481'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:36.585403 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-ba55462d-2102-4100-9bac-5b2e53c45b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f96dab5e1fb24480ba270fbdb7254481'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:36.594341 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-ba55462d-2102-4100-9bac-5b2e53c45b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f96dab5e1fb24480ba270fbdb7254481'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:36.604124 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-ba55462d-2102-4100-9bac-5b2e53c45b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f96dab5e1fb24480ba270fbdb7254481'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:36.618387 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-ba55462d-2102-4100-9bac-5b2e53c45b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f96dab5e1fb24480ba270fbdb7254481'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:36.626178 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 910/1828] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:36 2022] DELETE /identity/v3/users/f96dab5e1fb24480ba270fbdb7254481 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:36.626954 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55462d-2102-4100-9bac-5b2e53c45b78 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:36.628426 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ba55462d-2102-4100-9bac-5b2e53c45b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:36.632233 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4da1d8-577b-49f1-817c-1399c23ba8c7 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:36.696700 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dea746-7500-4d27-9be7-5eddb2e1ac9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:36.697437 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dea746-7500-4d27-9be7-5eddb2e1ac9b admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:36.697714 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dea746-7500-4d27-9be7-5eddb2e1ac9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:36.697990 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dea746-7500-4d27-9be7-5eddb2e1ac9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:36.698702 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dea746-7500-4d27-9be7-5eddb2e1ac9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:36.700322 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dea746-7500-4d27-9be7-5eddb2e1ac9b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:36.709690 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55462d-2102-4100-9bac-5b2e53c45b78 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:36.710546 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 919/1829] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:36.711343 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dea746-7500-4d27-9be7-5eddb2e1ac9b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:36.713077 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a9dea746-7500-4d27-9be7-5eddb2e1ac9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:36.714659 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1f867-cebd-4069-9e75-2aef34b5d93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:36.715358 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1f867-cebd-4069-9e75-2aef34b5d93f admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:36.715641 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1f867-cebd-4069-9e75-2aef34b5d93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:36.715915 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1f867-cebd-4069-9e75-2aef34b5d93f admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:36.716601 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1f867-cebd-4069-9e75-2aef34b5d93f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:36.718749 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1f867-cebd-4069-9e75-2aef34b5d93f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:36.725355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dea746-7500-4d27-9be7-5eddb2e1ac9b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:36.730049 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb4a97-e783-4f5d-b6b3-1a076148815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:36.730941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb4a97-e783-4f5d-b6b3-1a076148815e admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:36.731332 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb4a97-e783-4f5d-b6b3-1a076148815e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:36.731733 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb4a97-e783-4f5d-b6b3-1a076148815e admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:36.732481 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb4a97-e783-4f5d-b6b3-1a076148815e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:36.735160 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb4a97-e783-4f5d-b6b3-1a076148815e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:36.739888 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 911/1830] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:36 2022] POST /identity/v3/users => generated 307 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:36.741408 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8eedb-6a26-4188-9364-bf295b2dd1f5 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:36.741701 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8eedb-6a26-4188-9364-bf295b2dd1f5 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:36.742002 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8eedb-6a26-4188-9364-bf295b2dd1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:36.759079 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 920/1831] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:36 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:36.760010 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb4a97-e783-4f5d-b6b3-1a076148815e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:36.761698 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-4beb4a97-e783-4f5d-b6b3-1a076148815e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:36.766165 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-bad8eedb-6a26-4188-9364-bf295b2dd1f5 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:36.767336 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-bad8eedb-6a26-4188-9364-bf295b2dd1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:36.773601 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb4a97-e783-4f5d-b6b3-1a076148815e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:36.775047 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 912/1832] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:36 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:36.776080 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8eedb-6a26-4188-9364-bf295b2dd1f5 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:36.779233 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf2f2d-3c02-402d-ac72-0c1e39f99d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:36.780088 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf2f2d-3c02-402d-ac72-0c1e39f99d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:36.780378 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf2f2d-3c02-402d-ac72-0c1e39f99d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:36.780693 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf2f2d-3c02-402d-ac72-0c1e39f99d54 admin admin] PATH_INFO: `/v3/projects/450fe29083e649918b3ebf41b2c9d3d0/users/98851cff7f8c41b7bf6526098babfa4d/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:36.792218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8eedb-6a26-4188-9364-bf295b2dd1f5 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:36.796292 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf2f2d-3c02-402d-ac72-0c1e39f99d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=450fe29083e649918b3ebf41b2c9d3d0, user_id=98851cff7f8c41b7bf6526098babfa4d, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:36.797770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f863f0-93f3-4ac2-9b5c-32488c7acf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:36.798432 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f863f0-93f3-4ac2-9b5c-32488c7acf68 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:36.798709 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f863f0-93f3-4ac2-9b5c-32488c7acf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:36.798923 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf2f2d-3c02-402d-ac72-0c1e39f99d54 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:36.799023 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f863f0-93f3-4ac2-9b5c-32488c7acf68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:36.799673 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f863f0-93f3-4ac2-9b5c-32488c7acf68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:36.801264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f863f0-93f3-4ac2-9b5c-32488c7acf68 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:36.815986 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 913/1833] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:36.816168 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 921/1834] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:36 2022] PUT /identity/v3/projects/450fe29083e649918b3ebf41b2c9d3d0/users/98851cff7f8c41b7bf6526098babfa4d/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:36.816247 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f863f0-93f3-4ac2-9b5c-32488c7acf68 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:36.816330 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf2f2d-3c02-402d-ac72-0c1e39f99d54 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:36.817034 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-bfcf2f2d-3c02-402d-ac72-0c1e39f99d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:36.825640 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f863f0-93f3-4ac2-9b5c-32488c7acf68 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:36.879024 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d6dac-aff8-4581-bba2-1fdaa1dc7d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:36.879229 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf2f2d-3c02-402d-ac72-0c1e39f99d54 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:36.879607 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d6dac-aff8-4581-bba2-1fdaa1dc7d4d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:36.879883 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d6dac-aff8-4581-bba2-1fdaa1dc7d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:36.880153 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d6dac-aff8-4581-bba2-1fdaa1dc7d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:36.880894 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d6dac-aff8-4581-bba2-1fdaa1dc7d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:36.882636 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d6dac-aff8-4581-bba2-1fdaa1dc7d4d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:36.884081 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e908a-1726-4778-8a07-d4d5896ced22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:36.884868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e908a-1726-4778-8a07-d4d5896ced22 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:36.885248 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e908a-1726-4778-8a07-d4d5896ced22 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:36.885644 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e908a-1726-4778-8a07-d4d5896ced22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:36.893468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 914/1835] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:36.894127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d6dac-aff8-4581-bba2-1fdaa1dc7d4d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:36.899674 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e908a-1726-4778-8a07-d4d5896ced22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:36.905267 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e908a-1726-4778-8a07-d4d5896ced22 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:36.909103 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d6dac-aff8-4581-bba2-1fdaa1dc7d4d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:36.913811 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 922/1836] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:36 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:36.914005 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055a535-1635-48c2-8949-3f3b7420ab70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:36.914433 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e908a-1726-4778-8a07-d4d5896ced22 service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:36.914802 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055a535-1635-48c2-8949-3f3b7420ab70 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:36.915145 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055a535-1635-48c2-8949-3f3b7420ab70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:36.915485 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055a535-1635-48c2-8949-3f3b7420ab70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:36.916275 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055a535-1635-48c2-8949-3f3b7420ab70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:36.918063 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055a535-1635-48c2-8949-3f3b7420ab70 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:36.924725 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e908a-1726-4778-8a07-d4d5896ced22 service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:36.929517 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3da4d-9da3-49a7-815c-c911681d1b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:36.930426 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 915/1837] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:36.930538 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3da4d-9da3-49a7-815c-c911681d1b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:36.930676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3da4d-9da3-49a7-815c-c911681d1b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:36.930949 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3da4d-9da3-49a7-815c-c911681d1b66 admin admin] PATH_INFO: `/v3/projects/624a0367dddf42d28bb1d53a1797f59e/users/89bc109a1c6e448c9ea43ddf584740dc/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:36.933684 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055a535-1635-48c2-8949-3f3b7420ab70 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:36.948437 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055a535-1635-48c2-8949-3f3b7420ab70 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:36.953854 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3da4d-9da3-49a7-815c-c911681d1b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=624a0367dddf42d28bb1d53a1797f59e, user_id=89bc109a1c6e448c9ea43ddf584740dc, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:36.956660 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3da4d-9da3-49a7-815c-c911681d1b66 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:36.957707 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d2883-9049-45a7-b878-6a38e00809a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:36.958517 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d2883-9049-45a7-b878-6a38e00809a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:36.958896 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d2883-9049-45a7-b878-6a38e00809a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:36.959496 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d2883-9049-45a7-b878-6a38e00809a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:36.960384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d2883-9049-45a7-b878-6a38e00809a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:36.962198 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d2883-9049-45a7-b878-6a38e00809a0 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:36.976245 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 916/1838] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:36.977191 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d2883-9049-45a7-b878-6a38e00809a0 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:36.981752 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 923/1839] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:36 2022] PUT /identity/v3/projects/624a0367dddf42d28bb1d53a1797f59e/users/89bc109a1c6e448c9ea43ddf584740dc/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:36.983575 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3da4d-9da3-49a7-815c-c911681d1b66 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:36.990655 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d2883-9049-45a7-b878-6a38e00809a0 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:37.068274 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3da4d-9da3-49a7-815c-c911681d1b66 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:37.074451 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7f903-c616-441f-9514-798fcd456159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:37.075634 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7f903-c616-441f-9514-798fcd456159 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:37.076106 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7f903-c616-441f-9514-798fcd456159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:37.076557 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7f903-c616-441f-9514-798fcd456159 admin admin] PATH_INFO: `/v3/projects/9ec2e0f6728745118e1718616adb4d5f/users/af6efbb4246c45108e2936478c1a19f6/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:37.089593 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a60bb6-a885-45c2-94ea-4228bf772044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:37.091633 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a60bb6-a885-45c2-94ea-4228bf772044 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:37.093051 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a60bb6-a885-45c2-94ea-4228bf772044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:37.093783 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a60bb6-a885-45c2-94ea-4228bf772044 admin admin] PATH_INFO: `/v3/projects/450fe29083e649918b3ebf41b2c9d3d0/users/98851cff7f8c41b7bf6526098babfa4d/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:37.097492 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7f903-c616-441f-9514-798fcd456159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec2e0f6728745118e1718616adb4d5f, user_id=af6efbb4246c45108e2936478c1a19f6, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:37.098172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a60bb6-a885-45c2-94ea-4228bf772044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=450fe29083e649918b3ebf41b2c9d3d0, user_id=98851cff7f8c41b7bf6526098babfa4d, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:37.100897 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7f903-c616-441f-9514-798fcd456159 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:37.104622 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a60bb6-a885-45c2-94ea-4228bf772044 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:37.127174 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 924/1840] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:36 2022] PUT /identity/v3/projects/9ec2e0f6728745118e1718616adb4d5f/users/af6efbb4246c45108e2936478c1a19f6/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:37.128143 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7f903-c616-441f-9514-798fcd456159 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:37.131353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 917/1841] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:36 2022] PUT /identity/v3/projects/450fe29083e649918b3ebf41b2c9d3d0/users/98851cff7f8c41b7bf6526098babfa4d/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:37.142465 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09847d-dcad-49f3-8298-59787eba0c2b None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:37.142826 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09847d-dcad-49f3-8298-59787eba0c2b None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:37.143160 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09847d-dcad-49f3-8298-59787eba0c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:37.175987 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-ce09847d-dcad-49f3-8298-59787eba0c2b None None] MFA Rules not processed for user `af6efbb4246c45108e2936478c1a19f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:37.177300 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ce09847d-dcad-49f3-8298-59787eba0c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:37.224490 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7f903-c616-441f-9514-798fcd456159 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:37.250893 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 918/1842] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:37 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:57:37.252312 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36329169-13a0-4261-8370-d347245570be None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:37.252598 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36329169-13a0-4261-8370-d347245570be None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:37.253067 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36329169-13a0-4261-8370-d347245570be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:37.284031 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-36329169-13a0-4261-8370-d347245570be None None] MFA Rules not processed for user `98851cff7f8c41b7bf6526098babfa4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:37.285281 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-36329169-13a0-4261-8370-d347245570be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:37.293521 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be78ff-5aa2-44c0-a2a7-ffef18914d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:37.294263 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be78ff-5aa2-44c0-a2a7-ffef18914d7a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:37.294548 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be78ff-5aa2-44c0-a2a7-ffef18914d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:37.294823 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be78ff-5aa2-44c0-a2a7-ffef18914d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:37.296141 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be78ff-5aa2-44c0-a2a7-ffef18914d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:37.298194 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be78ff-5aa2-44c0-a2a7-ffef18914d7a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:37.308903 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 925/1843] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:37.309823 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be78ff-5aa2-44c0-a2a7-ffef18914d7a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:37.313725 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a5be78ff-5aa2-44c0-a2a7-ffef18914d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:37.333085 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be78ff-5aa2-44c0-a2a7-ffef18914d7a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:37.339556 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05562aa7-844a-4ffc-af62-227fd58b83e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:37.340512 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05562aa7-844a-4ffc-af62-227fd58b83e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:37.340841 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05562aa7-844a-4ffc-af62-227fd58b83e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:37.341236 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05562aa7-844a-4ffc-af62-227fd58b83e3 admin admin] PATH_INFO: `/v3/projects/ac64597db67e42e5812e3e77d34e11b5` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:37.343911 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05562aa7-844a-4ffc-af62-227fd58b83e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac64597db67e42e5812e3e77d34e11b5)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:37.346394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05562aa7-844a-4ffc-af62-227fd58b83e3 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:37.374548 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 919/1844] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:37 2022] POST /identity/v3/auth/tokens => generated 3466 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:37.375550 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36329169-13a0-4261-8370-d347245570be None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:37.395316 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36329169-13a0-4261-8370-d347245570be None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:37.414592 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-05562aa7-844a-4ffc-af62-227fd58b83e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac64597db67e42e5812e3e77d34e11b5', 'request_id': 'req-05562aa7-844a-4ffc-af62-227fd58b83e3'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:37.422808 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-05562aa7-844a-4ffc-af62-227fd58b83e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac64597db67e42e5812e3e77d34e11b5', 'request_id': 'req-05562aa7-844a-4ffc-af62-227fd58b83e3'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:37.430867 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-05562aa7-844a-4ffc-af62-227fd58b83e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac64597db67e42e5812e3e77d34e11b5', 'request_id': 'req-05562aa7-844a-4ffc-af62-227fd58b83e3'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:37.449753 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-05562aa7-844a-4ffc-af62-227fd58b83e3 admin admin] The token cache is being invalidate because project ac64597db67e42e5812e3e77d34e11b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:37.450097 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-05562aa7-844a-4ffc-af62-227fd58b83e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:37.450934 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-05562aa7-844a-4ffc-af62-227fd58b83e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:37.454219 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 926/1845] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:37 2022] DELETE /identity/v3/projects/ac64597db67e42e5812e3e77d34e11b5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:37.455153 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05562aa7-844a-4ffc-af62-227fd58b83e3 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:37.456626 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-05562aa7-844a-4ffc-af62-227fd58b83e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:37.518713 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ada3e0-0268-4fce-959c-50cb6893775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:37.520463 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ada3e0-0268-4fce-959c-50cb6893775d admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:37.520840 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ada3e0-0268-4fce-959c-50cb6893775d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:37.521318 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ada3e0-0268-4fce-959c-50cb6893775d admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:37.522261 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ada3e0-0268-4fce-959c-50cb6893775d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:37.525848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ada3e0-0268-4fce-959c-50cb6893775d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:37.557129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05562aa7-844a-4ffc-af62-227fd58b83e3 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:37.577468 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a7291-7396-4ee6-b1f4-65ce3dc42e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:37.578801 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a7291-7396-4ee6-b1f4-65ce3dc42e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:37.579088 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a7291-7396-4ee6-b1f4-65ce3dc42e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:37.579384 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a7291-7396-4ee6-b1f4-65ce3dc42e4b admin admin] PATH_INFO: `/v3/projects/624a0367dddf42d28bb1d53a1797f59e/users/89bc109a1c6e448c9ea43ddf584740dc/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:37.582466 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a7291-7396-4ee6-b1f4-65ce3dc42e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=624a0367dddf42d28bb1d53a1797f59e, user_id=89bc109a1c6e448c9ea43ddf584740dc, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:37.586593 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a7291-7396-4ee6-b1f4-65ce3dc42e4b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:37.590725 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 920/1846] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:37 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:37.592037 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ada3e0-0268-4fce-959c-50cb6893775d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:37.594156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-39ada3e0-0268-4fce-959c-50cb6893775d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:37.611417 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 927/1847] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:37 2022] PUT /identity/v3/projects/624a0367dddf42d28bb1d53a1797f59e/users/89bc109a1c6e448c9ea43ddf584740dc/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:37.621225 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a7291-7396-4ee6-b1f4-65ce3dc42e4b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:37.623027 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-bd1a7291-7396-4ee6-b1f4-65ce3dc42e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:37.743432 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ada3e0-0268-4fce-959c-50cb6893775d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:37.773476 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a7291-7396-4ee6-b1f4-65ce3dc42e4b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:37.788036 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ff170-e139-42a5-98e8-f98edc64a34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:37.788960 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ff170-e139-42a5-98e8-f98edc64a34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:37.789241 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ff170-e139-42a5-98e8-f98edc64a34f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:37.789511 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ff170-e139-42a5-98e8-f98edc64a34f admin admin] PATH_INFO: `/v3/users/af9ac2737a6f4124bb9eb371b6eeaaa8` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:37.791711 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ff170-e139-42a5-98e8-f98edc64a34f admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9ac2737a6f4124bb9eb371b6eeaaa8)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:37.794242 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ff170-e139-42a5-98e8-f98edc64a34f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:37.892774 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249eb103-b5f0-4b90-96eb-78c6fe32b17f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:37.894912 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eb103-b5f0-4b90-96eb-78c6fe32b17f service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:37.895281 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eb103-b5f0-4b90-96eb-78c6fe32b17f service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:37.895635 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eb103-b5f0-4b90-96eb-78c6fe32b17f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:37.897622 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a57ff170-e139-42a5-98e8-f98edc64a34f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9ac2737a6f4124bb9eb371b6eeaaa8'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:37.898554 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a57ff170-e139-42a5-98e8-f98edc64a34f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9ac2737a6f4124bb9eb371b6eeaaa8'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:37.899513 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a57ff170-e139-42a5-98e8-f98edc64a34f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9ac2737a6f4124bb9eb371b6eeaaa8'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:37.903443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-249eb103-b5f0-4b90-96eb-78c6fe32b17f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:37.910597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a57ff170-e139-42a5-98e8-f98edc64a34f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9ac2737a6f4124bb9eb371b6eeaaa8'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:37.918590 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a57ff170-e139-42a5-98e8-f98edc64a34f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9ac2737a6f4124bb9eb371b6eeaaa8'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:37.943470 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 928/1848] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:37 2022] DELETE /identity/v3/users/af9ac2737a6f4124bb9eb371b6eeaaa8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:37.945166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ff170-e139-42a5-98e8-f98edc64a34f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:37.946659 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a57ff170-e139-42a5-98e8-f98edc64a34f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:38.020087 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ff170-e139-42a5-98e8-f98edc64a34f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:38.031356 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc23f8-19f3-4d29-8301-c24e82edfdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:38.032641 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc23f8-19f3-4d29-8301-c24e82edfdb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.033497 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc23f8-19f3-4d29-8301-c24e82edfdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.035089 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc23f8-19f3-4d29-8301-c24e82edfdb0 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.039746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc23f8-19f3-4d29-8301-c24e82edfdb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:38.041882 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc23f8-19f3-4d29-8301-c24e82edfdb0 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:38.056506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249eb103-b5f0-4b90-96eb-78c6fe32b17f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:38.058400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249eb103-b5f0-4b90-96eb-78c6fe32b17f service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:38.074335 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 929/1849] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:37 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:38.077296 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd09b17-4b6c-465b-80e8-a3f2446db069 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.077589 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd09b17-4b6c-465b-80e8-a3f2446db069 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.077914 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd09b17-4b6c-465b-80e8-a3f2446db069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.081620 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 921/1850] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:37 2022] GET /identity/v3/auth/tokens => generated 3466 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:38.082784 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249eb103-b5f0-4b90-96eb-78c6fe32b17f service cinder] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:38.115930 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249eb103-b5f0-4b90-96eb-78c6fe32b17f service cinder] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:38.135794 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f55c0-edd7-420f-bd6b-a0e4d32a030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:38.136693 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f55c0-edd7-420f-bd6b-a0e4d32a030f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.137108 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f55c0-edd7-420f-bd6b-a0e4d32a030f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.137482 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f55c0-edd7-420f-bd6b-a0e4d32a030f admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.138349 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f55c0-edd7-420f-bd6b-a0e4d32a030f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:38.141125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f55c0-edd7-420f-bd6b-a0e4d32a030f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:38.162730 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-9bd09b17-4b6c-465b-80e8-a3f2446db069 None None] MFA Rules not processed for user `89bc109a1c6e448c9ea43ddf584740dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:38.165008 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-9bd09b17-4b6c-465b-80e8-a3f2446db069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:38.176882 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 922/1851] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:38.179124 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f55c0-edd7-420f-bd6b-a0e4d32a030f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:38.211247 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f55c0-edd7-420f-bd6b-a0e4d32a030f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:38.216645 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86dc4eb-9407-45c6-a2c7-176a18ab6a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:38.218386 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dc4eb-9407-45c6-a2c7-176a18ab6a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.218828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dc4eb-9407-45c6-a2c7-176a18ab6a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.219568 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dc4eb-9407-45c6-a2c7-176a18ab6a11 admin admin] PATH_INFO: `/v3/projects/31c410f2195348fbb56af3e3c23d906b/users/0f9e4d354544454eb9113a808fbdfe1b/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.254674 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86dc4eb-9407-45c6-a2c7-176a18ab6a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c410f2195348fbb56af3e3c23d906b, user_id=0f9e4d354544454eb9113a808fbdfe1b, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:38.258326 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86dc4eb-9407-45c6-a2c7-176a18ab6a11 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:38.299991 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 923/1852] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:38 2022] PUT /identity/v3/projects/31c410f2195348fbb56af3e3c23d906b/users/0f9e4d354544454eb9113a808fbdfe1b/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:38.305979 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86dc4eb-9407-45c6-a2c7-176a18ab6a11 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:38.394410 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 930/1853] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:38 2022] POST /identity/v3/auth/tokens => generated 3488 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:38.404450 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86dc4eb-9407-45c6-a2c7-176a18ab6a11 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:38.409076 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd09b17-4b6c-465b-80e8-a3f2446db069 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:38.410835 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-9bd09b17-4b6c-465b-80e8-a3f2446db069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:38.417452 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd72df9-0157-46d7-a9c1-53e50467b4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:38.419143 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd72df9-0157-46d7-a9c1-53e50467b4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.420788 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd72df9-0157-46d7-a9c1-53e50467b4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.422169 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd72df9-0157-46d7-a9c1-53e50467b4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.424065 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd72df9-0157-46d7-a9c1-53e50467b4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:38.427985 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd72df9-0157-46d7-a9c1-53e50467b4b8 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:38.469949 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 924/1854] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:38.471823 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd72df9-0157-46d7-a9c1-53e50467b4b8 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:38.488958 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd72df9-0157-46d7-a9c1-53e50467b4b8 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:38.498482 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd19f6-3ae9-401b-a644-bef7ab894969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:38.500954 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd19f6-3ae9-401b-a644-bef7ab894969 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.501505 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd19f6-3ae9-401b-a644-bef7ab894969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.502270 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd19f6-3ae9-401b-a644-bef7ab894969 admin admin] PATH_INFO: `/v3/projects/31c410f2195348fbb56af3e3c23d906b/users/0f9e4d354544454eb9113a808fbdfe1b/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.505881 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd19f6-3ae9-401b-a644-bef7ab894969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c410f2195348fbb56af3e3c23d906b, user_id=0f9e4d354544454eb9113a808fbdfe1b, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:38.510340 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd19f6-3ae9-401b-a644-bef7ab894969 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:38.548712 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 925/1855] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:38 2022] PUT /identity/v3/projects/31c410f2195348fbb56af3e3c23d906b/users/0f9e4d354544454eb9113a808fbdfe1b/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:38.550567 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38982b6b-9412-43a9-b8a8-da8273cf0aee None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.550968 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38982b6b-9412-43a9-b8a8-da8273cf0aee None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.551414 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38982b6b-9412-43a9-b8a8-da8273cf0aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.560522 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd09b17-4b6c-465b-80e8-a3f2446db069 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:38.593522 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-38982b6b-9412-43a9-b8a8-da8273cf0aee None None] MFA Rules not processed for user `0f9e4d354544454eb9113a808fbdfe1b`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:38.595220 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-38982b6b-9412-43a9-b8a8-da8273cf0aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:38.715018 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 926/1856] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:38 2022] POST /identity/v3/auth/tokens => generated 3472 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:38.727177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7f6c1-c877-4816-852f-0d364917c10a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:38.728474 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7f6c1-c877-4816-852f-0d364917c10a service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.729387 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7f6c1-c877-4816-852f-0d364917c10a service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.730037 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7f6c1-c877-4816-852f-0d364917c10a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.745604 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38982b6b-9412-43a9-b8a8-da8273cf0aee None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:38.752500 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-38982b6b-9412-43a9-b8a8-da8273cf0aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:38.770667 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38982b6b-9412-43a9-b8a8-da8273cf0aee None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:38.776850 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02d07c-3f7b-4a62-b52a-111f6e199ea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:38.777854 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02d07c-3f7b-4a62-b52a-111f6e199ea7 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.778408 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02d07c-3f7b-4a62-b52a-111f6e199ea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.779661 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02d07c-3f7b-4a62-b52a-111f6e199ea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.798183 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02d07c-3f7b-4a62-b52a-111f6e199ea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:38.800580 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02d07c-3f7b-4a62-b52a-111f6e199ea7 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:38.817474 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 927/1857] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:38 2022] GET /identity/v3/auth/tokens => generated 3472 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:57:38.866991 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02d07c-3f7b-4a62-b52a-111f6e199ea7 service cinder] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:38.885267 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7f6c1-c877-4816-852f-0d364917c10a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:38.887305 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7f6c1-c877-4816-852f-0d364917c10a service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:38.905636 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 931/1858] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:38 2022] GET /identity/v3/auth/tokens => generated 3488 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:57:38.917079 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7f6c1-c877-4816-852f-0d364917c10a service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:38.924357 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-2ba7f6c1-c877-4816-852f-0d364917c10a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:39.012984 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02d07c-3f7b-4a62-b52a-111f6e199ea7 service cinder] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:39.021574 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67593fc8-5a13-4461-8f91-1226a53ea972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:39.022471 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67593fc8-5a13-4461-8f91-1226a53ea972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:39.022751 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67593fc8-5a13-4461-8f91-1226a53ea972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:39.023022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67593fc8-5a13-4461-8f91-1226a53ea972 admin admin] PATH_INFO: `/v3/users/af6efbb4246c45108e2936478c1a19f6` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:39.024770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67593fc8-5a13-4461-8f91-1226a53ea972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af6efbb4246c45108e2936478c1a19f6)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:39.027649 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67593fc8-5a13-4461-8f91-1226a53ea972 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:39.053788 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7f6c1-c877-4816-852f-0d364917c10a service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:39.059588 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbee06-327a-4df4-be91-ec0b7687982e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:39.060827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbee06-327a-4df4-be91-ec0b7687982e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:39.061721 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbee06-327a-4df4-be91-ec0b7687982e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:39.062942 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbee06-327a-4df4-be91-ec0b7687982e admin admin] PATH_INFO: `/v3/users/3d33107f43ca413ebf82a8db67790cb6` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:39.064343 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbee06-327a-4df4-be91-ec0b7687982e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d33107f43ca413ebf82a8db67790cb6)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:39.066515 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbee06-327a-4df4-be91-ec0b7687982e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:39.115448 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-67593fc8-5a13-4461-8f91-1226a53ea972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af6efbb4246c45108e2936478c1a19f6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.116715 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-67593fc8-5a13-4461-8f91-1226a53ea972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af6efbb4246c45108e2936478c1a19f6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.128406 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-67593fc8-5a13-4461-8f91-1226a53ea972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af6efbb4246c45108e2936478c1a19f6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.145104 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c3fbee06-327a-4df4-be91-ec0b7687982e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d33107f43ca413ebf82a8db67790cb6'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.145631 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-67593fc8-5a13-4461-8f91-1226a53ea972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af6efbb4246c45108e2936478c1a19f6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.145768 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c3fbee06-327a-4df4-be91-ec0b7687982e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d33107f43ca413ebf82a8db67790cb6'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.146347 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c3fbee06-327a-4df4-be91-ec0b7687982e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d33107f43ca413ebf82a8db67790cb6'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.157328 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c3fbee06-327a-4df4-be91-ec0b7687982e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d33107f43ca413ebf82a8db67790cb6'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.164867 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-67593fc8-5a13-4461-8f91-1226a53ea972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af6efbb4246c45108e2936478c1a19f6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.167349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c3fbee06-327a-4df4-be91-ec0b7687982e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d33107f43ca413ebf82a8db67790cb6'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.174965 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 928/1859] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:38 2022] DELETE /identity/v3/users/af6efbb4246c45108e2936478c1a19f6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:39.176567 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67593fc8-5a13-4461-8f91-1226a53ea972 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:39.178906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-67593fc8-5a13-4461-8f91-1226a53ea972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:39.195564 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 932/1860] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:38 2022] DELETE /identity/v3/users/3d33107f43ca413ebf82a8db67790cb6 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:39.195564 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef969650-950c-46d0-b920-b3e96880605e None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:39.195860 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef969650-950c-46d0-b920-b3e96880605e None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:39.195947 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef969650-950c-46d0-b920-b3e96880605e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:39.216788 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-ef969650-950c-46d0-b920-b3e96880605e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:39.218518 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-ef969650-950c-46d0-b920-b3e96880605e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:39.267171 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67593fc8-5a13-4461-8f91-1226a53ea972 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:39.319340 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 933/1861] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:39 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:39.320648 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9feccd7-67fe-4497-a3fd-c40bd5d3c0c7 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:39.320997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9feccd7-67fe-4497-a3fd-c40bd5d3c0c7 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:39.321269 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9feccd7-67fe-4497-a3fd-c40bd5d3c0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:39.333156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb0f5d-2087-4d13-a4d9-f440eecfdba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:39.334294 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb0f5d-2087-4d13-a4d9-f440eecfdba6 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:39.334635 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb0f5d-2087-4d13-a4d9-f440eecfdba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:39.334918 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb0f5d-2087-4d13-a4d9-f440eecfdba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:39.336817 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-45eb0f5d-2087-4d13-a4d9-f440eecfdba6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:39.343880 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-a9feccd7-67fe-4497-a3fd-c40bd5d3c0c7 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:39.345139 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a9feccd7-67fe-4497-a3fd-c40bd5d3c0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:39.355294 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 934/1862] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:39 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:39.356486 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9feccd7-67fe-4497-a3fd-c40bd5d3c0c7 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:39.366455 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a9feccd7-67fe-4497-a3fd-c40bd5d3c0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:39.379246 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9feccd7-67fe-4497-a3fd-c40bd5d3c0c7 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:39.384621 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445af598-9cf8-4768-9850-4dd800e685c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:39.385543 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445af598-9cf8-4768-9850-4dd800e685c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:39.385923 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445af598-9cf8-4768-9850-4dd800e685c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:39.386089 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445af598-9cf8-4768-9850-4dd800e685c5 admin admin] PATH_INFO: `/v3/projects/d63ef65b70504b3ba4057a7adc54807e` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:39.387360 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445af598-9cf8-4768-9850-4dd800e685c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63ef65b70504b3ba4057a7adc54807e)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:39.390186 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445af598-9cf8-4768-9850-4dd800e685c5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:39.402230 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb0f5d-2087-4d13-a4d9-f440eecfdba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:39.404457 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb0f5d-2087-4d13-a4d9-f440eecfdba6 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:39.419052 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 929/1863] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:39 2022] GET /identity/v3/auth/tokens => generated 3421 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:39.422094 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb0f5d-2087-4d13-a4d9-f440eecfdba6 service cinder] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:39.423890 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-45eb0f5d-2087-4d13-a4d9-f440eecfdba6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:39.446608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-445af598-9cf8-4768-9850-4dd800e685c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63ef65b70504b3ba4057a7adc54807e', 'request_id': 'req-445af598-9cf8-4768-9850-4dd800e685c5'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.456776 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-445af598-9cf8-4768-9850-4dd800e685c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63ef65b70504b3ba4057a7adc54807e', 'request_id': 'req-445af598-9cf8-4768-9850-4dd800e685c5'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.465831 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-445af598-9cf8-4768-9850-4dd800e685c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63ef65b70504b3ba4057a7adc54807e', 'request_id': 'req-445af598-9cf8-4768-9850-4dd800e685c5'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.483039 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-445af598-9cf8-4768-9850-4dd800e685c5 admin admin] The token cache is being invalidate because project d63ef65b70504b3ba4057a7adc54807e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:39.483495 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-445af598-9cf8-4768-9850-4dd800e685c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.484572 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-445af598-9cf8-4768-9850-4dd800e685c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:39.495007 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 935/1864] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:39 2022] DELETE /identity/v3/projects/d63ef65b70504b3ba4057a7adc54807e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:39.496106 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445af598-9cf8-4768-9850-4dd800e685c5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:39.501588 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-445af598-9cf8-4768-9850-4dd800e685c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:39.524106 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb0f5d-2087-4d13-a4d9-f440eecfdba6 service cinder] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:39.579500 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445af598-9cf8-4768-9850-4dd800e685c5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:39.596280 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45426dfe-18e9-4938-a3c9-e79718589770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:39.597129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45426dfe-18e9-4938-a3c9-e79718589770 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:39.597608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45426dfe-18e9-4938-a3c9-e79718589770 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:39.597938 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45426dfe-18e9-4938-a3c9-e79718589770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:39.600314 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-45426dfe-18e9-4938-a3c9-e79718589770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:39.604897 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b550b-f439-4d9c-9234-59046dd68534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:39.605793 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b550b-f439-4d9c-9234-59046dd68534 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:39.606260 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b550b-f439-4d9c-9234-59046dd68534 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:39.606674 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b550b-f439-4d9c-9234-59046dd68534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:39.611536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-475b550b-f439-4d9c-9234-59046dd68534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:39.719456 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45426dfe-18e9-4938-a3c9-e79718589770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:39.721313 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45426dfe-18e9-4938-a3c9-e79718589770 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:39.729141 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b550b-f439-4d9c-9234-59046dd68534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:39.731119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b550b-f439-4d9c-9234-59046dd68534 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:39.744329 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 936/1865] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:39 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:39.748143 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159a84d-4012-4abb-be54-07615c13a73a None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:39.749849 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159a84d-4012-4abb-be54-07615c13a73a None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:39.750514 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159a84d-4012-4abb-be54-07615c13a73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:39.752849 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 930/1866] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:39 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:39.773439 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-a159a84d-4012-4abb-be54-07615c13a73a None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:39.774450 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a159a84d-4012-4abb-be54-07615c13a73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:39.785487 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 937/1867] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:39 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:39.793273 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896e125-3f9f-4475-bde8-e066d1895611 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:39.793561 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896e125-3f9f-4475-bde8-e066d1895611 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:39.793838 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896e125-3f9f-4475-bde8-e066d1895611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:39.827921 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-a896e125-3f9f-4475-bde8-e066d1895611 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:39.829454 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-a896e125-3f9f-4475-bde8-e066d1895611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:39.839708 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 931/1868] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:39 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:39.845952 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159a84d-4012-4abb-be54-07615c13a73a None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:39.863424 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159a84d-4012-4abb-be54-07615c13a73a None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:39.882748 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e66ef-1b84-474a-8ad6-1ce149aee71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:39.885284 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e66ef-1b84-474a-8ad6-1ce149aee71d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:39.886040 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e66ef-1b84-474a-8ad6-1ce149aee71d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:39.886587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e66ef-1b84-474a-8ad6-1ce149aee71d admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:39.887660 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e66ef-1b84-474a-8ad6-1ce149aee71d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:39.888183 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e66ef-1b84-474a-8ad6-1ce149aee71d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:39.900424 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e66ef-1b84-474a-8ad6-1ce149aee71d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:39.923804 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 938/1869] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:39.928879 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896e125-3f9f-4475-bde8-e066d1895611 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:39.944899 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896e125-3f9f-4475-bde8-e066d1895611 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:39.953165 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60218fa-d37f-4b92-9496-e2af9d449be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:39.954508 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60218fa-d37f-4b92-9496-e2af9d449be0 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:39.954806 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60218fa-d37f-4b92-9496-e2af9d449be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:39.955119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60218fa-d37f-4b92-9496-e2af9d449be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:39.955979 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60218fa-d37f-4b92-9496-e2af9d449be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:39.958851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60218fa-d37f-4b92-9496-e2af9d449be0 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:39.994100 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 932/1870] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:39 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:39.999288 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e66ef-1b84-474a-8ad6-1ce149aee71d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:40.013671 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e66ef-1b84-474a-8ad6-1ce149aee71d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:40.084817 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bee2d0-182d-46fd-9e6e-aaba830276d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:40.085570 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bee2d0-182d-46fd-9e6e-aaba830276d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:40.085874 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bee2d0-182d-46fd-9e6e-aaba830276d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:40.086165 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bee2d0-182d-46fd-9e6e-aaba830276d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:40.086918 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bee2d0-182d-46fd-9e6e-aaba830276d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:40.089024 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bee2d0-182d-46fd-9e6e-aaba830276d4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:40.146771 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 939/1871] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:39 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:40.151323 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60218fa-d37f-4b92-9496-e2af9d449be0 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:40.169598 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60218fa-d37f-4b92-9496-e2af9d449be0 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:40.181368 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94087a8e-735c-43a8-9c80-cfcaec25e04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:40.182084 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94087a8e-735c-43a8-9c80-cfcaec25e04b admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:40.182721 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94087a8e-735c-43a8-9c80-cfcaec25e04b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:40.183015 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94087a8e-735c-43a8-9c80-cfcaec25e04b admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:40.183829 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94087a8e-735c-43a8-9c80-cfcaec25e04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:40.185560 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94087a8e-735c-43a8-9c80-cfcaec25e04b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:40.219823 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 933/1872] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:40.224099 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bee2d0-182d-46fd-9e6e-aaba830276d4 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:40.243930 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bee2d0-182d-46fd-9e6e-aaba830276d4 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:40.255106 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bfcf2-98c7-4ba8-90f9-76432b785371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:40.255787 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bfcf2-98c7-4ba8-90f9-76432b785371 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:40.256079 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bfcf2-98c7-4ba8-90f9-76432b785371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:40.256355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bfcf2-98c7-4ba8-90f9-76432b785371 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:40.257350 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bfcf2-98c7-4ba8-90f9-76432b785371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:40.269750 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bfcf2-98c7-4ba8-90f9-76432b785371 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:40.307244 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 940/1873] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:40.310485 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94087a8e-735c-43a8-9c80-cfcaec25e04b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:40.329495 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94087a8e-735c-43a8-9c80-cfcaec25e04b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:40.352308 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5203d1-aa45-4d0a-a7e6-6b0e81e6000b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:40.353343 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5203d1-aa45-4d0a-a7e6-6b0e81e6000b admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:40.353641 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5203d1-aa45-4d0a-a7e6-6b0e81e6000b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:40.353938 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5203d1-aa45-4d0a-a7e6-6b0e81e6000b admin admin] PATH_INFO: `/v3/projects/9d99329456374e82a0306ac447d47c17/users/1da6300cd8af46a3a68c63d642580aa7/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:40.415694 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5203d1-aa45-4d0a-a7e6-6b0e81e6000b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d99329456374e82a0306ac447d47c17, user_id=1da6300cd8af46a3a68c63d642580aa7, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:40.427839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5203d1-aa45-4d0a-a7e6-6b0e81e6000b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:40.457363 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bfcf2-98c7-4ba8-90f9-76432b785371 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:40.459357 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c68bfcf2-98c7-4ba8-90f9-76432b785371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:40.460909 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 934/1874] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:40 2022] PUT /identity/v3/projects/9d99329456374e82a0306ac447d47c17/users/1da6300cd8af46a3a68c63d642580aa7/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:40.481700 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f038f-0f50-4679-9315-9aba2f86393e None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:40.482008 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f038f-0f50-4679-9315-9aba2f86393e None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:40.482377 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f038f-0f50-4679-9315-9aba2f86393e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:40.511392 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bfcf2-98c7-4ba8-90f9-76432b785371 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:40.570119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-a53f038f-0f50-4679-9315-9aba2f86393e None None] MFA Rules not processed for user `1da6300cd8af46a3a68c63d642580aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:40.571796 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-a53f038f-0f50-4679-9315-9aba2f86393e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:40.639219 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba74312-8499-4fd5-b525-b520538f643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:40.640318 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba74312-8499-4fd5-b525-b520538f643f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:40.640597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba74312-8499-4fd5-b525-b520538f643f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:40.640917 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba74312-8499-4fd5-b525-b520538f643f admin admin] PATH_INFO: `/v3/projects/9ec2e0f6728745118e1718616adb4d5f` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:40.642097 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba74312-8499-4fd5-b525-b520538f643f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ec2e0f6728745118e1718616adb4d5f)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:40.644193 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba74312-8499-4fd5-b525-b520538f643f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:40.668651 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 935/1875] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:40 2022] POST /identity/v3/auth/tokens => generated 3393 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:40.680351 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f038f-0f50-4679-9315-9aba2f86393e None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:40.682163 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-a53f038f-0f50-4679-9315-9aba2f86393e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:40.705303 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-1ba74312-8499-4fd5-b525-b520538f643f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ec2e0f6728745118e1718616adb4d5f', 'request_id': 'req-1ba74312-8499-4fd5-b525-b520538f643f'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:40.720065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-1ba74312-8499-4fd5-b525-b520538f643f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ec2e0f6728745118e1718616adb4d5f', 'request_id': 'req-1ba74312-8499-4fd5-b525-b520538f643f'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:40.728389 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-1ba74312-8499-4fd5-b525-b520538f643f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ec2e0f6728745118e1718616adb4d5f', 'request_id': 'req-1ba74312-8499-4fd5-b525-b520538f643f'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:40.744643 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-1ba74312-8499-4fd5-b525-b520538f643f admin admin] The token cache is being invalidate because project 9ec2e0f6728745118e1718616adb4d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:40.744960 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-1ba74312-8499-4fd5-b525-b520538f643f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:40.745764 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-1ba74312-8499-4fd5-b525-b520538f643f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:40.747626 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 941/1876] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:40 2022] DELETE /identity/v3/projects/9ec2e0f6728745118e1718616adb4d5f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:57:40.753441 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f038f-0f50-4679-9315-9aba2f86393e None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:40.761556 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba74312-8499-4fd5-b525-b520538f643f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:40.763258 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-1ba74312-8499-4fd5-b525-b520538f643f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:40.820396 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c68e78-7bb4-4c98-9c69-441f0485be5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:40.821117 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c68e78-7bb4-4c98-9c69-441f0485be5f service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:40.821400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c68e78-7bb4-4c98-9c69-441f0485be5f service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:40.821750 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c68e78-7bb4-4c98-9c69-441f0485be5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:40.823783 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-67c68e78-7bb4-4c98-9c69-441f0485be5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:40.860605 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba74312-8499-4fd5-b525-b520538f643f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:40.869003 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd393455-1390-4268-96ce-4b1cbd180f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:40.869955 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd393455-1390-4268-96ce-4b1cbd180f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:40.870256 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd393455-1390-4268-96ce-4b1cbd180f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:40.870550 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd393455-1390-4268-96ce-4b1cbd180f11 admin admin] PATH_INFO: `/v3/users/0f9e4d354544454eb9113a808fbdfe1b` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:40.872757 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd393455-1390-4268-96ce-4b1cbd180f11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9e4d354544454eb9113a808fbdfe1b)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:40.875846 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd393455-1390-4268-96ce-4b1cbd180f11 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:40.912443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c68e78-7bb4-4c98-9c69-441f0485be5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:40.913905 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c68e78-7bb4-4c98-9c69-441f0485be5f service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:40.935512 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 936/1877] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:40 2022] GET /identity/v3/auth/tokens => generated 3393 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:57:40.959619 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-dd393455-1390-4268-96ce-4b1cbd180f11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9e4d354544454eb9113a808fbdfe1b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:40.960323 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-dd393455-1390-4268-96ce-4b1cbd180f11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9e4d354544454eb9113a808fbdfe1b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:40.960438 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c68e78-7bb4-4c98-9c69-441f0485be5f service cinder] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:40.961023 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-dd393455-1390-4268-96ce-4b1cbd180f11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9e4d354544454eb9113a808fbdfe1b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:40.962198 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-67c68e78-7bb4-4c98-9c69-441f0485be5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:40.979898 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c68e78-7bb4-4c98-9c69-441f0485be5f service cinder] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:40.984289 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-dd393455-1390-4268-96ce-4b1cbd180f11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9e4d354544454eb9113a808fbdfe1b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:40.987840 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4c13f-a0c3-4c0f-a9ac-e40758a9e6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:40.989218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4c13f-a0c3-4c0f-a9ac-e40758a9e6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:40.989658 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4c13f-a0c3-4c0f-a9ac-e40758a9e6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:40.990085 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4c13f-a0c3-4c0f-a9ac-e40758a9e6a4 admin admin] PATH_INFO: `/v3/users/1da6300cd8af46a3a68c63d642580aa7` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:40.997211 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4c13f-a0c3-4c0f-a9ac-e40758a9e6a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da6300cd8af46a3a68c63d642580aa7)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:41.001614 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4c13f-a0c3-4c0f-a9ac-e40758a9e6a4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:41.005060 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-dd393455-1390-4268-96ce-4b1cbd180f11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9e4d354544454eb9113a808fbdfe1b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.063614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 942/1878] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:40 2022] DELETE /identity/v3/users/0f9e4d354544454eb9113a808fbdfe1b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:41.097737 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-0ea4c13f-a0c3-4c0f-a9ac-e40758a9e6a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da6300cd8af46a3a68c63d642580aa7'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.101221 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-0ea4c13f-a0c3-4c0f-a9ac-e40758a9e6a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da6300cd8af46a3a68c63d642580aa7'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.107623 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd393455-1390-4268-96ce-4b1cbd180f11 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:41.110138 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-dd393455-1390-4268-96ce-4b1cbd180f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:41.112298 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-0ea4c13f-a0c3-4c0f-a9ac-e40758a9e6a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da6300cd8af46a3a68c63d642580aa7'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.122141 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-0ea4c13f-a0c3-4c0f-a9ac-e40758a9e6a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da6300cd8af46a3a68c63d642580aa7'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.160512 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-0ea4c13f-a0c3-4c0f-a9ac-e40758a9e6a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da6300cd8af46a3a68c63d642580aa7'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.184445 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 937/1879] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:40 2022] DELETE /identity/v3/users/1da6300cd8af46a3a68c63d642580aa7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:57:41.189917 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e52a2d-6e4b-43a2-978b-acb156cddec6 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:41.190105 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e52a2d-6e4b-43a2-978b-acb156cddec6 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:41.190389 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e52a2d-6e4b-43a2-978b-acb156cddec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:41.228899 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-e5e52a2d-6e4b-43a2-978b-acb156cddec6 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:41.230317 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-e5e52a2d-6e4b-43a2-978b-acb156cddec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:41.231032 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd393455-1390-4268-96ce-4b1cbd180f11 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:41.330396 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0724d-b3df-48b7-960b-bd6a2db5da12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:41.332414 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0724d-b3df-48b7-960b-bd6a2db5da12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:41.333845 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0724d-b3df-48b7-960b-bd6a2db5da12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:41.334278 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0724d-b3df-48b7-960b-bd6a2db5da12 admin admin] PATH_INFO: `/v3/projects/c7f06fe6fe1c4040a4056bf4971aa3ed` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:41.336740 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0724d-b3df-48b7-960b-bd6a2db5da12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7f06fe6fe1c4040a4056bf4971aa3ed)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:41.340964 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0724d-b3df-48b7-960b-bd6a2db5da12 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:41.376510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 938/1880] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:41 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:41.395227 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e52a2d-6e4b-43a2-978b-acb156cddec6 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:41.396788 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-e5e52a2d-6e4b-43a2-978b-acb156cddec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:41.429992 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d7e0724d-b3df-48b7-960b-bd6a2db5da12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f06fe6fe1c4040a4056bf4971aa3ed', 'request_id': 'req-d7e0724d-b3df-48b7-960b-bd6a2db5da12'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.442438 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d7e0724d-b3df-48b7-960b-bd6a2db5da12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f06fe6fe1c4040a4056bf4971aa3ed', 'request_id': 'req-d7e0724d-b3df-48b7-960b-bd6a2db5da12'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.449886 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d7e0724d-b3df-48b7-960b-bd6a2db5da12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f06fe6fe1c4040a4056bf4971aa3ed', 'request_id': 'req-d7e0724d-b3df-48b7-960b-bd6a2db5da12'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.469202 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d7e0724d-b3df-48b7-960b-bd6a2db5da12 admin admin] The token cache is being invalidate because project c7f06fe6fe1c4040a4056bf4971aa3ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:41.470388 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d7e0724d-b3df-48b7-960b-bd6a2db5da12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.470984 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d7e0724d-b3df-48b7-960b-bd6a2db5da12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.473677 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 943/1881] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:41 2022] DELETE /identity/v3/projects/c7f06fe6fe1c4040a4056bf4971aa3ed => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:41.480612 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0724d-b3df-48b7-960b-bd6a2db5da12 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:41.482156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-d7e0724d-b3df-48b7-960b-bd6a2db5da12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:41.505212 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e52a2d-6e4b-43a2-978b-acb156cddec6 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:41.590257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cba04-8bb4-40ab-bf17-a0a0f5f3382c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:41.591601 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cba04-8bb4-40ab-bf17-a0a0f5f3382c service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:41.591975 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cba04-8bb4-40ab-bf17-a0a0f5f3382c service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:41.592653 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cba04-8bb4-40ab-bf17-a0a0f5f3382c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:41.595393 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ba7cba04-8bb4-40ab-bf17-a0a0f5f3382c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:41.602009 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0724d-b3df-48b7-960b-bd6a2db5da12 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:41.607664 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da5eb9-9138-46b2-a1fc-b36eaca087f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:41.609289 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da5eb9-9138-46b2-a1fc-b36eaca087f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:41.609454 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cba04-8bb4-40ab-bf17-a0a0f5f3382c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:41.609563 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da5eb9-9138-46b2-a1fc-b36eaca087f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:41.609563 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da5eb9-9138-46b2-a1fc-b36eaca087f2 admin admin] PATH_INFO: `/v3/users/98851cff7f8c41b7bf6526098babfa4d` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:41.610666 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cba04-8bb4-40ab-bf17-a0a0f5f3382c service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:41.610809 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da5eb9-9138-46b2-a1fc-b36eaca087f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98851cff7f8c41b7bf6526098babfa4d)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:41.612833 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da5eb9-9138-46b2-a1fc-b36eaca087f2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:41.629090 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 939/1882] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:41 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:41.633596 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cba04-8bb4-40ab-bf17-a0a0f5f3382c service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:41.638450 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ba7cba04-8bb4-40ab-bf17-a0a0f5f3382c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:41.663875 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cba04-8bb4-40ab-bf17-a0a0f5f3382c service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:41.669621 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f9c31-10a0-4158-886f-1a8554026e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:41.670721 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f9c31-10a0-4158-886f-1a8554026e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:41.671119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f9c31-10a0-4158-886f-1a8554026e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:41.671445 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f9c31-10a0-4158-886f-1a8554026e97 admin admin] PATH_INFO: `/v3/projects/31c410f2195348fbb56af3e3c23d906b` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:41.672837 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f9c31-10a0-4158-886f-1a8554026e97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c410f2195348fbb56af3e3c23d906b)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:41.675004 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f9c31-10a0-4158-886f-1a8554026e97 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:41.678323 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-36da5eb9-9138-46b2-a1fc-b36eaca087f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98851cff7f8c41b7bf6526098babfa4d'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.678787 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-36da5eb9-9138-46b2-a1fc-b36eaca087f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98851cff7f8c41b7bf6526098babfa4d'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.679561 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-36da5eb9-9138-46b2-a1fc-b36eaca087f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98851cff7f8c41b7bf6526098babfa4d'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.709045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-36da5eb9-9138-46b2-a1fc-b36eaca087f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98851cff7f8c41b7bf6526098babfa4d'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.726098 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-36da5eb9-9138-46b2-a1fc-b36eaca087f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98851cff7f8c41b7bf6526098babfa4d'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.742055 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-c47f9c31-10a0-4158-886f-1a8554026e97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c410f2195348fbb56af3e3c23d906b', 'request_id': 'req-c47f9c31-10a0-4158-886f-1a8554026e97'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.750635 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-c47f9c31-10a0-4158-886f-1a8554026e97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c410f2195348fbb56af3e3c23d906b', 'request_id': 'req-c47f9c31-10a0-4158-886f-1a8554026e97'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.756772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-c47f9c31-10a0-4158-886f-1a8554026e97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c410f2195348fbb56af3e3c23d906b', 'request_id': 'req-c47f9c31-10a0-4158-886f-1a8554026e97'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.761429 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 944/1883] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:41 2022] DELETE /identity/v3/users/98851cff7f8c41b7bf6526098babfa4d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:57:41.791217 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-c47f9c31-10a0-4158-886f-1a8554026e97 admin admin] The token cache is being invalidate because project 31c410f2195348fbb56af3e3c23d906b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:41.791583 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-c47f9c31-10a0-4158-886f-1a8554026e97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.794162 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-c47f9c31-10a0-4158-886f-1a8554026e97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:41.804066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 940/1884] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:41 2022] DELETE /identity/v3/projects/31c410f2195348fbb56af3e3c23d906b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:41.805916 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714927df-0a77-44dd-b56f-b233bf956444 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:41.806165 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714927df-0a77-44dd-b56f-b233bf956444 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:41.806464 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714927df-0a77-44dd-b56f-b233bf956444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:41.829878 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-714927df-0a77-44dd-b56f-b233bf956444 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:41.831256 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-714927df-0a77-44dd-b56f-b233bf956444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:41.939819 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 945/1885] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:41 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:41.941023 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b2b5a-df44-46f9-abe3-e8370f080ed6 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:41.941316 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b2b5a-df44-46f9-abe3-e8370f080ed6 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:41.941602 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b2b5a-df44-46f9-abe3-e8370f080ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:41.966854 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-747b2b5a-df44-46f9-abe3-e8370f080ed6 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:41.968749 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-747b2b5a-df44-46f9-abe3-e8370f080ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:41.984341 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714927df-0a77-44dd-b56f-b233bf956444 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:41.992916 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 941/1886] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:41 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:41.997424 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714927df-0a77-44dd-b56f-b233bf956444 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:42.019320 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0198897-81a0-4d0e-b6bd-e301a96027b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:42.020031 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0198897-81a0-4d0e-b6bd-e301a96027b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:42.020307 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0198897-81a0-4d0e-b6bd-e301a96027b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:42.020575 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0198897-81a0-4d0e-b6bd-e301a96027b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:42.021348 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0198897-81a0-4d0e-b6bd-e301a96027b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:42.021653 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0198897-81a0-4d0e-b6bd-e301a96027b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:42.023477 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0198897-81a0-4d0e-b6bd-e301a96027b7 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:42.039773 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 946/1887] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:42.044460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b2b5a-df44-46f9-abe3-e8370f080ed6 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:42.062025 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b2b5a-df44-46f9-abe3-e8370f080ed6 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:42.081588 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e0088-54a4-4560-bd8f-b1dd2c6e6ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:42.083895 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e0088-54a4-4560-bd8f-b1dd2c6e6ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:42.084367 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e0088-54a4-4560-bd8f-b1dd2c6e6ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:42.085463 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e0088-54a4-4560-bd8f-b1dd2c6e6ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:42.087816 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e0088-54a4-4560-bd8f-b1dd2c6e6ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:42.090845 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e0088-54a4-4560-bd8f-b1dd2c6e6ae9 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:42.134065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0198897-81a0-4d0e-b6bd-e301a96027b7 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:42.135312 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 942/1888] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:42 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:42.136829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-d0198897-81a0-4d0e-b6bd-e301a96027b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:42.137014 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e0088-54a4-4560-bd8f-b1dd2c6e6ae9 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:42.162990 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0198897-81a0-4d0e-b6bd-e301a96027b7 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:42.210185 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e0088-54a4-4560-bd8f-b1dd2c6e6ae9 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:42.215036 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a3567-2c86-4c5c-ae2a-472058bee793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:42.215705 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a3567-2c86-4c5c-ae2a-472058bee793 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:42.215980 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a3567-2c86-4c5c-ae2a-472058bee793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:42.216252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a3567-2c86-4c5c-ae2a-472058bee793 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:42.217640 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a3567-2c86-4c5c-ae2a-472058bee793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:42.219756 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a3567-2c86-4c5c-ae2a-472058bee793 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:42.232477 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988a74b-b6fd-4b0a-a4bd-8d5853b5e163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:42.234858 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988a74b-b6fd-4b0a-a4bd-8d5853b5e163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:42.235125 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988a74b-b6fd-4b0a-a4bd-8d5853b5e163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:42.235509 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988a74b-b6fd-4b0a-a4bd-8d5853b5e163 admin admin] PATH_INFO: `/v3/projects/9d99329456374e82a0306ac447d47c17` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:42.237036 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988a74b-b6fd-4b0a-a4bd-8d5853b5e163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d99329456374e82a0306ac447d47c17)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:42.239754 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988a74b-b6fd-4b0a-a4bd-8d5853b5e163 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:42.247308 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 943/1889] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:42 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:42.251921 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a3567-2c86-4c5c-ae2a-472058bee793 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:42.261647 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a3567-2c86-4c5c-ae2a-472058bee793 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:42.266885 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed6970-f45b-4b3c-8b32-8adf310853f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:42.267562 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed6970-f45b-4b3c-8b32-8adf310853f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:42.268233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed6970-f45b-4b3c-8b32-8adf310853f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:42.268233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed6970-f45b-4b3c-8b32-8adf310853f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:42.268917 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed6970-f45b-4b3c-8b32-8adf310853f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:42.270409 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed6970-f45b-4b3c-8b32-8adf310853f4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:42.286120 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 944/1890] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:57:42.290418 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed6970-f45b-4b3c-8b32-8adf310853f4 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:42.301198 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7988a74b-b6fd-4b0a-a4bd-8d5853b5e163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d99329456374e82a0306ac447d47c17', 'request_id': 'req-7988a74b-b6fd-4b0a-a4bd-8d5853b5e163'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:42.301598 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed6970-f45b-4b3c-8b32-8adf310853f4 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:42.308026 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7988a74b-b6fd-4b0a-a4bd-8d5853b5e163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d99329456374e82a0306ac447d47c17', 'request_id': 'req-7988a74b-b6fd-4b0a-a4bd-8d5853b5e163'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:42.314577 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7988a74b-b6fd-4b0a-a4bd-8d5853b5e163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d99329456374e82a0306ac447d47c17', 'request_id': 'req-7988a74b-b6fd-4b0a-a4bd-8d5853b5e163'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:42.330357 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7988a74b-b6fd-4b0a-a4bd-8d5853b5e163 admin admin] The token cache is being invalidate because project 9d99329456374e82a0306ac447d47c17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:42.331103 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7988a74b-b6fd-4b0a-a4bd-8d5853b5e163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:42.332053 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7988a74b-b6fd-4b0a-a4bd-8d5853b5e163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:42.337132 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 947/1891] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:42 2022] DELETE /identity/v3/projects/9d99329456374e82a0306ac447d47c17 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:57:42.340135 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d5c55-13bc-4c37-b044-503d19c0ce43 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:42.341262 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d5c55-13bc-4c37-b044-503d19c0ce43 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:42.341551 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d5c55-13bc-4c37-b044-503d19c0ce43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:42.363186 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c6d71-458a-4898-a932-bec7acf2ffec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:42.363532 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-944d5c55-13bc-4c37-b044-503d19c0ce43 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:42.363915 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c6d71-458a-4898-a932-bec7acf2ffec admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:42.364196 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c6d71-458a-4898-a932-bec7acf2ffec admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:42.365059 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c6d71-458a-4898-a932-bec7acf2ffec admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:42.365177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-944d5c55-13bc-4c37-b044-503d19c0ce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:42.365274 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c6d71-458a-4898-a932-bec7acf2ffec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:42.367009 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c6d71-458a-4898-a932-bec7acf2ffec admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:42.381833 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 948/1892] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:42 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:57:42.388944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 945/1893] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:57:42.391084 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0016c3-81cf-4596-b5ba-446059f994e5 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:42.391290 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c6d71-458a-4898-a932-bec7acf2ffec admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:42.391496 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0016c3-81cf-4596-b5ba-446059f994e5 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:42.391723 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0016c3-81cf-4596-b5ba-446059f994e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:42.393538 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-974c6d71-458a-4898-a932-bec7acf2ffec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:42.409421 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c6d71-458a-4898-a932-bec7acf2ffec admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:42.417199 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1e5f3-b3b8-4c45-93f0-fab5f294d5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:42.418576 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1e5f3-b3b8-4c45-93f0-fab5f294d5d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:42.419039 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1e5f3-b3b8-4c45-93f0-fab5f294d5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:42.419518 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1e5f3-b3b8-4c45-93f0-fab5f294d5d1 admin admin] PATH_INFO: `/v3/projects/301e274d65b145f59dff87f51fc38c8f/users/99d4aa2539734c45862c5a5db8d6476e/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:42.433997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-2f0016c3-81cf-4596-b5ba-446059f994e5 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:42.436471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-2f0016c3-81cf-4596-b5ba-446059f994e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:42.438605 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1e5f3-b3b8-4c45-93f0-fab5f294d5d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=301e274d65b145f59dff87f51fc38c8f, user_id=99d4aa2539734c45862c5a5db8d6476e, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:42.441398 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1e5f3-b3b8-4c45-93f0-fab5f294d5d1 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:42.449292 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 949/1894] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:42 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:42.452887 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0016c3-81cf-4596-b5ba-446059f994e5 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:42.464572 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0016c3-81cf-4596-b5ba-446059f994e5 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:42.465523 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 946/1895] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:42 2022] PUT /identity/v3/projects/301e274d65b145f59dff87f51fc38c8f/users/99d4aa2539734c45862c5a5db8d6476e/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:42.478066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac90c5-b256-4a8c-ab4b-1b748d71731a None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:42.478627 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac90c5-b256-4a8c-ab4b-1b748d71731a None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:42.479254 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac90c5-b256-4a8c-ab4b-1b748d71731a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:42.516383 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-90ac90c5-b256-4a8c-ab4b-1b748d71731a None None] MFA Rules not processed for user `99d4aa2539734c45862c5a5db8d6476e`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:42.518041 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-90ac90c5-b256-4a8c-ab4b-1b748d71731a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:42.577562 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef5a2c-ab38-433c-908c-04fd4b6b08c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:42.578894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef5a2c-ab38-433c-908c-04fd4b6b08c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:42.579047 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef5a2c-ab38-433c-908c-04fd4b6b08c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:42.579304 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef5a2c-ab38-433c-908c-04fd4b6b08c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:42.580344 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef5a2c-ab38-433c-908c-04fd4b6b08c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:42.580655 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef5a2c-ab38-433c-908c-04fd4b6b08c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:42.582699 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef5a2c-ab38-433c-908c-04fd4b6b08c7 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:42.603205 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 950/1896] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:42.608981 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef5a2c-ab38-433c-908c-04fd4b6b08c7 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:42.624364 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef5a2c-ab38-433c-908c-04fd4b6b08c7 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:42.637901 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd96195-e53c-4a79-9607-8abe3905af3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:42.638812 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd96195-e53c-4a79-9607-8abe3905af3e admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:42.639531 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd96195-e53c-4a79-9607-8abe3905af3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:42.639839 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd96195-e53c-4a79-9607-8abe3905af3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:42.641001 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd96195-e53c-4a79-9607-8abe3905af3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:42.643447 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 947/1897] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:42 2022] POST /identity/v3/auth/tokens => generated 3407 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:57:42.645830 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd96195-e53c-4a79-9607-8abe3905af3e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:42.647994 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac90c5-b256-4a8c-ab4b-1b748d71731a None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:42.677183 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac90c5-b256-4a8c-ab4b-1b748d71731a None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:42.694902 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe9a22-0d78-4cf6-b5d1-92e1df2aba04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:42.698473 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe9a22-0d78-4cf6-b5d1-92e1df2aba04 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:42.699055 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe9a22-0d78-4cf6-b5d1-92e1df2aba04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:42.699427 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe9a22-0d78-4cf6-b5d1-92e1df2aba04 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:42.700722 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe9a22-0d78-4cf6-b5d1-92e1df2aba04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:42.707097 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe9a22-0d78-4cf6-b5d1-92e1df2aba04 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:42.723434 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 951/1898] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:42 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:42.724146 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd96195-e53c-4a79-9607-8abe3905af3e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:42.743127 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-efd96195-e53c-4a79-9607-8abe3905af3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:42.775532 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 948/1899] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:42 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:42.777797 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe9a22-0d78-4cf6-b5d1-92e1df2aba04 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:42.931286 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe9a22-0d78-4cf6-b5d1-92e1df2aba04 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:42.934780 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd96195-e53c-4a79-9607-8abe3905af3e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:42.939382 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7107893-9eac-4fce-9a95-cd2033bd37ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:42.940324 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7107893-9eac-4fce-9a95-cd2033bd37ab admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:42.940679 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7107893-9eac-4fce-9a95-cd2033bd37ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:42.941051 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7107893-9eac-4fce-9a95-cd2033bd37ab admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:42.941965 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7107893-9eac-4fce-9a95-cd2033bd37ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:42.944652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7107893-9eac-4fce-9a95-cd2033bd37ab admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:42.951632 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2a5fc-b630-47e8-acbd-4a641b994737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:42.952731 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2a5fc-b630-47e8-acbd-4a641b994737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:42.952963 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2a5fc-b630-47e8-acbd-4a641b994737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:42.953240 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2a5fc-b630-47e8-acbd-4a641b994737 admin admin] PATH_INFO: `/v3/projects/450fe29083e649918b3ebf41b2c9d3d0` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:42.956858 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2a5fc-b630-47e8-acbd-4a641b994737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=450fe29083e649918b3ebf41b2c9d3d0)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:42.958786 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2a5fc-b630-47e8-acbd-4a641b994737 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:42.978463 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 949/1900] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:42 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:42.979848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7107893-9eac-4fce-9a95-cd2033bd37ab admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:42.994786 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7107893-9eac-4fce-9a95-cd2033bd37ab admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:43.005839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cf9c6-2add-41fd-8a8b-842d0997d92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:43.006478 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cf9c6-2add-41fd-8a8b-842d0997d92a admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:43.006775 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cf9c6-2add-41fd-8a8b-842d0997d92a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:43.007054 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cf9c6-2add-41fd-8a8b-842d0997d92a admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:43.009353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cf9c6-2add-41fd-8a8b-842d0997d92a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:43.010576 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cf9c6-2add-41fd-8a8b-842d0997d92a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:43.034143 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f6e2a5fc-b630-47e8-acbd-4a641b994737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '450fe29083e649918b3ebf41b2c9d3d0', 'request_id': 'req-f6e2a5fc-b630-47e8-acbd-4a641b994737'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:43.041363 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f6e2a5fc-b630-47e8-acbd-4a641b994737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '450fe29083e649918b3ebf41b2c9d3d0', 'request_id': 'req-f6e2a5fc-b630-47e8-acbd-4a641b994737'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:43.049140 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f6e2a5fc-b630-47e8-acbd-4a641b994737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '450fe29083e649918b3ebf41b2c9d3d0', 'request_id': 'req-f6e2a5fc-b630-47e8-acbd-4a641b994737'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:43.059152 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 950/1901] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:42 2022] POST /identity/v3/users => generated 300 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:43.061446 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cf9c6-2add-41fd-8a8b-842d0997d92a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:43.082772 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f6e2a5fc-b630-47e8-acbd-4a641b994737 admin admin] The token cache is being invalidate because project 450fe29083e649918b3ebf41b2c9d3d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:43.083082 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f6e2a5fc-b630-47e8-acbd-4a641b994737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:43.084494 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f6e2a5fc-b630-47e8-acbd-4a641b994737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:43.086349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 952/1902] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:42 2022] DELETE /identity/v3/projects/450fe29083e649918b3ebf41b2c9d3d0 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:43.087635 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cf9c6-2add-41fd-8a8b-842d0997d92a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:43.091054 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2a5fc-b630-47e8-acbd-4a641b994737 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:43.095605 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-f6e2a5fc-b630-47e8-acbd-4a641b994737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:43.193043 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2a5fc-b630-47e8-acbd-4a641b994737 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:43.198814 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747efb62-4871-47a6-97e1-2134bbaa1c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:43.199985 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6104b8-0cdf-46a8-9d18-c59133b9c6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:43.200215 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747efb62-4871-47a6-97e1-2134bbaa1c64 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:43.201091 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747efb62-4871-47a6-97e1-2134bbaa1c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:43.201514 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6104b8-0cdf-46a8-9d18-c59133b9c6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:43.201723 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6104b8-0cdf-46a8-9d18-c59133b9c6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:43.202108 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6104b8-0cdf-46a8-9d18-c59133b9c6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:43.202496 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747efb62-4871-47a6-97e1-2134bbaa1c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:43.203264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6104b8-0cdf-46a8-9d18-c59133b9c6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:43.203722 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747efb62-4871-47a6-97e1-2134bbaa1c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:43.205613 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6104b8-0cdf-46a8-9d18-c59133b9c6e3 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:43.206466 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747efb62-4871-47a6-97e1-2134bbaa1c64 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:43.221466 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 953/1903] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:43.223867 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da6c25-b7e9-4727-889c-a2cea6144d4e None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:43.224720 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da6c25-b7e9-4727-889c-a2cea6144d4e None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:43.225210 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da6c25-b7e9-4727-889c-a2cea6144d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:43.228106 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 951/1904] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:43.229202 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6104b8-0cdf-46a8-9d18-c59133b9c6e3 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:43.245904 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6104b8-0cdf-46a8-9d18-c59133b9c6e3 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:43.253460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373d6ba-0185-4ac3-833a-3f12da29051a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:43.254030 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373d6ba-0185-4ac3-833a-3f12da29051a admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:43.254306 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373d6ba-0185-4ac3-833a-3f12da29051a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:43.254576 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373d6ba-0185-4ac3-833a-3f12da29051a admin admin] PATH_INFO: `/v3/projects/99ac70052c4945c6af3ce2ec03209846/users/83b04eeb77eb4b9a8f8aaf98a4e60a24/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:43.267448 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-c2da6c25-b7e9-4727-889c-a2cea6144d4e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:43.270307 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c2da6c25-b7e9-4727-889c-a2cea6144d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:43.289606 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373d6ba-0185-4ac3-833a-3f12da29051a admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ac70052c4945c6af3ce2ec03209846, user_id=83b04eeb77eb4b9a8f8aaf98a4e60a24, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:43.290006 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 954/1905] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:43 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:43.291130 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da6c25-b7e9-4727-889c-a2cea6144d4e None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:43.293175 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c2da6c25-b7e9-4727-889c-a2cea6144d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:43.314329 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da6c25-b7e9-4727-889c-a2cea6144d4e None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:43.315416 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373d6ba-0185-4ac3-833a-3f12da29051a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:43.321561 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb92898-5d3b-496b-8708-f42c4490e317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:43.322737 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb92898-5d3b-496b-8708-f42c4490e317 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:43.323293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb92898-5d3b-496b-8708-f42c4490e317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:43.323890 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb92898-5d3b-496b-8708-f42c4490e317 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:43.324954 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb92898-5d3b-496b-8708-f42c4490e317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:43.330069 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb92898-5d3b-496b-8708-f42c4490e317 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:43.352894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 955/1906] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:43.352894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d411171-571e-47f1-8555-d9a133efcf96 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:43.352894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d411171-571e-47f1-8555-d9a133efcf96 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:43.352894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d411171-571e-47f1-8555-d9a133efcf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:43.379995 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-5d411171-571e-47f1-8555-d9a133efcf96 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:43.382042 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-5d411171-571e-47f1-8555-d9a133efcf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:43.391447 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 952/1907] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:43 2022] PUT /identity/v3/projects/99ac70052c4945c6af3ce2ec03209846/users/83b04eeb77eb4b9a8f8aaf98a4e60a24/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:43.397088 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373d6ba-0185-4ac3-833a-3f12da29051a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:43.477794 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373d6ba-0185-4ac3-833a-3f12da29051a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:43.487375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993546f-8295-4083-a6c8-f6384f3b4429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:43.488454 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993546f-8295-4083-a6c8-f6384f3b4429 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:43.489213 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993546f-8295-4083-a6c8-f6384f3b4429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:43.489668 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993546f-8295-4083-a6c8-f6384f3b4429 admin admin] PATH_INFO: `/v3/projects/bee25848fa324abd8c02e5658d51f49b/users/9f193fc25516427eb69d69fe9fac4f5b/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:43.497478 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 956/1908] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:43 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:43.498688 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d411171-571e-47f1-8555-d9a133efcf96 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:43.509262 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d411171-571e-47f1-8555-d9a133efcf96 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:43.509480 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993546f-8295-4083-a6c8-f6384f3b4429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bee25848fa324abd8c02e5658d51f49b, user_id=9f193fc25516427eb69d69fe9fac4f5b, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:43.512246 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993546f-8295-4083-a6c8-f6384f3b4429 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:43.521610 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9213ea-fc8e-4b9b-8821-63e5fe2dda35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:43.522307 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9213ea-fc8e-4b9b-8821-63e5fe2dda35 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:43.522592 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9213ea-fc8e-4b9b-8821-63e5fe2dda35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:43.522867 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9213ea-fc8e-4b9b-8821-63e5fe2dda35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:43.523824 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9213ea-fc8e-4b9b-8821-63e5fe2dda35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:43.526186 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9213ea-fc8e-4b9b-8821-63e5fe2dda35 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:43.534259 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 953/1909] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:43 2022] PUT /identity/v3/projects/bee25848fa324abd8c02e5658d51f49b/users/9f193fc25516427eb69d69fe9fac4f5b/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:43.536110 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993546f-8295-4083-a6c8-f6384f3b4429 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:43.542815 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 957/1910] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:43.546984 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9213ea-fc8e-4b9b-8821-63e5fe2dda35 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:43.565287 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9213ea-fc8e-4b9b-8821-63e5fe2dda35 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:43.642862 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843c4de-8e27-4bb7-b1cd-faa4f0c6d461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:43.644249 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843c4de-8e27-4bb7-b1cd-faa4f0c6d461 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:43.644960 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843c4de-8e27-4bb7-b1cd-faa4f0c6d461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:43.645410 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843c4de-8e27-4bb7-b1cd-faa4f0c6d461 admin admin] PATH_INFO: `/v3/projects/99ac70052c4945c6af3ce2ec03209846/users/83b04eeb77eb4b9a8f8aaf98a4e60a24/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:43.648244 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843c4de-8e27-4bb7-b1cd-faa4f0c6d461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ac70052c4945c6af3ce2ec03209846, user_id=83b04eeb77eb4b9a8f8aaf98a4e60a24, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:43.653305 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843c4de-8e27-4bb7-b1cd-faa4f0c6d461 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:43.672787 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 958/1911] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:43 2022] PUT /identity/v3/projects/99ac70052c4945c6af3ce2ec03209846/users/83b04eeb77eb4b9a8f8aaf98a4e60a24/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:57:43.674693 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489e3c1-7011-4fd8-abfb-f3ea69bd8baa None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:43.675148 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489e3c1-7011-4fd8-abfb-f3ea69bd8baa None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:43.675436 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489e3c1-7011-4fd8-abfb-f3ea69bd8baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:43.677517 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993546f-8295-4083-a6c8-f6384f3b4429 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:43.714945 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-1489e3c1-7011-4fd8-abfb-f3ea69bd8baa None None] MFA Rules not processed for user `9f193fc25516427eb69d69fe9fac4f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:43.716211 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-1489e3c1-7011-4fd8-abfb-f3ea69bd8baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:43.764958 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde2ff0-ebe9-4f91-9d90-6a2a6ce71a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:43.765655 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde2ff0-ebe9-4f91-9d90-6a2a6ce71a0b admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:43.765928 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde2ff0-ebe9-4f91-9d90-6a2a6ce71a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:43.766202 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde2ff0-ebe9-4f91-9d90-6a2a6ce71a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:43.766930 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde2ff0-ebe9-4f91-9d90-6a2a6ce71a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:43.767229 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde2ff0-ebe9-4f91-9d90-6a2a6ce71a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:43.769300 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde2ff0-ebe9-4f91-9d90-6a2a6ce71a0b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:43.783942 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 954/1912] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:43.785885 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc194126-7dd3-4b6b-bbff-3cd905c60f44 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:43.786333 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc194126-7dd3-4b6b-bbff-3cd905c60f44 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:43.787021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc194126-7dd3-4b6b-bbff-3cd905c60f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:43.818542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 959/1913] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:43 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:43.818542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489e3c1-7011-4fd8-abfb-f3ea69bd8baa None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:43.833676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489e3c1-7011-4fd8-abfb-f3ea69bd8baa None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:43.841543 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922ac8f-0831-4245-bb70-9229a664b693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:43.843574 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922ac8f-0831-4245-bb70-9229a664b693 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:43.843574 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922ac8f-0831-4245-bb70-9229a664b693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:43.843574 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922ac8f-0831-4245-bb70-9229a664b693 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:43.844281 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922ac8f-0831-4245-bb70-9229a664b693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:43.845501 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-bc194126-7dd3-4b6b-bbff-3cd905c60f44 None None] MFA Rules not processed for user `83b04eeb77eb4b9a8f8aaf98a4e60a24`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:43.846666 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922ac8f-0831-4245-bb70-9229a664b693 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:43.846973 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-bc194126-7dd3-4b6b-bbff-3cd905c60f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:43.891824 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 960/1914] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:43 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:43.893942 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922ac8f-0831-4245-bb70-9229a664b693 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:43.897190 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-0922ac8f-0831-4245-bb70-9229a664b693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:43.965058 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 955/1915] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:43 2022] POST /identity/v3/auth/tokens => generated 3474 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:43.966382 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc194126-7dd3-4b6b-bbff-3cd905c60f44 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:43.978840 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc194126-7dd3-4b6b-bbff-3cd905c60f44 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:44.033946 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922ac8f-0831-4245-bb70-9229a664b693 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:44.039014 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd45812-baef-4c33-9df5-1c87d4c9e96d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:44.039673 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd45812-baef-4c33-9df5-1c87d4c9e96d service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:44.039952 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd45812-baef-4c33-9df5-1c87d4c9e96d service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:44.040262 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd45812-baef-4c33-9df5-1c87d4c9e96d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:44.071227 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f2c5f-71c7-40a0-ba5c-561b84964b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:44.073188 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f2c5f-71c7-40a0-ba5c-561b84964b9d admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:44.073495 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f2c5f-71c7-40a0-ba5c-561b84964b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:44.074240 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f2c5f-71c7-40a0-ba5c-561b84964b9d admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:44.074487 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f2c5f-71c7-40a0-ba5c-561b84964b9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:44.085065 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f2c5f-71c7-40a0-ba5c-561b84964b9d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:44.116596 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd45812-baef-4c33-9df5-1c87d4c9e96d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:44.118193 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd45812-baef-4c33-9df5-1c87d4c9e96d service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:44.119101 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 956/1916] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:43 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:44.119963 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f2c5f-71c7-40a0-ba5c-561b84964b9d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:44.122358 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-219f2c5f-71c7-40a0-ba5c-561b84964b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:44.130166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 961/1917] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:43 2022] GET /identity/v3/auth/tokens => generated 3391 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:44.131110 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd45812-baef-4c33-9df5-1c87d4c9e96d service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:44.136673 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f2c5f-71c7-40a0-ba5c-561b84964b9d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:44.141724 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50bb8a-9cbc-433e-9353-7ade1bbb5e67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:44.142647 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50bb8a-9cbc-433e-9353-7ade1bbb5e67 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:44.142938 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50bb8a-9cbc-433e-9353-7ade1bbb5e67 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:44.143214 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50bb8a-9cbc-433e-9353-7ade1bbb5e67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:44.144218 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd45812-baef-4c33-9df5-1c87d4c9e96d service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:44.151414 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a25ed7-596e-493d-83d3-0d3af9acb52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:44.152394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a25ed7-596e-493d-83d3-0d3af9acb52a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:44.152931 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a25ed7-596e-493d-83d3-0d3af9acb52a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:44.153182 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a25ed7-596e-493d-83d3-0d3af9acb52a admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:44.161066 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a25ed7-596e-493d-83d3-0d3af9acb52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:44.161066 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a25ed7-596e-493d-83d3-0d3af9acb52a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:44.175403 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 962/1918] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:44.176688 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a25ed7-596e-493d-83d3-0d3af9acb52a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:44.187844 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a25ed7-596e-493d-83d3-0d3af9acb52a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:44.197339 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9bf05-d702-4606-839f-bf8b010715ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:44.198317 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9bf05-d702-4606-839f-bf8b010715ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:44.198596 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9bf05-d702-4606-839f-bf8b010715ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:44.198941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9bf05-d702-4606-839f-bf8b010715ac admin admin] PATH_INFO: `/v3/users/9f193fc25516427eb69d69fe9fac4f5b` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:44.200257 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9bf05-d702-4606-839f-bf8b010715ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f193fc25516427eb69d69fe9fac4f5b)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:44.204969 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9bf05-d702-4606-839f-bf8b010715ac admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:44.237564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50bb8a-9cbc-433e-9353-7ade1bbb5e67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:44.239467 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50bb8a-9cbc-433e-9353-7ade1bbb5e67 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:44.251719 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 957/1919] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:44 2022] GET /identity/v3/auth/tokens => generated 3474 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:44.263455 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50bb8a-9cbc-433e-9353-7ade1bbb5e67 service cinder] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:44.271988 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-77b9bf05-d702-4606-839f-bf8b010715ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f193fc25516427eb69d69fe9fac4f5b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:44.272922 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-77b9bf05-d702-4606-839f-bf8b010715ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f193fc25516427eb69d69fe9fac4f5b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:44.273750 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-77b9bf05-d702-4606-839f-bf8b010715ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f193fc25516427eb69d69fe9fac4f5b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:44.276563 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50bb8a-9cbc-433e-9353-7ade1bbb5e67 service cinder] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:44.283689 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-77b9bf05-d702-4606-839f-bf8b010715ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f193fc25516427eb69d69fe9fac4f5b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:44.284630 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa64c8-2160-4a5a-81d0-2c03a78c2922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:44.285392 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa64c8-2160-4a5a-81d0-2c03a78c2922 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:44.285726 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa64c8-2160-4a5a-81d0-2c03a78c2922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:44.286002 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa64c8-2160-4a5a-81d0-2c03a78c2922 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:44.286973 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa64c8-2160-4a5a-81d0-2c03a78c2922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:44.289767 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa64c8-2160-4a5a-81d0-2c03a78c2922 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:44.294596 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-77b9bf05-d702-4606-839f-bf8b010715ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f193fc25516427eb69d69fe9fac4f5b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:44.306054 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 958/1920] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:44.310130 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa64c8-2160-4a5a-81d0-2c03a78c2922 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:44.316354 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 963/1921] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:44 2022] DELETE /identity/v3/users/9f193fc25516427eb69d69fe9fac4f5b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:44.317367 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-d6fa64c8-2160-4a5a-81d0-2c03a78c2922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:44.321140 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82a492-1ebc-4da2-af84-48e9de829675 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:44.321434 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82a492-1ebc-4da2-af84-48e9de829675 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:44.321853 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82a492-1ebc-4da2-af84-48e9de829675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:44.334184 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa64c8-2160-4a5a-81d0-2c03a78c2922 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:44.340854 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-7b82a492-1ebc-4da2-af84-48e9de829675 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:44.344072 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-7b82a492-1ebc-4da2-af84-48e9de829675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:44.409179 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e536ffc-147d-4ccc-b10d-d52c550f356b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:44.409179 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e536ffc-147d-4ccc-b10d-d52c550f356b admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:44.409179 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e536ffc-147d-4ccc-b10d-d52c550f356b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:44.409179 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e536ffc-147d-4ccc-b10d-d52c550f356b admin admin] PATH_INFO: `/v3/projects/914f7f61b2e64e76904b9c71a44f55d6/users/e947eee956834b9d8502dcfaa7e87eb4/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:44.440155 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 964/1922] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:44.441145 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82a492-1ebc-4da2-af84-48e9de829675 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:44.442613 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-7b82a492-1ebc-4da2-af84-48e9de829675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:44.451461 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e536ffc-147d-4ccc-b10d-d52c550f356b admin admin] RBAC: Authorizing `identity:create_grant(project_id=914f7f61b2e64e76904b9c71a44f55d6, user_id=e947eee956834b9d8502dcfaa7e87eb4, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:44.456160 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e536ffc-147d-4ccc-b10d-d52c550f356b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:44.459296 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82a492-1ebc-4da2-af84-48e9de829675 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:44.465137 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4c602-256c-4fbd-987d-b35a2b473c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:44.466062 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4c602-256c-4fbd-987d-b35a2b473c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:44.466339 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4c602-256c-4fbd-987d-b35a2b473c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:44.466602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4c602-256c-4fbd-987d-b35a2b473c4d admin admin] PATH_INFO: `/v3/users/99d4aa2539734c45862c5a5db8d6476e` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:44.468502 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4c602-256c-4fbd-987d-b35a2b473c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d4aa2539734c45862c5a5db8d6476e)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:44.470934 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4c602-256c-4fbd-987d-b35a2b473c4d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:44.488307 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 959/1923] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:44 2022] PUT /identity/v3/projects/914f7f61b2e64e76904b9c71a44f55d6/users/e947eee956834b9d8502dcfaa7e87eb4/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:57:44.489659 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e536ffc-147d-4ccc-b10d-d52c550f356b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:44.496931 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-4e536ffc-147d-4ccc-b10d-d52c550f356b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:44.591550 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-69b4c602-256c-4fbd-987d-b35a2b473c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d4aa2539734c45862c5a5db8d6476e'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:44.592598 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-69b4c602-256c-4fbd-987d-b35a2b473c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d4aa2539734c45862c5a5db8d6476e'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:44.593699 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-69b4c602-256c-4fbd-987d-b35a2b473c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d4aa2539734c45862c5a5db8d6476e'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:44.608384 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-69b4c602-256c-4fbd-987d-b35a2b473c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d4aa2539734c45862c5a5db8d6476e'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:44.630212 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-69b4c602-256c-4fbd-987d-b35a2b473c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d4aa2539734c45862c5a5db8d6476e'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:44.664741 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e536ffc-147d-4ccc-b10d-d52c550f356b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:44.678600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466223a-465d-4e41-b580-6faa8084edbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:44.682656 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 965/1924] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:44 2022] DELETE /identity/v3/users/99d4aa2539734c45862c5a5db8d6476e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:44.683184 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466223a-465d-4e41-b580-6faa8084edbd service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:44.683184 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466223a-465d-4e41-b580-6faa8084edbd service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:44.683184 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466223a-465d-4e41-b580-6faa8084edbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:44.683415 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5f9c1-0fc3-4bb7-b5f4-6999714f0d46 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:44.683415 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5f9c1-0fc3-4bb7-b5f4-6999714f0d46 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:44.683415 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5f9c1-0fc3-4bb7-b5f4-6999714f0d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:44.688311 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-3466223a-465d-4e41-b580-6faa8084edbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:44.733556 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-07f5f9c1-0fc3-4bb7-b5f4-6999714f0d46 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:44.735114 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-07f5f9c1-0fc3-4bb7-b5f4-6999714f0d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:44.831152 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 966/1925] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:44.832528 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce4f5c-67c1-4b20-bec9-54138187fead None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:44.833554 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce4f5c-67c1-4b20-bec9-54138187fead None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:44.833554 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce4f5c-67c1-4b20-bec9-54138187fead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:44.860169 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-fbce4f5c-67c1-4b20-bec9-54138187fead None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:44.863083 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-fbce4f5c-67c1-4b20-bec9-54138187fead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:44.871282 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 967/1926] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:44.872196 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce4f5c-67c1-4b20-bec9-54138187fead None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:44.872505 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466223a-465d-4e41-b580-6faa8084edbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:44.874969 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466223a-465d-4e41-b580-6faa8084edbd service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:44.878124 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-fbce4f5c-67c1-4b20-bec9-54138187fead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:44.894336 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 960/1927] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:44 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:44.895546 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466223a-465d-4e41-b580-6faa8084edbd service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:44.897548 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-3466223a-465d-4e41-b580-6faa8084edbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:44.899290 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce4f5c-67c1-4b20-bec9-54138187fead None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:44.913229 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e43743-ad9f-4ba0-9e30-1284047cd215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:44.914125 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e43743-ad9f-4ba0-9e30-1284047cd215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:44.914405 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466223a-465d-4e41-b580-6faa8084edbd service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:44.914520 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e43743-ad9f-4ba0-9e30-1284047cd215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:44.914661 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e43743-ad9f-4ba0-9e30-1284047cd215 admin admin] PATH_INFO: `/v3/users/c861ab94572d4e62892a2b7068f8df1f` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:44.917150 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e43743-ad9f-4ba0-9e30-1284047cd215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c861ab94572d4e62892a2b7068f8df1f)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:44.919848 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e43743-ad9f-4ba0-9e30-1284047cd215 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:44.997571 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-97e43743-ad9f-4ba0-9e30-1284047cd215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c861ab94572d4e62892a2b7068f8df1f'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:44.998382 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-97e43743-ad9f-4ba0-9e30-1284047cd215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c861ab94572d4e62892a2b7068f8df1f'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:45.000304 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-97e43743-ad9f-4ba0-9e30-1284047cd215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c861ab94572d4e62892a2b7068f8df1f'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:45.006291 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a899019-be83-4c41-89c6-80d98960363c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:45.007103 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a899019-be83-4c41-89c6-80d98960363c service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:45.007359 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a899019-be83-4c41-89c6-80d98960363c service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:45.007530 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a899019-be83-4c41-89c6-80d98960363c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:45.010607 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-0a899019-be83-4c41-89c6-80d98960363c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:45.016862 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-97e43743-ad9f-4ba0-9e30-1284047cd215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c861ab94572d4e62892a2b7068f8df1f'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:45.028600 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-97e43743-ad9f-4ba0-9e30-1284047cd215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c861ab94572d4e62892a2b7068f8df1f'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:45.030400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a899019-be83-4c41-89c6-80d98960363c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:45.031934 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a899019-be83-4c41-89c6-80d98960363c service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:45.048694 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 961/1928] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:44 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:45.050136 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a899019-be83-4c41-89c6-80d98960363c service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:45.051772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-0a899019-be83-4c41-89c6-80d98960363c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:45.056904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 968/1929] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:44 2022] DELETE /identity/v3/users/c861ab94572d4e62892a2b7068f8df1f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:45.062135 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf696604-fd21-4681-9caf-25c7d5938f12 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:45.063361 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf696604-fd21-4681-9caf-25c7d5938f12 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:45.063516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf696604-fd21-4681-9caf-25c7d5938f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:45.067357 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a899019-be83-4c41-89c6-80d98960363c service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:45.103851 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-cf696604-fd21-4681-9caf-25c7d5938f12 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:45.105587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-cf696604-fd21-4681-9caf-25c7d5938f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:45.187564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd1c0c-0062-4cad-8b48-0c85722d0f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:45.187944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd1c0c-0062-4cad-8b48-0c85722d0f45 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:45.188158 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd1c0c-0062-4cad-8b48-0c85722d0f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:45.188438 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd1c0c-0062-4cad-8b48-0c85722d0f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:45.191713 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-fdbd1c0c-0062-4cad-8b48-0c85722d0f45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:45.236925 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 969/1930] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:45 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:57:45.252101 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf696604-fd21-4681-9caf-25c7d5938f12 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:45.266086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf696604-fd21-4681-9caf-25c7d5938f12 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:45.274613 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2fc08-3b8c-40b7-8f71-c3bedc9c6fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:45.278204 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2fc08-3b8c-40b7-8f71-c3bedc9c6fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:45.278494 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2fc08-3b8c-40b7-8f71-c3bedc9c6fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:45.278948 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2fc08-3b8c-40b7-8f71-c3bedc9c6fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:45.310483 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2fc08-3b8c-40b7-8f71-c3bedc9c6fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:45.313900 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd1c0c-0062-4cad-8b48-0c85722d0f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:45.315869 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd1c0c-0062-4cad-8b48-0c85722d0f45 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:45.316227 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2fc08-3b8c-40b7-8f71-c3bedc9c6fb4 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:45.332190 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 962/1931] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:45 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:45.333561 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 970/1932] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:45 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:45.472561 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd1c0c-0062-4cad-8b48-0c85722d0f45 service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:45.474310 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-fdbd1c0c-0062-4cad-8b48-0c85722d0f45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:45.494434 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd1c0c-0062-4cad-8b48-0c85722d0f45 service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:45.523127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859038b8-f333-47e3-a94b-0b3523b54027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:45.524854 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859038b8-f333-47e3-a94b-0b3523b54027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:45.525192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859038b8-f333-47e3-a94b-0b3523b54027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:45.527873 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859038b8-f333-47e3-a94b-0b3523b54027 admin admin] PATH_INFO: `/v3/projects/bee25848fa324abd8c02e5658d51f49b` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:45.530585 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859038b8-f333-47e3-a94b-0b3523b54027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bee25848fa324abd8c02e5658d51f49b)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:45.534399 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859038b8-f333-47e3-a94b-0b3523b54027 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:45.618185 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-859038b8-f333-47e3-a94b-0b3523b54027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bee25848fa324abd8c02e5658d51f49b', 'request_id': 'req-859038b8-f333-47e3-a94b-0b3523b54027'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:45.625545 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-859038b8-f333-47e3-a94b-0b3523b54027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bee25848fa324abd8c02e5658d51f49b', 'request_id': 'req-859038b8-f333-47e3-a94b-0b3523b54027'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:45.636078 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-859038b8-f333-47e3-a94b-0b3523b54027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bee25848fa324abd8c02e5658d51f49b', 'request_id': 'req-859038b8-f333-47e3-a94b-0b3523b54027'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:45.651977 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-859038b8-f333-47e3-a94b-0b3523b54027 admin admin] The token cache is being invalidate because project bee25848fa324abd8c02e5658d51f49b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:45.652298 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-859038b8-f333-47e3-a94b-0b3523b54027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:45.652974 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-859038b8-f333-47e3-a94b-0b3523b54027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:45.655217 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 963/1933] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:45 2022] DELETE /identity/v3/projects/bee25848fa324abd8c02e5658d51f49b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:45.661165 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8160c79-bb29-49ff-8e2b-d40ff57a4232 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:45.661552 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8160c79-bb29-49ff-8e2b-d40ff57a4232 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:45.662195 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8160c79-bb29-49ff-8e2b-d40ff57a4232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:45.683573 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-f8160c79-bb29-49ff-8e2b-d40ff57a4232 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:45.685559 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-f8160c79-bb29-49ff-8e2b-d40ff57a4232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:45.780267 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 971/1934] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:45 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:45.788739 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e337ebe-e7aa-4175-905b-151b90f648d8 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:45.789328 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e337ebe-e7aa-4175-905b-151b90f648d8 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:45.789989 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e337ebe-e7aa-4175-905b-151b90f648d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:45.848516 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-6e337ebe-e7aa-4175-905b-151b90f648d8 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:45.848516 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-6e337ebe-e7aa-4175-905b-151b90f648d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:45.860376 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 964/1935] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:45 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:45.864616 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8160c79-bb29-49ff-8e2b-d40ff57a4232 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:45.886277 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8160c79-bb29-49ff-8e2b-d40ff57a4232 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:45.916638 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7260595-d2a6-4832-97a9-b8d3d3743112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:45.917351 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7260595-d2a6-4832-97a9-b8d3d3743112 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:45.917634 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7260595-d2a6-4832-97a9-b8d3d3743112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:45.917901 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7260595-d2a6-4832-97a9-b8d3d3743112 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:45.918667 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7260595-d2a6-4832-97a9-b8d3d3743112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:45.920281 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7260595-d2a6-4832-97a9-b8d3d3743112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:45.923061 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7260595-d2a6-4832-97a9-b8d3d3743112 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:45.957460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e337ebe-e7aa-4175-905b-151b90f648d8 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:45.957982 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 972/1936] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:45.970434 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e337ebe-e7aa-4175-905b-151b90f648d8 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:45.991552 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164d480-9a42-434a-a0d9-857c6d0304a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:45.992744 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164d480-9a42-434a-a0d9-857c6d0304a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:45.993265 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164d480-9a42-434a-a0d9-857c6d0304a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:45.993651 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164d480-9a42-434a-a0d9-857c6d0304a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:45.994415 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164d480-9a42-434a-a0d9-857c6d0304a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:45.997202 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164d480-9a42-434a-a0d9-857c6d0304a4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:46.026587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7260595-d2a6-4832-97a9-b8d3d3743112 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:46.030311 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-d7260595-d2a6-4832-97a9-b8d3d3743112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:46.052072 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 965/1937] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:45 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:57:46.054867 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164d480-9a42-434a-a0d9-857c6d0304a4 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:46.056252 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7260595-d2a6-4832-97a9-b8d3d3743112 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:46.231551 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83a948-cc02-46e6-9063-dd247e6d5512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:46.234356 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83a948-cc02-46e6-9063-dd247e6d5512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:46.235758 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83a948-cc02-46e6-9063-dd247e6d5512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:46.238473 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83a948-cc02-46e6-9063-dd247e6d5512 admin admin] PATH_INFO: `/v3/projects/301e274d65b145f59dff87f51fc38c8f` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:46.245178 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83a948-cc02-46e6-9063-dd247e6d5512 admin admin] RBAC: Authorizing `identity:delete_project(project_id=301e274d65b145f59dff87f51fc38c8f)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:46.249157 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83a948-cc02-46e6-9063-dd247e6d5512 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:46.254656 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164d480-9a42-434a-a0d9-857c6d0304a4 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:46.261464 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3df63-65fa-4172-a1af-8dc822ceb0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:46.262265 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3df63-65fa-4172-a1af-8dc822ceb0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:46.262620 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3df63-65fa-4172-a1af-8dc822ceb0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:46.263156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3df63-65fa-4172-a1af-8dc822ceb0c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:46.263929 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3df63-65fa-4172-a1af-8dc822ceb0c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:46.266651 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3df63-65fa-4172-a1af-8dc822ceb0c8 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:46.298665 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 966/1938] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:46 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:46.300359 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3df63-65fa-4172-a1af-8dc822ceb0c8 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:46.302672 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-0bc3df63-65fa-4172-a1af-8dc822ceb0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:46.316915 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4b83a948-cc02-46e6-9063-dd247e6d5512 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '301e274d65b145f59dff87f51fc38c8f', 'request_id': 'req-4b83a948-cc02-46e6-9063-dd247e6d5512'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:46.321847 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3df63-65fa-4172-a1af-8dc822ceb0c8 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:46.324894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4b83a948-cc02-46e6-9063-dd247e6d5512 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '301e274d65b145f59dff87f51fc38c8f', 'request_id': 'req-4b83a948-cc02-46e6-9063-dd247e6d5512'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:46.337351 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4b83a948-cc02-46e6-9063-dd247e6d5512 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '301e274d65b145f59dff87f51fc38c8f', 'request_id': 'req-4b83a948-cc02-46e6-9063-dd247e6d5512'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:46.363354 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4b83a948-cc02-46e6-9063-dd247e6d5512 admin admin] The token cache is being invalidate because project 301e274d65b145f59dff87f51fc38c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:46.363739 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4b83a948-cc02-46e6-9063-dd247e6d5512 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:46.364530 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4b83a948-cc02-46e6-9063-dd247e6d5512 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:46.366561 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 973/1939] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:46 2022] DELETE /identity/v3/projects/301e274d65b145f59dff87f51fc38c8f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:57:46.367490 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83a948-cc02-46e6-9063-dd247e6d5512 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:46.369353 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-4b83a948-cc02-46e6-9063-dd247e6d5512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:46.452748 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471acdf-17be-4a83-a606-38eb56c7b061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:46.454078 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471acdf-17be-4a83-a606-38eb56c7b061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:46.454693 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471acdf-17be-4a83-a606-38eb56c7b061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:46.455114 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471acdf-17be-4a83-a606-38eb56c7b061 admin admin] PATH_INFO: `/v3/projects/454ce786396046ad95893a259902d7b6` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:46.462440 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471acdf-17be-4a83-a606-38eb56c7b061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=454ce786396046ad95893a259902d7b6)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:46.469959 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83a948-cc02-46e6-9063-dd247e6d5512 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:46.475457 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c59bcf-dee1-4b10-94de-885b7b27c1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:46.476134 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c59bcf-dee1-4b10-94de-885b7b27c1db admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:46.476415 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c59bcf-dee1-4b10-94de-885b7b27c1db admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:46.476688 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c59bcf-dee1-4b10-94de-885b7b27c1db admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:46.477451 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c59bcf-dee1-4b10-94de-885b7b27c1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:46.478534 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471acdf-17be-4a83-a606-38eb56c7b061 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:46.479454 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c59bcf-dee1-4b10-94de-885b7b27c1db admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:46.504080 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 974/1940] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:46.505235 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c59bcf-dee1-4b10-94de-885b7b27c1db admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:46.509200 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-08c59bcf-dee1-4b10-94de-885b7b27c1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:46.530829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c59bcf-dee1-4b10-94de-885b7b27c1db admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:46.537123 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb1589-75fb-4f9e-bb7b-37b52b84b788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:46.538204 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb1589-75fb-4f9e-bb7b-37b52b84b788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:46.538631 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb1589-75fb-4f9e-bb7b-37b52b84b788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:46.539056 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb1589-75fb-4f9e-bb7b-37b52b84b788 admin admin] PATH_INFO: `/v3/users/83b04eeb77eb4b9a8f8aaf98a4e60a24` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:46.540909 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb1589-75fb-4f9e-bb7b-37b52b84b788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83b04eeb77eb4b9a8f8aaf98a4e60a24)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:46.542907 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb1589-75fb-4f9e-bb7b-37b52b84b788 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:46.614736 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-f471acdf-17be-4a83-a606-38eb56c7b061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '454ce786396046ad95893a259902d7b6', 'request_id': 'req-f471acdf-17be-4a83-a606-38eb56c7b061'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:46.622098 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-f471acdf-17be-4a83-a606-38eb56c7b061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '454ce786396046ad95893a259902d7b6', 'request_id': 'req-f471acdf-17be-4a83-a606-38eb56c7b061'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:46.628749 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-f471acdf-17be-4a83-a606-38eb56c7b061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '454ce786396046ad95893a259902d7b6', 'request_id': 'req-f471acdf-17be-4a83-a606-38eb56c7b061'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:46.653567 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-e2bb1589-75fb-4f9e-bb7b-37b52b84b788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83b04eeb77eb4b9a8f8aaf98a4e60a24'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:46.654323 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-e2bb1589-75fb-4f9e-bb7b-37b52b84b788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83b04eeb77eb4b9a8f8aaf98a4e60a24'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:46.656589 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-e2bb1589-75fb-4f9e-bb7b-37b52b84b788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83b04eeb77eb4b9a8f8aaf98a4e60a24'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:46.659350 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-f471acdf-17be-4a83-a606-38eb56c7b061 admin admin] The token cache is being invalidate because project 454ce786396046ad95893a259902d7b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:46.659898 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-f471acdf-17be-4a83-a606-38eb56c7b061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:46.662549 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-f471acdf-17be-4a83-a606-38eb56c7b061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:46.672744 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 967/1941] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:46 2022] DELETE /identity/v3/projects/454ce786396046ad95893a259902d7b6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:46.672744 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471acdf-17be-4a83-a606-38eb56c7b061 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:46.673359 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-f471acdf-17be-4a83-a606-38eb56c7b061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:46.679456 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-e2bb1589-75fb-4f9e-bb7b-37b52b84b788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83b04eeb77eb4b9a8f8aaf98a4e60a24'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:46.694730 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-e2bb1589-75fb-4f9e-bb7b-37b52b84b788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83b04eeb77eb4b9a8f8aaf98a4e60a24'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:46.729758 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 975/1942] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:46 2022] DELETE /identity/v3/users/83b04eeb77eb4b9a8f8aaf98a4e60a24 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:46.734172 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ecfaa-c947-4ec1-b128-de1b1b350454 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:46.734470 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ecfaa-c947-4ec1-b128-de1b1b350454 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:46.734789 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ecfaa-c947-4ec1-b128-de1b1b350454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:46.754575 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471acdf-17be-4a83-a606-38eb56c7b061 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:46.766415 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-628ecfaa-c947-4ec1-b128-de1b1b350454 None None] MFA Rules not processed for user `e947eee956834b9d8502dcfaa7e87eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:46.768723 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-628ecfaa-c947-4ec1-b128-de1b1b350454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:46.863496 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71792ba-5755-4a88-8263-8eefe3e763de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:46.865775 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71792ba-5755-4a88-8263-8eefe3e763de admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:46.867428 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71792ba-5755-4a88-8263-8eefe3e763de admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:46.868582 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71792ba-5755-4a88-8263-8eefe3e763de admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:46.871835 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71792ba-5755-4a88-8263-8eefe3e763de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:46.876742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71792ba-5755-4a88-8263-8eefe3e763de admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:46.937109 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 968/1943] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:46.938226 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71792ba-5755-4a88-8263-8eefe3e763de admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:46.941577 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-f71792ba-5755-4a88-8263-8eefe3e763de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:46.955634 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 976/1944] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:46 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:46.962295 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ecfaa-c947-4ec1-b128-de1b1b350454 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:46.980753 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71792ba-5755-4a88-8263-8eefe3e763de admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:46.983816 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ecfaa-c947-4ec1-b128-de1b1b350454 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:46.992627 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9be62c-b456-4ad6-9d8b-9efebf0b635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:46.992833 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ede79e-f3e4-4043-9bc0-f56f0e2a07e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:46.993512 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9be62c-b456-4ad6-9d8b-9efebf0b635a admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:46.993866 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9be62c-b456-4ad6-9d8b-9efebf0b635a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:46.994348 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9be62c-b456-4ad6-9d8b-9efebf0b635a admin admin] PATH_INFO: `/v3/projects/6e15e80496d946b4ba64c95751ebc354/users/cd9cb4ec35524e859b828892c95130e7/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:46.994984 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ede79e-f3e4-4043-9bc0-f56f0e2a07e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:46.995717 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ede79e-f3e4-4043-9bc0-f56f0e2a07e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:46.996101 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ede79e-f3e4-4043-9bc0-f56f0e2a07e5 admin admin] PATH_INFO: `/v3/users/89bc109a1c6e448c9ea43ddf584740dc` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:46.999427 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ede79e-f3e4-4043-9bc0-f56f0e2a07e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89bc109a1c6e448c9ea43ddf584740dc)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:47.011830 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ede79e-f3e4-4043-9bc0-f56f0e2a07e5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:47.031387 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9be62c-b456-4ad6-9d8b-9efebf0b635a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e15e80496d946b4ba64c95751ebc354, user_id=cd9cb4ec35524e859b828892c95130e7, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:47.036272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9be62c-b456-4ad6-9d8b-9efebf0b635a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:47.055664 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 977/1945] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:46 2022] PUT /identity/v3/projects/6e15e80496d946b4ba64c95751ebc354/users/cd9cb4ec35524e859b828892c95130e7/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:47.056514 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9be62c-b456-4ad6-9d8b-9efebf0b635a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:47.058474 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-fd9be62c-b456-4ad6-9d8b-9efebf0b635a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:47.089887 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-26ede79e-f3e4-4043-9bc0-f56f0e2a07e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89bc109a1c6e448c9ea43ddf584740dc'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:47.091156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-26ede79e-f3e4-4043-9bc0-f56f0e2a07e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89bc109a1c6e448c9ea43ddf584740dc'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:47.103080 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-26ede79e-f3e4-4043-9bc0-f56f0e2a07e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89bc109a1c6e448c9ea43ddf584740dc'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:47.118718 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-26ede79e-f3e4-4043-9bc0-f56f0e2a07e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89bc109a1c6e448c9ea43ddf584740dc'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:47.146414 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-26ede79e-f3e4-4043-9bc0-f56f0e2a07e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89bc109a1c6e448c9ea43ddf584740dc'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:47.151068 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9be62c-b456-4ad6-9d8b-9efebf0b635a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:47.158404 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df4593-9b9f-42ea-bfd0-b5bf145fda82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:47.158706 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 969/1946] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:46 2022] DELETE /identity/v3/users/89bc109a1c6e448c9ea43ddf584740dc => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:47.159099 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df4593-9b9f-42ea-bfd0-b5bf145fda82 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:47.159597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df4593-9b9f-42ea-bfd0-b5bf145fda82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:47.159872 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df4593-9b9f-42ea-bfd0-b5bf145fda82 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:47.160595 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df4593-9b9f-42ea-bfd0-b5bf145fda82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:47.161303 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e61cf7-de47-473b-8265-e7103b0e1f13 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:47.161802 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e61cf7-de47-473b-8265-e7103b0e1f13 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:47.162288 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e61cf7-de47-473b-8265-e7103b0e1f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:47.162795 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df4593-9b9f-42ea-bfd0-b5bf145fda82 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:47.199652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-c8e61cf7-de47-473b-8265-e7103b0e1f13 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:47.202511 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c8e61cf7-de47-473b-8265-e7103b0e1f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:47.213878 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 978/1947] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:47 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:47.215245 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df4593-9b9f-42ea-bfd0-b5bf145fda82 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:47.233625 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-86df4593-9b9f-42ea-bfd0-b5bf145fda82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:47.326317 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 970/1948] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:47 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:47.331464 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e61cf7-de47-473b-8265-e7103b0e1f13 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:47.333490 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c8e61cf7-de47-473b-8265-e7103b0e1f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:47.352836 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e61cf7-de47-473b-8265-e7103b0e1f13 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:47.360314 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df4593-9b9f-42ea-bfd0-b5bf145fda82 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:47.363650 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482971d-2a10-4265-a824-e7e247909030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:47.366278 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482971d-2a10-4265-a824-e7e247909030 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:47.367577 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482971d-2a10-4265-a824-e7e247909030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:47.368303 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482971d-2a10-4265-a824-e7e247909030 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:47.369729 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205deb40-f849-4b4e-8371-814fcb626c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:47.370145 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482971d-2a10-4265-a824-e7e247909030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:47.371064 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205deb40-f849-4b4e-8371-814fcb626c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:47.371526 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205deb40-f849-4b4e-8371-814fcb626c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:47.371992 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205deb40-f849-4b4e-8371-814fcb626c39 admin admin] PATH_INFO: `/v3/projects/99ac70052c4945c6af3ce2ec03209846` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:47.374699 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205deb40-f849-4b4e-8371-814fcb626c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ac70052c4945c6af3ce2ec03209846)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:47.376066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482971d-2a10-4265-a824-e7e247909030 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:47.378362 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205deb40-f849-4b4e-8371-814fcb626c39 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:47.421914 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 971/1949] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:47 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:47.424751 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482971d-2a10-4265-a824-e7e247909030 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:47.429513 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-8482971d-2a10-4265-a824-e7e247909030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:47.473439 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-205deb40-f849-4b4e-8371-814fcb626c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ac70052c4945c6af3ce2ec03209846', 'request_id': 'req-205deb40-f849-4b4e-8371-814fcb626c39'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:47.481231 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-205deb40-f849-4b4e-8371-814fcb626c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ac70052c4945c6af3ce2ec03209846', 'request_id': 'req-205deb40-f849-4b4e-8371-814fcb626c39'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:47.488297 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-205deb40-f849-4b4e-8371-814fcb626c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ac70052c4945c6af3ce2ec03209846', 'request_id': 'req-205deb40-f849-4b4e-8371-814fcb626c39'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:47.500764 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482971d-2a10-4265-a824-e7e247909030 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:47.511639 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-205deb40-f849-4b4e-8371-814fcb626c39 admin admin] The token cache is being invalidate because project 99ac70052c4945c6af3ce2ec03209846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:47.512169 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-205deb40-f849-4b4e-8371-814fcb626c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:47.513260 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-205deb40-f849-4b4e-8371-814fcb626c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:47.516496 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 979/1950] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:47 2022] DELETE /identity/v3/projects/99ac70052c4945c6af3ce2ec03209846 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:47.522160 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205deb40-f849-4b4e-8371-814fcb626c39 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:47.523457 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-205deb40-f849-4b4e-8371-814fcb626c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:47.595040 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e564c-273a-4d97-a086-f7cb5e0eb281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:47.595788 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e564c-273a-4d97-a086-f7cb5e0eb281 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:47.596237 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e564c-273a-4d97-a086-f7cb5e0eb281 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:47.596611 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e564c-273a-4d97-a086-f7cb5e0eb281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:47.599433 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-3b2e564c-273a-4d97-a086-f7cb5e0eb281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:47.625737 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205deb40-f849-4b4e-8371-814fcb626c39 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:47.631623 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea5e6d-8519-468c-9013-fd4cfb22f436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:47.632587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea5e6d-8519-468c-9013-fd4cfb22f436 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:47.632977 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea5e6d-8519-468c-9013-fd4cfb22f436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:47.633268 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea5e6d-8519-468c-9013-fd4cfb22f436 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:47.633999 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea5e6d-8519-468c-9013-fd4cfb22f436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:47.635619 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea5e6d-8519-468c-9013-fd4cfb22f436 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:47.651123 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 980/1951] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:47.651123 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b196f-6760-4e8d-b9be-4a8a042ddeba None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:47.651123 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b196f-6760-4e8d-b9be-4a8a042ddeba None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:47.651123 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b196f-6760-4e8d-b9be-4a8a042ddeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:47.675325 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-ae6b196f-6760-4e8d-b9be-4a8a042ddeba None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:47.676539 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-ae6b196f-6760-4e8d-b9be-4a8a042ddeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:47.694330 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 981/1952] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:47 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:47.695189 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b196f-6760-4e8d-b9be-4a8a042ddeba None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:47.699707 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-ae6b196f-6760-4e8d-b9be-4a8a042ddeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:47.700271 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e564c-273a-4d97-a086-f7cb5e0eb281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:47.702199 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e564c-273a-4d97-a086-f7cb5e0eb281 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:47.713196 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 972/1953] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:47 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:47.714025 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e564c-273a-4d97-a086-f7cb5e0eb281 service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:47.718992 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b196f-6760-4e8d-b9be-4a8a042ddeba None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:47.724643 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e564c-273a-4d97-a086-f7cb5e0eb281 service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:47.726183 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e2683-fb40-43aa-97ea-104a566533e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:47.727298 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e2683-fb40-43aa-97ea-104a566533e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:47.727753 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e2683-fb40-43aa-97ea-104a566533e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:47.728230 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e2683-fb40-43aa-97ea-104a566533e0 admin admin] PATH_INFO: `/v3/projects/624a0367dddf42d28bb1d53a1797f59e` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:47.729691 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e2683-fb40-43aa-97ea-104a566533e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=624a0367dddf42d28bb1d53a1797f59e)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:47.730228 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204d9d5-4502-4fb2-9c60-e750f538c217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:47.731130 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204d9d5-4502-4fb2-9c60-e750f538c217 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:47.731413 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204d9d5-4502-4fb2-9c60-e750f538c217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:47.731690 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204d9d5-4502-4fb2-9c60-e750f538c217 admin admin] PATH_INFO: `/v3/projects/7bfbe773e86b4e3ea2f102f39cd297ff/users/44d4723c5aef49a8a28cc7af33f1640c/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:47.732532 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e2683-fb40-43aa-97ea-104a566533e0 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:47.750921 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204d9d5-4502-4fb2-9c60-e750f538c217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfbe773e86b4e3ea2f102f39cd297ff, user_id=44d4723c5aef49a8a28cc7af33f1640c, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:47.753676 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204d9d5-4502-4fb2-9c60-e750f538c217 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:47.768915 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 973/1954] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:47 2022] PUT /identity/v3/projects/7bfbe773e86b4e3ea2f102f39cd297ff/users/44d4723c5aef49a8a28cc7af33f1640c/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:47.770649 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a292b-5e02-43d9-b648-844d5f5c323b None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:47.770944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a292b-5e02-43d9-b648-844d5f5c323b None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:47.771217 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a292b-5e02-43d9-b648-844d5f5c323b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:47.790904 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-7b6a292b-5e02-43d9-b648-844d5f5c323b None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:47.791322 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-381e2683-fb40-43aa-97ea-104a566533e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '624a0367dddf42d28bb1d53a1797f59e', 'request_id': 'req-381e2683-fb40-43aa-97ea-104a566533e0'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:47.792296 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-7b6a292b-5e02-43d9-b648-844d5f5c323b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:47.807602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-381e2683-fb40-43aa-97ea-104a566533e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '624a0367dddf42d28bb1d53a1797f59e', 'request_id': 'req-381e2683-fb40-43aa-97ea-104a566533e0'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:47.807602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-381e2683-fb40-43aa-97ea-104a566533e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '624a0367dddf42d28bb1d53a1797f59e', 'request_id': 'req-381e2683-fb40-43aa-97ea-104a566533e0'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:47.830464 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-381e2683-fb40-43aa-97ea-104a566533e0 admin admin] The token cache is being invalidate because project 624a0367dddf42d28bb1d53a1797f59e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:47.831064 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-381e2683-fb40-43aa-97ea-104a566533e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:47.832285 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-381e2683-fb40-43aa-97ea-104a566533e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:47.834979 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 982/1955] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:47 2022] DELETE /identity/v3/projects/624a0367dddf42d28bb1d53a1797f59e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:47.844334 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e2683-fb40-43aa-97ea-104a566533e0 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:47.847273 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-381e2683-fb40-43aa-97ea-104a566533e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:47.897132 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 974/1956] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:47 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:47.897132 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad28f7-fe62-47ef-9c56-25dc85d3a63a None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:47.897132 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad28f7-fe62-47ef-9c56-25dc85d3a63a None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:47.897132 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad28f7-fe62-47ef-9c56-25dc85d3a63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:47.923449 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-b8ad28f7-fe62-47ef-9c56-25dc85d3a63a None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:47.924679 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b8ad28f7-fe62-47ef-9c56-25dc85d3a63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:47.942898 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 975/1957] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:47 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:47.942898 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad28f7-fe62-47ef-9c56-25dc85d3a63a None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:47.955555 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e2683-fb40-43aa-97ea-104a566533e0 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:47.958030 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad28f7-fe62-47ef-9c56-25dc85d3a63a None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:47.960427 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d59a5-fcee-4d48-ba64-56bb59190a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:47.961334 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d59a5-fcee-4d48-ba64-56bb59190a15 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:47.961545 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d59a5-fcee-4d48-ba64-56bb59190a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:47.962129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d59a5-fcee-4d48-ba64-56bb59190a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:47.962976 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d59a5-fcee-4d48-ba64-56bb59190a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:47.964783 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d59a5-fcee-4d48-ba64-56bb59190a15 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:47.967850 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b69ee-3f89-4422-8ea7-c52169f91168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:47.968560 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b69ee-3f89-4422-8ea7-c52169f91168 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:47.968877 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b69ee-3f89-4422-8ea7-c52169f91168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:47.969161 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b69ee-3f89-4422-8ea7-c52169f91168 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:47.970076 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b69ee-3f89-4422-8ea7-c52169f91168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:47.970398 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b69ee-3f89-4422-8ea7-c52169f91168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:47.972638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b69ee-3f89-4422-8ea7-c52169f91168 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:47.976882 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 983/1958] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:47.978426 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2be6e-28c6-4d3a-b6cc-e85c30cdb204 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:47.978838 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2be6e-28c6-4d3a-b6cc-e85c30cdb204 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:47.979181 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2be6e-28c6-4d3a-b6cc-e85c30cdb204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:47.992101 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 976/1959] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:47.993008 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b69ee-3f89-4422-8ea7-c52169f91168 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:48.004609 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b69ee-3f89-4422-8ea7-c52169f91168 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:48.010663 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd48de-c252-44fc-ad72-ebb2d9c7dc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:48.011648 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd48de-c252-44fc-ad72-ebb2d9c7dc8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:48.011932 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd48de-c252-44fc-ad72-ebb2d9c7dc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:48.012284 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd48de-c252-44fc-ad72-ebb2d9c7dc8d admin admin] PATH_INFO: `/v3/projects/7bfbe773e86b4e3ea2f102f39cd297ff/users/44d4723c5aef49a8a28cc7af33f1640c/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:48.017020 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-4fd2be6e-28c6-4d3a-b6cc-e85c30cdb204 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:48.019558 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-4fd2be6e-28c6-4d3a-b6cc-e85c30cdb204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:48.035211 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd48de-c252-44fc-ad72-ebb2d9c7dc8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfbe773e86b4e3ea2f102f39cd297ff, user_id=44d4723c5aef49a8a28cc7af33f1640c, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:48.039646 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 984/1960] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:47 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:48.039646 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2be6e-28c6-4d3a-b6cc-e85c30cdb204 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:48.041739 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd48de-c252-44fc-ad72-ebb2d9c7dc8d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:48.059940 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 977/1961] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:47 2022] PUT /identity/v3/projects/7bfbe773e86b4e3ea2f102f39cd297ff/users/44d4723c5aef49a8a28cc7af33f1640c/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:48.064700 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2be6e-28c6-4d3a-b6cc-e85c30cdb204 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:48.066444 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd48de-c252-44fc-ad72-ebb2d9c7dc8d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:48.165810 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd48de-c252-44fc-ad72-ebb2d9c7dc8d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:48.171955 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492d569-1092-46df-b549-22b9913b649c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:48.173027 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492d569-1092-46df-b549-22b9913b649c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:48.173313 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492d569-1092-46df-b549-22b9913b649c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:48.173781 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492d569-1092-46df-b549-22b9913b649c admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:48.174897 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492d569-1092-46df-b549-22b9913b649c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:48.175218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492d569-1092-46df-b549-22b9913b649c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:48.177124 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492d569-1092-46df-b549-22b9913b649c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:48.196533 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 978/1962] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:48.204159 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492d569-1092-46df-b549-22b9913b649c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:48.225236 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492d569-1092-46df-b549-22b9913b649c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:48.234753 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f882e-e111-4691-8b6d-b00ee947e5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:48.237402 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cef0b-bba9-4485-b885-0194baf42340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:48.237782 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f882e-e111-4691-8b6d-b00ee947e5d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:48.238118 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cef0b-bba9-4485-b885-0194baf42340 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:48.238418 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cef0b-bba9-4485-b885-0194baf42340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:48.238840 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f882e-e111-4691-8b6d-b00ee947e5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:48.238947 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cef0b-bba9-4485-b885-0194baf42340 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:48.239325 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f882e-e111-4691-8b6d-b00ee947e5d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:48.241166 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495cef0b-bba9-4485-b885-0194baf42340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:48.243648 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f882e-e111-4691-8b6d-b00ee947e5d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:48.244340 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495cef0b-bba9-4485-b885-0194baf42340 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:48.256576 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f882e-e111-4691-8b6d-b00ee947e5d1 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:48.328615 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 979/1963] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:48 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:48.332841 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 985/1964] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:48 2022] POST /identity/v3/projects => generated 381 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:48.339834 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f882e-e111-4691-8b6d-b00ee947e5d1 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:48.340373 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cef0b-bba9-4485-b885-0194baf42340 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:48.428326 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f882e-e111-4691-8b6d-b00ee947e5d1 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:48.440541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b90f30-117f-43d5-b0f1-1e7921b60fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:48.442856 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b90f30-117f-43d5-b0f1-1e7921b60fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:48.447480 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b90f30-117f-43d5-b0f1-1e7921b60fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:48.448022 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b90f30-117f-43d5-b0f1-1e7921b60fe5 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:48.449901 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b90f30-117f-43d5-b0f1-1e7921b60fe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:48.455232 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cef0b-bba9-4485-b885-0194baf42340 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:48.455602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b90f30-117f-43d5-b0f1-1e7921b60fe5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:48.468942 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c080a-354c-41a9-9a47-792d73418f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:48.469722 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c080a-354c-41a9-9a47-792d73418f4b admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:48.470076 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c080a-354c-41a9-9a47-792d73418f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:48.470407 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c080a-354c-41a9-9a47-792d73418f4b admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:48.471183 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c080a-354c-41a9-9a47-792d73418f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:48.474532 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c080a-354c-41a9-9a47-792d73418f4b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:48.497304 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 986/1965] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:48 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:48.501940 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b90f30-117f-43d5-b0f1-1e7921b60fe5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:48.504703 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 980/1966] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:48 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:48.508569 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c080a-354c-41a9-9a47-792d73418f4b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:48.515611 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b90f30-117f-43d5-b0f1-1e7921b60fe5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:48.522281 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c080a-354c-41a9-9a47-792d73418f4b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:48.523511 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b4cde-97a0-4a6c-957a-161bea2f783a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:48.524192 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b4cde-97a0-4a6c-957a-161bea2f783a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:48.524471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b4cde-97a0-4a6c-957a-161bea2f783a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:48.524741 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b4cde-97a0-4a6c-957a-161bea2f783a admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:48.525520 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b4cde-97a0-4a6c-957a-161bea2f783a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:48.527381 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b4cde-97a0-4a6c-957a-161bea2f783a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:48.535279 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c6e60-555b-4d5c-bfa3-15f7693c29f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:48.536505 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c6e60-555b-4d5c-bfa3-15f7693c29f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:48.536917 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c6e60-555b-4d5c-bfa3-15f7693c29f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:48.537266 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c6e60-555b-4d5c-bfa3-15f7693c29f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:48.538088 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c6e60-555b-4d5c-bfa3-15f7693c29f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:48.539879 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c6e60-555b-4d5c-bfa3-15f7693c29f5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:48.552410 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 987/1967] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:48.556272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b4cde-97a0-4a6c-957a-161bea2f783a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:48.566151 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 981/1968] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:48.570648 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b4cde-97a0-4a6c-957a-161bea2f783a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:48.570887 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c6e60-555b-4d5c-bfa3-15f7693c29f5 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:48.583942 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5459f-84e1-418d-bd33-8cea73a4337d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:48.584972 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5459f-84e1-418d-bd33-8cea73a4337d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:48.585475 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5459f-84e1-418d-bd33-8cea73a4337d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:48.585896 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5459f-84e1-418d-bd33-8cea73a4337d admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:48.586868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5459f-84e1-418d-bd33-8cea73a4337d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:48.588161 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c6e60-555b-4d5c-bfa3-15f7693c29f5 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:48.588839 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5459f-84e1-418d-bd33-8cea73a4337d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:48.594570 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694c654-0b64-4239-95a9-dd603fd9a35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:48.595380 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694c654-0b64-4239-95a9-dd603fd9a35e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:48.595728 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694c654-0b64-4239-95a9-dd603fd9a35e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:48.596557 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694c654-0b64-4239-95a9-dd603fd9a35e admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:48.603888 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694c654-0b64-4239-95a9-dd603fd9a35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:48.605895 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694c654-0b64-4239-95a9-dd603fd9a35e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:48.614827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 988/1969] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:48.620854 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5459f-84e1-418d-bd33-8cea73a4337d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:48.631461 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 982/1970] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:48.636055 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694c654-0b64-4239-95a9-dd603fd9a35e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:48.639395 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5459f-84e1-418d-bd33-8cea73a4337d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:48.648844 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f90da-9166-453b-94be-715991f08e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:48.649039 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694c654-0b64-4239-95a9-dd603fd9a35e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:48.650124 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f90da-9166-453b-94be-715991f08e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:48.650432 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f90da-9166-453b-94be-715991f08e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:48.650676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f90da-9166-453b-94be-715991f08e47 admin admin] PATH_INFO: `/v3/projects/98388d99967741079574198f38a902c5/users/25bb5ba53fe64dfea70e70701d4dad1f/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:48.660115 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df44c7f-c709-4280-99e0-ea5342d07bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:48.661268 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df44c7f-c709-4280-99e0-ea5342d07bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:48.661712 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df44c7f-c709-4280-99e0-ea5342d07bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:48.662127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df44c7f-c709-4280-99e0-ea5342d07bb4 admin admin] PATH_INFO: `/v3/projects/0c4f0b6d489e4ecaa78e44447379a9e9/users/5daa25d997d04943a1533fe3fe9d1ff3/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:48.667362 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f90da-9166-453b-94be-715991f08e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98388d99967741079574198f38a902c5, user_id=25bb5ba53fe64dfea70e70701d4dad1f, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:48.670091 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f90da-9166-453b-94be-715991f08e47 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:48.685663 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df44c7f-c709-4280-99e0-ea5342d07bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4f0b6d489e4ecaa78e44447379a9e9, user_id=5daa25d997d04943a1533fe3fe9d1ff3, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:48.690633 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df44c7f-c709-4280-99e0-ea5342d07bb4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:48.699111 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 989/1971] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:48 2022] PUT /identity/v3/projects/98388d99967741079574198f38a902c5/users/25bb5ba53fe64dfea70e70701d4dad1f/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:48.710649 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93051b-c3cc-49f1-82ca-f6a14660c262 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:48.710934 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93051b-c3cc-49f1-82ca-f6a14660c262 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:48.711255 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93051b-c3cc-49f1-82ca-f6a14660c262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:48.721749 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 983/1972] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:48 2022] PUT /identity/v3/projects/0c4f0b6d489e4ecaa78e44447379a9e9/users/5daa25d997d04943a1533fe3fe9d1ff3/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:57:48.734815 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f0e3c-489b-4f65-baad-21932d0caa5f None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:48.735927 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f0e3c-489b-4f65-baad-21932d0caa5f None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:48.736479 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f0e3c-489b-4f65-baad-21932d0caa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:48.785729 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-550f0e3c-489b-4f65-baad-21932d0caa5f None None] MFA Rules not processed for user `5daa25d997d04943a1533fe3fe9d1ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:48.787112 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-550f0e3c-489b-4f65-baad-21932d0caa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:48.788191 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-7e93051b-c3cc-49f1-82ca-f6a14660c262 None None] MFA Rules not processed for user `25bb5ba53fe64dfea70e70701d4dad1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:48.789779 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-7e93051b-c3cc-49f1-82ca-f6a14660c262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:48.922732 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 984/1973] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:48 2022] POST /identity/v3/auth/tokens => generated 3401 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:48.929457 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f0e3c-489b-4f65-baad-21932d0caa5f None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:48.963297 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 990/1974] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:48 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:57:48.986576 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93051b-c3cc-49f1-82ca-f6a14660c262 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:48.989831 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-7e93051b-c3cc-49f1-82ca-f6a14660c262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:49.017649 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f0e3c-489b-4f65-baad-21932d0caa5f None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:49.025162 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553150e-bb17-4e96-b9e0-5f9b00898b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:49.026414 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553150e-bb17-4e96-b9e0-5f9b00898b1a admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:49.026951 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553150e-bb17-4e96-b9e0-5f9b00898b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:49.027478 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553150e-bb17-4e96-b9e0-5f9b00898b1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:49.028616 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553150e-bb17-4e96-b9e0-5f9b00898b1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:49.031554 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553150e-bb17-4e96-b9e0-5f9b00898b1a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:49.066175 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 985/1975] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:48 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:49.071741 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553150e-bb17-4e96-b9e0-5f9b00898b1a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:49.137766 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93051b-c3cc-49f1-82ca-f6a14660c262 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:49.194636 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553150e-bb17-4e96-b9e0-5f9b00898b1a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:49.208476 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a5465-cf26-48c4-8c2e-26dd9672105f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:49.216871 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a5465-cf26-48c4-8c2e-26dd9672105f admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:49.216871 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a5465-cf26-48c4-8c2e-26dd9672105f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:49.216871 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a5465-cf26-48c4-8c2e-26dd9672105f admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:49.216871 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a5465-cf26-48c4-8c2e-26dd9672105f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:49.222599 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a5465-cf26-48c4-8c2e-26dd9672105f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:49.246043 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f081cc-6740-421a-8bd1-cd16a78fa31d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:49.247384 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f081cc-6740-421a-8bd1-cd16a78fa31d service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:49.247885 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f081cc-6740-421a-8bd1-cd16a78fa31d service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:49.248423 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f081cc-6740-421a-8bd1-cd16a78fa31d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:49.267393 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 986/1976] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:49 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:57:49.272687 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a5465-cf26-48c4-8c2e-26dd9672105f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:49.290863 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a5465-cf26-48c4-8c2e-26dd9672105f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:49.297059 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28542318-e9ca-418e-94f7-75d5197fdf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:49.299982 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28542318-e9ca-418e-94f7-75d5197fdf7d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:49.299982 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28542318-e9ca-418e-94f7-75d5197fdf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:49.299982 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28542318-e9ca-418e-94f7-75d5197fdf7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:49.299982 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28542318-e9ca-418e-94f7-75d5197fdf7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:49.300777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28542318-e9ca-418e-94f7-75d5197fdf7d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:49.312961 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 987/1977] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:57:49.314466 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff35da-2789-4399-b3f3-1f5e921e0f19 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:49.314766 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff35da-2789-4399-b3f3-1f5e921e0f19 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:49.315042 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff35da-2789-4399-b3f3-1f5e921e0f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:49.350012 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-66ff35da-2789-4399-b3f3-1f5e921e0f19 None None] MFA Rules not processed for user `44d4723c5aef49a8a28cc7af33f1640c`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:49.351337 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-66ff35da-2789-4399-b3f3-1f5e921e0f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:49.377829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f081cc-6740-421a-8bd1-cd16a78fa31d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:49.380741 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f081cc-6740-421a-8bd1-cd16a78fa31d service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:49.399579 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 991/1978] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:48 2022] GET /identity/v3/auth/tokens => generated 3405 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:57:49.401450 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f081cc-6740-421a-8bd1-cd16a78fa31d service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:49.422988 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f081cc-6740-421a-8bd1-cd16a78fa31d service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:49.441129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197b89b-7d43-4c57-9cbe-7af55cd1bfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:49.442765 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197b89b-7d43-4c57-9cbe-7af55cd1bfdb admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:49.443270 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197b89b-7d43-4c57-9cbe-7af55cd1bfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:49.443765 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197b89b-7d43-4c57-9cbe-7af55cd1bfdb admin admin] PATH_INFO: `/v3/projects/1bdec33f230c4050bd806baef2da329b/users/da8204d8187c467ca8a969b300a84744/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:49.471518 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 988/1979] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:49 2022] POST /identity/v3/auth/tokens => generated 3460 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:49.471518 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff35da-2789-4399-b3f3-1f5e921e0f19 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:49.476876 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197b89b-7d43-4c57-9cbe-7af55cd1bfdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bdec33f230c4050bd806baef2da329b, user_id=da8204d8187c467ca8a969b300a84744, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:49.482817 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197b89b-7d43-4c57-9cbe-7af55cd1bfdb admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:49.490843 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff35da-2789-4399-b3f3-1f5e921e0f19 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:49.497540 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874909c-262c-4f0b-ace0-53b7cbdcdb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:49.498540 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874909c-262c-4f0b-ace0-53b7cbdcdb33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:49.499055 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874909c-262c-4f0b-ace0-53b7cbdcdb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:49.499562 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874909c-262c-4f0b-ace0-53b7cbdcdb33 admin admin] PATH_INFO: `/v3/users/25bb5ba53fe64dfea70e70701d4dad1f` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:49.501404 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874909c-262c-4f0b-ace0-53b7cbdcdb33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25bb5ba53fe64dfea70e70701d4dad1f)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:49.503374 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874909c-262c-4f0b-ace0-53b7cbdcdb33 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:49.515402 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 992/1980] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:49 2022] PUT /identity/v3/projects/1bdec33f230c4050bd806baef2da329b/users/da8204d8187c467ca8a969b300a84744/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:49.517530 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197b89b-7d43-4c57-9cbe-7af55cd1bfdb admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:49.520434 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-8197b89b-7d43-4c57-9cbe-7af55cd1bfdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:49.588305 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1874909c-262c-4f0b-ace0-53b7cbdcdb33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25bb5ba53fe64dfea70e70701d4dad1f'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:49.589322 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1874909c-262c-4f0b-ace0-53b7cbdcdb33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25bb5ba53fe64dfea70e70701d4dad1f'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:49.598443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1874909c-262c-4f0b-ace0-53b7cbdcdb33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25bb5ba53fe64dfea70e70701d4dad1f'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:49.610043 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1874909c-262c-4f0b-ace0-53b7cbdcdb33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25bb5ba53fe64dfea70e70701d4dad1f'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:49.652206 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1874909c-262c-4f0b-ace0-53b7cbdcdb33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25bb5ba53fe64dfea70e70701d4dad1f'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:49.675847 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 989/1981] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:49 2022] DELETE /identity/v3/users/25bb5ba53fe64dfea70e70701d4dad1f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:49.677119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874909c-262c-4f0b-ace0-53b7cbdcdb33 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:49.679276 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1874909c-262c-4f0b-ace0-53b7cbdcdb33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:49.753248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874909c-262c-4f0b-ace0-53b7cbdcdb33 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:49.756547 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197b89b-7d43-4c57-9cbe-7af55cd1bfdb admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:49.760367 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc2f89-a306-4c9c-aac9-711424712add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:49.761838 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc2f89-a306-4c9c-aac9-711424712add admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:49.762386 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc2f89-a306-4c9c-aac9-711424712add admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:49.762850 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc2f89-a306-4c9c-aac9-711424712add admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:49.764332 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc2f89-a306-4c9c-aac9-711424712add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:49.766667 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc2f89-a306-4c9c-aac9-711424712add admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:49.780938 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 990/1982] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:49.782656 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef0647-ebe6-4d2d-8420-132772160032 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:49.783138 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef0647-ebe6-4d2d-8420-132772160032 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:49.783628 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef0647-ebe6-4d2d-8420-132772160032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:49.808666 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-b5ef0647-ebe6-4d2d-8420-132772160032 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:49.810654 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b5ef0647-ebe6-4d2d-8420-132772160032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:49.819632 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 991/1983] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:49 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:49.820716 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef0647-ebe6-4d2d-8420-132772160032 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:49.832066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef0647-ebe6-4d2d-8420-132772160032 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:49.837583 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fae2bd-f8e5-4464-8899-78dcb9fcd4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:49.838566 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fae2bd-f8e5-4464-8899-78dcb9fcd4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:49.838947 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fae2bd-f8e5-4464-8899-78dcb9fcd4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:49.839324 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fae2bd-f8e5-4464-8899-78dcb9fcd4f1 admin admin] PATH_INFO: `/v3/projects/1bdec33f230c4050bd806baef2da329b/users/da8204d8187c467ca8a969b300a84744/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:49.843847 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fae2bd-f8e5-4464-8899-78dcb9fcd4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bdec33f230c4050bd806baef2da329b, user_id=da8204d8187c467ca8a969b300a84744, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:49.846778 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fae2bd-f8e5-4464-8899-78dcb9fcd4f1 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:49.877234 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 992/1984] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:49 2022] PUT /identity/v3/projects/1bdec33f230c4050bd806baef2da329b/users/da8204d8187c467ca8a969b300a84744/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:49.877234 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fae2bd-f8e5-4464-8899-78dcb9fcd4f1 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:49.879414 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-38fae2bd-f8e5-4464-8899-78dcb9fcd4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:49.900199 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80147c-2729-4bb1-84b0-ab1aa4a119fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:49.901417 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80147c-2729-4bb1-84b0-ab1aa4a119fd service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:49.901764 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80147c-2729-4bb1-84b0-ab1aa4a119fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:49.902378 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80147c-2729-4bb1-84b0-ab1aa4a119fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:49.905094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-8a80147c-2729-4bb1-84b0-ab1aa4a119fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:49.985172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fae2bd-f8e5-4464-8899-78dcb9fcd4f1 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:49.990339 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02229f-6f23-40f9-b188-bfd53584bb65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:49.991695 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02229f-6f23-40f9-b188-bfd53584bb65 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:49.991695 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02229f-6f23-40f9-b188-bfd53584bb65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:49.991904 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02229f-6f23-40f9-b188-bfd53584bb65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:50.012750 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80147c-2729-4bb1-84b0-ab1aa4a119fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:50.014575 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80147c-2729-4bb1-84b0-ab1aa4a119fd service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:50.025230 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 993/1985] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:49 2022] GET /identity/v3/auth/tokens => generated 3391 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:50.027134 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41299eb-be39-4f44-a073-ab7e86845348 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:50.027424 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41299eb-be39-4f44-a073-ab7e86845348 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:50.027705 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41299eb-be39-4f44-a073-ab7e86845348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:50.067800 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-e41299eb-be39-4f44-a073-ab7e86845348 None None] MFA Rules not processed for user `da8204d8187c467ca8a969b300a84744`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:50.069130 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-e41299eb-be39-4f44-a073-ab7e86845348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:50.110602 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02229f-6f23-40f9-b188-bfd53584bb65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:50.113752 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02229f-6f23-40f9-b188-bfd53584bb65 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:50.142293 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 993/1986] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:49 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:50.160026 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 994/1987] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:50 2022] POST /identity/v3/auth/tokens => generated 3466 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:50.172530 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02229f-6f23-40f9-b188-bfd53584bb65 service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:50.174441 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-6d02229f-6f23-40f9-b188-bfd53584bb65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:50.291896 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02229f-6f23-40f9-b188-bfd53584bb65 service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:50.299513 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bb536-830f-458c-a5b4-ec7b2b9d2b91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:50.300688 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bb536-830f-458c-a5b4-ec7b2b9d2b91 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:50.301213 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bb536-830f-458c-a5b4-ec7b2b9d2b91 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:50.301661 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bb536-830f-458c-a5b4-ec7b2b9d2b91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:50.315515 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269bb536-830f-458c-a5b4-ec7b2b9d2b91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:50.317519 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269bb536-830f-458c-a5b4-ec7b2b9d2b91 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:50.341334 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 994/1988] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:50 2022] GET /identity/v3/auth/tokens => generated 3466 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:57:50.688767 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41299eb-be39-4f44-a073-ab7e86845348 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:50.691531 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-e41299eb-be39-4f44-a073-ab7e86845348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:50.727956 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41299eb-be39-4f44-a073-ab7e86845348 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:50.749119 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc37ff-972c-417c-be11-34e5fdaf89cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:50.750147 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc37ff-972c-417c-be11-34e5fdaf89cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:50.750608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc37ff-972c-417c-be11-34e5fdaf89cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:50.754132 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc37ff-972c-417c-be11-34e5fdaf89cd admin admin] PATH_INFO: `/v3/projects/98388d99967741079574198f38a902c5` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:50.757831 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc37ff-972c-417c-be11-34e5fdaf89cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=98388d99967741079574198f38a902c5)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:50.776061 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc37ff-972c-417c-be11-34e5fdaf89cd admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:50.904082 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-36bc37ff-972c-417c-be11-34e5fdaf89cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98388d99967741079574198f38a902c5', 'request_id': 'req-36bc37ff-972c-417c-be11-34e5fdaf89cd'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:50.912677 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-36bc37ff-972c-417c-be11-34e5fdaf89cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98388d99967741079574198f38a902c5', 'request_id': 'req-36bc37ff-972c-417c-be11-34e5fdaf89cd'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:50.920305 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-36bc37ff-972c-417c-be11-34e5fdaf89cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98388d99967741079574198f38a902c5', 'request_id': 'req-36bc37ff-972c-417c-be11-34e5fdaf89cd'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:50.945548 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-36bc37ff-972c-417c-be11-34e5fdaf89cd admin admin] The token cache is being invalidate because project 98388d99967741079574198f38a902c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:50.945847 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-36bc37ff-972c-417c-be11-34e5fdaf89cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:50.946789 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-36bc37ff-972c-417c-be11-34e5fdaf89cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:50.949521 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 995/1989] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:50 2022] DELETE /identity/v3/projects/98388d99967741079574198f38a902c5 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:50.955465 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b661086-0b31-4215-961b-f9f642fd1b68 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:50.956121 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b661086-0b31-4215-961b-f9f642fd1b68 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:50.956650 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b661086-0b31-4215-961b-f9f642fd1b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:50.978636 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-5b661086-0b31-4215-961b-f9f642fd1b68 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:50.983987 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-5b661086-0b31-4215-961b-f9f642fd1b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:51.088268 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 995/1990] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:50 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:51.096325 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a2f16-f08a-43bc-91db-1d354a350af1 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:51.096707 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a2f16-f08a-43bc-91db-1d354a350af1 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:51.097102 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a2f16-f08a-43bc-91db-1d354a350af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:51.109160 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b661086-0b31-4215-961b-f9f642fd1b68 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:51.111989 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-5b661086-0b31-4215-961b-f9f642fd1b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:51.121763 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-c77a2f16-f08a-43bc-91db-1d354a350af1 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:51.123242 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c77a2f16-f08a-43bc-91db-1d354a350af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:51.136719 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 996/1991] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:51 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:51.143586 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a2f16-f08a-43bc-91db-1d354a350af1 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:51.160163 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a2f16-f08a-43bc-91db-1d354a350af1 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:51.173764 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc5523-9203-472f-b2d2-8d11ca480428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:51.175147 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc5523-9203-472f-b2d2-8d11ca480428 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:51.175522 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc5523-9203-472f-b2d2-8d11ca480428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:51.175852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc5523-9203-472f-b2d2-8d11ca480428 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:51.176691 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc5523-9203-472f-b2d2-8d11ca480428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:51.177085 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc5523-9203-472f-b2d2-8d11ca480428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:51.179356 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc5523-9203-472f-b2d2-8d11ca480428 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:51.199490 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 997/1992] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:51.200883 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc5523-9203-472f-b2d2-8d11ca480428 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:51.215794 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc5523-9203-472f-b2d2-8d11ca480428 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:51.219805 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b661086-0b31-4215-961b-f9f642fd1b68 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:51.225008 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0a6ba-9b7a-423e-9d05-052fbb935874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:51.226057 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0a6ba-9b7a-423e-9d05-052fbb935874 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:51.226471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0a6ba-9b7a-423e-9d05-052fbb935874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:51.226834 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0a6ba-9b7a-423e-9d05-052fbb935874 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:51.228840 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0a6ba-9b7a-423e-9d05-052fbb935874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:51.231259 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0a6ba-9b7a-423e-9d05-052fbb935874 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:51.232171 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614625a2-3155-4d05-b9a2-d6419772fafe tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8204d8187c467ca8a969b300a84744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bdec33f230c4050bd806baef2da329b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:51.233753 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614625a2-3155-4d05-b9a2-d6419772fafe tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:51.234222 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614625a2-3155-4d05-b9a2-d6419772fafe tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:51.234700 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614625a2-3155-4d05-b9a2-d6419772fafe tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:51.235667 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614625a2-3155-4d05-b9a2-d6419772fafe tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:51.236159 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614625a2-3155-4d05-b9a2-d6419772fafe tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:51.238057 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614625a2-3155-4d05-b9a2-d6419772fafe tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:51.255392 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 996/1993] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:51.267900 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614625a2-3155-4d05-b9a2-d6419772fafe tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:51.282002 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614625a2-3155-4d05-b9a2-d6419772fafe tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:51.284749 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 998/1994] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:51 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:51.286411 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0a6ba-9b7a-423e-9d05-052fbb935874 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:51.376531 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86858f69-72d4-4d9d-a372-c61dea51731c tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8204d8187c467ca8a969b300a84744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bdec33f230c4050bd806baef2da329b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:51.377248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86858f69-72d4-4d9d-a372-c61dea51731c tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:51.377536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86858f69-72d4-4d9d-a372-c61dea51731c tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:51.377819 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86858f69-72d4-4d9d-a372-c61dea51731c tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:51.378997 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86858f69-72d4-4d9d-a372-c61dea51731c tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:51.380446 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86858f69-72d4-4d9d-a372-c61dea51731c tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:51.390049 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0a6ba-9b7a-423e-9d05-052fbb935874 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:51.401785 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600f813-ea3a-4233-a01e-bc23fed200b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:51.402518 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600f813-ea3a-4233-a01e-bc23fed200b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:51.402807 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600f813-ea3a-4233-a01e-bc23fed200b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:51.403074 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600f813-ea3a-4233-a01e-bc23fed200b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:51.403763 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600f813-ea3a-4233-a01e-bc23fed200b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:51.406707 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600f813-ea3a-4233-a01e-bc23fed200b1 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:51.426581 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 997/1995] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:51 2022] POST /identity/v3/projects => generated 355 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:51.432447 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86858f69-72d4-4d9d-a372-c61dea51731c tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:51.447524 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 999/1996] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:51 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:51.449252 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600f813-ea3a-4233-a01e-bc23fed200b1 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:51.465162 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600f813-ea3a-4233-a01e-bc23fed200b1 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:51.573359 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a3dec-d433-42a9-9bb3-e2efeed87756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:51.574086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a3dec-d433-42a9-9bb3-e2efeed87756 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:51.574379 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a3dec-d433-42a9-9bb3-e2efeed87756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:51.574723 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a3dec-d433-42a9-9bb3-e2efeed87756 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:51.575602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a3dec-d433-42a9-9bb3-e2efeed87756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:51.578613 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a3dec-d433-42a9-9bb3-e2efeed87756 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:51.586380 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86858f69-72d4-4d9d-a372-c61dea51731c tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:51.594079 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1000/1997] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:51.594715 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4c51c-e04c-4c66-9d80-eade0db176c4 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8204d8187c467ca8a969b300a84744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bdec33f230c4050bd806baef2da329b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:51.595981 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4c51c-e04c-4c66-9d80-eade0db176c4 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:51.596469 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4c51c-e04c-4c66-9d80-eade0db176c4 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:51.596991 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4c51c-e04c-4c66-9d80-eade0db176c4 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:51.598459 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4c51c-e04c-4c66-9d80-eade0db176c4 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:51.598974 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4c51c-e04c-4c66-9d80-eade0db176c4 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:51.600363 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a3dec-d433-42a9-9bb3-e2efeed87756 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:51.601910 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4c51c-e04c-4c66-9d80-eade0db176c4 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:51.617920 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a3dec-d433-42a9-9bb3-e2efeed87756 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:51.626507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c58b0d-548b-4d38-8c03-918e3fb3f24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:51.627445 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c58b0d-548b-4d38-8c03-918e3fb3f24c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:51.627894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c58b0d-548b-4d38-8c03-918e3fb3f24c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:51.628314 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c58b0d-548b-4d38-8c03-918e3fb3f24c admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:51.629316 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c58b0d-548b-4d38-8c03-918e3fb3f24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:51.630211 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 998/1998] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:57:51.631330 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c58b0d-548b-4d38-8c03-918e3fb3f24c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:51.648617 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1001/1999] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:51.650214 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4c51c-e04c-4c66-9d80-eade0db176c4 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:51.671452 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4c51c-e04c-4c66-9d80-eade0db176c4 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:51.681651 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5cf3d-775e-4812-8ad0-b308a1cade2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:51.684111 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5cf3d-775e-4812-8ad0-b308a1cade2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:51.685259 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5cf3d-775e-4812-8ad0-b308a1cade2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:51.686248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5cf3d-775e-4812-8ad0-b308a1cade2e admin admin] PATH_INFO: `/v3/projects/4ca8fbd98a1e4a1e9522728ee14b34a6/users/56551a48f6df42eba6828a019f696705/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:51.700362 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c58b0d-548b-4d38-8c03-918e3fb3f24c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:51.712715 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c58b0d-548b-4d38-8c03-918e3fb3f24c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:51.725538 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5cf3d-775e-4812-8ad0-b308a1cade2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca8fbd98a1e4a1e9522728ee14b34a6, user_id=56551a48f6df42eba6828a019f696705, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:51.729120 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5cf3d-775e-4812-8ad0-b308a1cade2e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:51.733225 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb8562-1ee1-4bff-a25c-a70584597877 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8204d8187c467ca8a969b300a84744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bdec33f230c4050bd806baef2da329b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:51.734104 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb8562-1ee1-4bff-a25c-a70584597877 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:51.734387 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb8562-1ee1-4bff-a25c-a70584597877 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:51.734660 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb8562-1ee1-4bff-a25c-a70584597877 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] PATH_INFO: `/v3/projects/7ebd03499ff54900b841434846c8aeca` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:51.735973 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb8562-1ee1-4bff-a25c-a70584597877 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7ebd03499ff54900b841434846c8aeca)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:51.738820 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb8562-1ee1-4bff-a25c-a70584597877 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:51.778839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 999/2000] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:51 2022] PUT /identity/v3/projects/4ca8fbd98a1e4a1e9522728ee14b34a6/users/56551a48f6df42eba6828a019f696705/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:51.780734 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5cf3d-775e-4812-8ad0-b308a1cade2e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:51.790254 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-3bb5cf3d-775e-4812-8ad0-b308a1cade2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:51.798143 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-84fb8562-1ee1-4bff-a25c-a70584597877 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ebd03499ff54900b841434846c8aeca', 'request_id': 'req-84fb8562-1ee1-4bff-a25c-a70584597877'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:51.806860 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-84fb8562-1ee1-4bff-a25c-a70584597877 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ebd03499ff54900b841434846c8aeca', 'request_id': 'req-84fb8562-1ee1-4bff-a25c-a70584597877'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:51.814850 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-84fb8562-1ee1-4bff-a25c-a70584597877 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ebd03499ff54900b841434846c8aeca', 'request_id': 'req-84fb8562-1ee1-4bff-a25c-a70584597877'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:51.835836 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-84fb8562-1ee1-4bff-a25c-a70584597877 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] The token cache is being invalidate because project 7ebd03499ff54900b841434846c8aeca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:51.836354 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-84fb8562-1ee1-4bff-a25c-a70584597877 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:51.837218 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-84fb8562-1ee1-4bff-a25c-a70584597877 tempest-VolumeQuotaClassesTest-934233819 tempest-VolumeQuotaClassesTest-934233819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:51.840033 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1002/2001] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:51 2022] DELETE /identity/v3/projects/7ebd03499ff54900b841434846c8aeca => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:51.841734 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d6c44-6a1e-45e3-b4fa-9a01fe08e933 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:51.843017 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d6c44-6a1e-45e3-b4fa-9a01fe08e933 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:51.843498 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d6c44-6a1e-45e3-b4fa-9a01fe08e933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:51.916124 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-c34d6c44-6a1e-45e3-b4fa-9a01fe08e933 None None] MFA Rules not processed for user `56551a48f6df42eba6828a019f696705`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:51.918459 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c34d6c44-6a1e-45e3-b4fa-9a01fe08e933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:51.920590 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5cf3d-775e-4812-8ad0-b308a1cade2e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:52.054670 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244bb98-b733-4f3c-b399-ae21807c75a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:52.055446 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244bb98-b733-4f3c-b399-ae21807c75a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:52.055734 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244bb98-b733-4f3c-b399-ae21807c75a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:52.056012 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244bb98-b733-4f3c-b399-ae21807c75a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:52.061514 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c244bb98-b733-4f3c-b399-ae21807c75a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:52.102578 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1003/2002] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:51 2022] POST /identity/v3/auth/tokens => generated 3389 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:52.114912 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d6c44-6a1e-45e3-b4fa-9a01fe08e933 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:52.117626 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c34d6c44-6a1e-45e3-b4fa-9a01fe08e933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:52.245646 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d6c44-6a1e-45e3-b4fa-9a01fe08e933 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:52.260836 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb303538-5a73-48a5-b7f8-ed3bf07e0fc4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07298acc960e4154be7c79f2368a1952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:52.261614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb303538-5a73-48a5-b7f8-ed3bf07e0fc4 service glance] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:52.261614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb303538-5a73-48a5-b7f8-ed3bf07e0fc4 service glance] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:52.261868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb303538-5a73-48a5-b7f8-ed3bf07e0fc4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:52.278456 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb303538-5a73-48a5-b7f8-ed3bf07e0fc4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:52.280844 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb303538-5a73-48a5-b7f8-ed3bf07e0fc4 service glance] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:52.292735 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1004/2003] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:52 2022] GET /identity/v3/auth/tokens => generated 3389 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:57:52.308575 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb303538-5a73-48a5-b7f8-ed3bf07e0fc4 service glance] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:52.310362 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-fb303538-5a73-48a5-b7f8-ed3bf07e0fc4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:52.360956 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244bb98-b733-4f3c-b399-ae21807c75a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:52.362410 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244bb98-b733-4f3c-b399-ae21807c75a6 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:52.425711 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1000/2004] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:51 2022] GET /identity/v3/auth/tokens => generated 3460 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:52.480518 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb303538-5a73-48a5-b7f8-ed3bf07e0fc4 service glance] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:52.487240 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463a453-fc80-49b8-9e29-3d7c4323eb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:52.488369 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463a453-fc80-49b8-9e29-3d7c4323eb47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:52.488973 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463a453-fc80-49b8-9e29-3d7c4323eb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:52.489382 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463a453-fc80-49b8-9e29-3d7c4323eb47 admin admin] PATH_INFO: `/v3/users/5daa25d997d04943a1533fe3fe9d1ff3` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:52.490777 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463a453-fc80-49b8-9e29-3d7c4323eb47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5daa25d997d04943a1533fe3fe9d1ff3)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:52.493484 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463a453-fc80-49b8-9e29-3d7c4323eb47 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:52.588588 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7463a453-fc80-49b8-9e29-3d7c4323eb47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5daa25d997d04943a1533fe3fe9d1ff3'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:52.598121 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7463a453-fc80-49b8-9e29-3d7c4323eb47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5daa25d997d04943a1533fe3fe9d1ff3'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:52.600024 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7463a453-fc80-49b8-9e29-3d7c4323eb47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5daa25d997d04943a1533fe3fe9d1ff3'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:52.621435 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7463a453-fc80-49b8-9e29-3d7c4323eb47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5daa25d997d04943a1533fe3fe9d1ff3'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:52.653993 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7463a453-fc80-49b8-9e29-3d7c4323eb47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5daa25d997d04943a1533fe3fe9d1ff3'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:52.715979 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a81d2-c084-473b-be6a-eadb7820a0dc None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:52.716494 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a81d2-c084-473b-be6a-eadb7820a0dc None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:52.716870 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a81d2-c084-473b-be6a-eadb7820a0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:52.719028 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1005/2005] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:52 2022] DELETE /identity/v3/users/5daa25d997d04943a1533fe3fe9d1ff3 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:57:52.753840 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-956a81d2-c084-473b-be6a-eadb7820a0dc None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:52.755089 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-956a81d2-c084-473b-be6a-eadb7820a0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:52.900496 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1001/2006] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:52 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:52.915155 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463a453-fc80-49b8-9e29-3d7c4323eb47 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:52.916908 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-7463a453-fc80-49b8-9e29-3d7c4323eb47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:53.047383 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463a453-fc80-49b8-9e29-3d7c4323eb47 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:53.060301 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560d032-25ec-4fef-ad96-800c81759978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:53.061371 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560d032-25ec-4fef-ad96-800c81759978 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:53.061662 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560d032-25ec-4fef-ad96-800c81759978 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:53.061919 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560d032-25ec-4fef-ad96-800c81759978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:53.077669 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560d032-25ec-4fef-ad96-800c81759978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:53.079626 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560d032-25ec-4fef-ad96-800c81759978 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:53.095639 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1006/2007] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:52 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:53.558578 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a81d2-c084-473b-be6a-eadb7820a0dc None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:53.562374 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-956a81d2-c084-473b-be6a-eadb7820a0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:53.587944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a81d2-c084-473b-be6a-eadb7820a0dc None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:53.592594 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f1413-e42a-479e-903d-d6469f315981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:53.593732 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f1413-e42a-479e-903d-d6469f315981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:53.594015 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f1413-e42a-479e-903d-d6469f315981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:53.594413 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f1413-e42a-479e-903d-d6469f315981 admin admin] PATH_INFO: `/v3/projects/0c4f0b6d489e4ecaa78e44447379a9e9` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:53.609347 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f1413-e42a-479e-903d-d6469f315981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c4f0b6d489e4ecaa78e44447379a9e9)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:53.611353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f1413-e42a-479e-903d-d6469f315981 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:53.752647 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-261f1413-e42a-479e-903d-d6469f315981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c4f0b6d489e4ecaa78e44447379a9e9', 'request_id': 'req-261f1413-e42a-479e-903d-d6469f315981'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:53.774662 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-261f1413-e42a-479e-903d-d6469f315981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c4f0b6d489e4ecaa78e44447379a9e9', 'request_id': 'req-261f1413-e42a-479e-903d-d6469f315981'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:53.786415 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-261f1413-e42a-479e-903d-d6469f315981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c4f0b6d489e4ecaa78e44447379a9e9', 'request_id': 'req-261f1413-e42a-479e-903d-d6469f315981'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:53.812995 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-261f1413-e42a-479e-903d-d6469f315981 admin admin] The token cache is being invalidate because project 0c4f0b6d489e4ecaa78e44447379a9e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:53.813631 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-261f1413-e42a-479e-903d-d6469f315981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:53.814614 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-261f1413-e42a-479e-903d-d6469f315981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:53.818566 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1002/2008] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:53 2022] DELETE /identity/v3/projects/0c4f0b6d489e4ecaa78e44447379a9e9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:53.825058 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560d032-25ec-4fef-ad96-800c81759978 service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:53.852500 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560d032-25ec-4fef-ad96-800c81759978 service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:53.932436 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d17ed6-68a5-4f30-ac30-8b652e816179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:53.933402 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d17ed6-68a5-4f30-ac30-8b652e816179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:53.933679 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d17ed6-68a5-4f30-ac30-8b652e816179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:53.933949 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d17ed6-68a5-4f30-ac30-8b652e816179 admin admin] PATH_INFO: `/v3/users/da8204d8187c467ca8a969b300a84744` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:53.937293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d17ed6-68a5-4f30-ac30-8b652e816179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da8204d8187c467ca8a969b300a84744)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:53.940556 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d17ed6-68a5-4f30-ac30-8b652e816179 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:54.028550 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-48d17ed6-68a5-4f30-ac30-8b652e816179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da8204d8187c467ca8a969b300a84744'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:54.030424 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-48d17ed6-68a5-4f30-ac30-8b652e816179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da8204d8187c467ca8a969b300a84744'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:54.031701 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-48d17ed6-68a5-4f30-ac30-8b652e816179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da8204d8187c467ca8a969b300a84744'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:54.047898 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-48d17ed6-68a5-4f30-ac30-8b652e816179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da8204d8187c467ca8a969b300a84744'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:54.058437 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-48d17ed6-68a5-4f30-ac30-8b652e816179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da8204d8187c467ca8a969b300a84744'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:54.112531 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1007/2009] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:57:53 2022] DELETE /identity/v3/users/da8204d8187c467ca8a969b300a84744 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:55.085247 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f1413-e42a-479e-903d-d6469f315981 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:55.087536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-261f1413-e42a-479e-903d-d6469f315981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:55.115257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f1413-e42a-479e-903d-d6469f315981 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:55.122394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd233a-7d0c-449c-a928-3ca5d4c19867 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:55.122936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd233a-7d0c-449c-a928-3ca5d4c19867 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:55.122936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd233a-7d0c-449c-a928-3ca5d4c19867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:55.180429 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-b6cd233a-7d0c-449c-a928-3ca5d4c19867 None None] MFA Rules not processed for user `cd9cb4ec35524e859b828892c95130e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:55.181083 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b6cd233a-7d0c-449c-a928-3ca5d4c19867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:55.222235 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739b14d-e18e-4c8f-9138-72ef2b94b0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:55.223559 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739b14d-e18e-4c8f-9138-72ef2b94b0de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:55.223827 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739b14d-e18e-4c8f-9138-72ef2b94b0de admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:55.224503 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739b14d-e18e-4c8f-9138-72ef2b94b0de admin admin] PATH_INFO: `/v3/projects/1bdec33f230c4050bd806baef2da329b` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:55.226285 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739b14d-e18e-4c8f-9138-72ef2b94b0de admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bdec33f230c4050bd806baef2da329b)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:55.228233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739b14d-e18e-4c8f-9138-72ef2b94b0de admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:55.277100 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1008/2010] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:55 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:55.282241 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd233a-7d0c-449c-a928-3ca5d4c19867 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:55.286252 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b6cd233a-7d0c-449c-a928-3ca5d4c19867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:55.298262 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9739b14d-e18e-4c8f-9138-72ef2b94b0de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bdec33f230c4050bd806baef2da329b', 'request_id': 'req-9739b14d-e18e-4c8f-9138-72ef2b94b0de'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:55.301984 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd233a-7d0c-449c-a928-3ca5d4c19867 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:55.304652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9739b14d-e18e-4c8f-9138-72ef2b94b0de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bdec33f230c4050bd806baef2da329b', 'request_id': 'req-9739b14d-e18e-4c8f-9138-72ef2b94b0de'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:55.311932 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9739b14d-e18e-4c8f-9138-72ef2b94b0de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bdec33f230c4050bd806baef2da329b', 'request_id': 'req-9739b14d-e18e-4c8f-9138-72ef2b94b0de'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:55.326092 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9739b14d-e18e-4c8f-9138-72ef2b94b0de admin admin] The token cache is being invalidate because project 1bdec33f230c4050bd806baef2da329b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:57:55.326748 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9739b14d-e18e-4c8f-9138-72ef2b94b0de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:55.327588 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9739b14d-e18e-4c8f-9138-72ef2b94b0de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:57:55.329202 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1003/2011] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:57:55 2022] DELETE /identity/v3/projects/1bdec33f230c4050bd806baef2da329b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:55.335173 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da03b4-850f-4d0a-876e-12f4931e5581 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:55.335458 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da03b4-850f-4d0a-876e-12f4931e5581 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:55.335917 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da03b4-850f-4d0a-876e-12f4931e5581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:55.359577 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-f4da03b4-850f-4d0a-876e-12f4931e5581 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:55.360888 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-f4da03b4-850f-4d0a-876e-12f4931e5581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:55.365183 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5be94-b3d5-477d-a1d5-ad68401c6a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:55.365949 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5be94-b3d5-477d-a1d5-ad68401c6a9b admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:55.366308 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5be94-b3d5-477d-a1d5-ad68401c6a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:55.366646 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5be94-b3d5-477d-a1d5-ad68401c6a9b admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:55.367437 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5be94-b3d5-477d-a1d5-ad68401c6a9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:55.369474 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5be94-b3d5-477d-a1d5-ad68401c6a9b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:55.369966 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1004/2012] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:55 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:55.381337 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109877ef-0ba3-472b-a761-cb526a9cc20b None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:55.381719 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109877ef-0ba3-472b-a761-cb526a9cc20b None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:55.382066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109877ef-0ba3-472b-a761-cb526a9cc20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:55.409376 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-109877ef-0ba3-472b-a761-cb526a9cc20b None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:55.410248 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1009/2013] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:55 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:55.413944 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5be94-b3d5-477d-a1d5-ad68401c6a9b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:55.414562 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-109877ef-0ba3-472b-a761-cb526a9cc20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:55.415533 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-52e5be94-b3d5-477d-a1d5-ad68401c6a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:55.486387 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1005/2014] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:55 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:57:55.490730 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109877ef-0ba3-472b-a761-cb526a9cc20b None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:55.500025 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5be94-b3d5-477d-a1d5-ad68401c6a9b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:55.500448 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109877ef-0ba3-472b-a761-cb526a9cc20b None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:55.504981 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189ba08-9232-48c4-83d2-dc545e594646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:55.505177 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139b9fb-bf05-468b-bf1e-50a13153fcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:55.505657 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189ba08-9232-48c4-83d2-dc545e594646 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:55.505829 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139b9fb-bf05-468b-bf1e-50a13153fcbe admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:55.505928 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189ba08-9232-48c4-83d2-dc545e594646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:55.506110 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139b9fb-bf05-468b-bf1e-50a13153fcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:55.506207 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189ba08-9232-48c4-83d2-dc545e594646 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:55.506378 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139b9fb-bf05-468b-bf1e-50a13153fcbe admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:55.506865 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189ba08-9232-48c4-83d2-dc545e594646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:55.507090 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139b9fb-bf05-468b-bf1e-50a13153fcbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:57:55.507388 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139b9fb-bf05-468b-bf1e-50a13153fcbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:55.508785 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189ba08-9232-48c4-83d2-dc545e594646 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:55.508978 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139b9fb-bf05-468b-bf1e-50a13153fcbe admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:55.522938 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1006/2015] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:57:55.527989 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139b9fb-bf05-468b-bf1e-50a13153fcbe admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:55.535032 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1010/2016] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:55 2022] POST /identity/v3/users => generated 296 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:57:55.538543 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189ba08-9232-48c4-83d2-dc545e594646 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:55.541574 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139b9fb-bf05-468b-bf1e-50a13153fcbe admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:55.547204 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833da7a-cb3f-4a1f-94ec-3c0d116df72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:55.547863 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833da7a-cb3f-4a1f-94ec-3c0d116df72b admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:55.548138 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833da7a-cb3f-4a1f-94ec-3c0d116df72b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:55.548408 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833da7a-cb3f-4a1f-94ec-3c0d116df72b admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:55.549130 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833da7a-cb3f-4a1f-94ec-3c0d116df72b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:55.551027 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833da7a-cb3f-4a1f-94ec-3c0d116df72b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:55.558908 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189ba08-9232-48c4-83d2-dc545e594646 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:55.566173 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405220d8-5390-4d33-95f5-9f79bfc70638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:55.567091 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405220d8-5390-4d33-95f5-9f79bfc70638 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:55.567282 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405220d8-5390-4d33-95f5-9f79bfc70638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:55.567595 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405220d8-5390-4d33-95f5-9f79bfc70638 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:55.568329 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405220d8-5390-4d33-95f5-9f79bfc70638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:55.569988 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405220d8-5390-4d33-95f5-9f79bfc70638 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:55.582073 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1011/2017] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:57:55.586054 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405220d8-5390-4d33-95f5-9f79bfc70638 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:55.593430 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1007/2018] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:55 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:57:55.594530 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833da7a-cb3f-4a1f-94ec-3c0d116df72b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:55.598661 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405220d8-5390-4d33-95f5-9f79bfc70638 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:55.675130 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833da7a-cb3f-4a1f-94ec-3c0d116df72b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:55.681399 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f493edb-a4b5-4f1b-9456-9f44eff5ab9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:55.681858 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311d1eb-d3b8-4828-98f6-7e9b05ed681c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:55.682271 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f493edb-a4b5-4f1b-9456-9f44eff5ab9a admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:55.682611 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f493edb-a4b5-4f1b-9456-9f44eff5ab9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:55.682892 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f493edb-a4b5-4f1b-9456-9f44eff5ab9a admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:55.683516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311d1eb-d3b8-4828-98f6-7e9b05ed681c admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:55.683755 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f493edb-a4b5-4f1b-9456-9f44eff5ab9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:55.684242 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311d1eb-d3b8-4828-98f6-7e9b05ed681c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:55.684666 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311d1eb-d3b8-4828-98f6-7e9b05ed681c admin admin] PATH_INFO: `/v3/projects/f201d79d2228443fae07022bc53b97b2/users/8dad11600d5642d880603399a7252791/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:55.687550 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f493edb-a4b5-4f1b-9456-9f44eff5ab9a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:55.717871 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311d1eb-d3b8-4828-98f6-7e9b05ed681c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f201d79d2228443fae07022bc53b97b2, user_id=8dad11600d5642d880603399a7252791, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:55.720654 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311d1eb-d3b8-4828-98f6-7e9b05ed681c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:55.727187 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1008/2019] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:55 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:57:55.732352 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f493edb-a4b5-4f1b-9456-9f44eff5ab9a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:55.742586 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1012/2020] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:55 2022] PUT /identity/v3/projects/f201d79d2228443fae07022bc53b97b2/users/8dad11600d5642d880603399a7252791/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:55.743587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311d1eb-d3b8-4828-98f6-7e9b05ed681c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:55.751542 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f493edb-a4b5-4f1b-9456-9f44eff5ab9a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:55.841288 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11b838-6302-4520-b055-f3831067e472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:55.842912 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11b838-6302-4520-b055-f3831067e472 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:55.843164 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11b838-6302-4520-b055-f3831067e472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:55.843906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11b838-6302-4520-b055-f3831067e472 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:55.844677 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11b838-6302-4520-b055-f3831067e472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:55.848557 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11b838-6302-4520-b055-f3831067e472 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:55.860632 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1009/2021] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:55.865256 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11b838-6302-4520-b055-f3831067e472 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:55.882443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11b838-6302-4520-b055-f3831067e472 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:55.887893 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddfd95-418c-4785-9eb7-637f6c58521e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:55.888748 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddfd95-418c-4785-9eb7-637f6c58521e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:55.889705 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddfd95-418c-4785-9eb7-637f6c58521e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:55.890400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddfd95-418c-4785-9eb7-637f6c58521e admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:55.891244 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddfd95-418c-4785-9eb7-637f6c58521e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:55.893372 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddfd95-418c-4785-9eb7-637f6c58521e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:55.905695 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311d1eb-d3b8-4828-98f6-7e9b05ed681c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:55.913705 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1010/2022] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:57:55.918418 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddfd95-418c-4785-9eb7-637f6c58521e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:55.922557 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cf4d3-9161-48e2-9334-f968d037eea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:55.923246 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cf4d3-9161-48e2-9334-f968d037eea7 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:55.925018 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cf4d3-9161-48e2-9334-f968d037eea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:55.925577 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cf4d3-9161-48e2-9334-f968d037eea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:55.926440 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cf4d3-9161-48e2-9334-f968d037eea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:55.928574 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cf4d3-9161-48e2-9334-f968d037eea7 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:55.929694 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddfd95-418c-4785-9eb7-637f6c58521e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:55.940724 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3ddf2-4f70-4041-ad3e-dbd40f735cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:55.943585 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3ddf2-4f70-4041-ad3e-dbd40f735cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:55.944046 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3ddf2-4f70-4041-ad3e-dbd40f735cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:55.944577 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3ddf2-4f70-4041-ad3e-dbd40f735cf0 admin admin] PATH_INFO: `/v3/projects/fbe16b6f9b0e4c55abcf07a9bfab1b7d/users/e1faa842c0274575a2c4f1802ed17ccf/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:55.953226 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1013/2023] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:57:55.956943 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cf4d3-9161-48e2-9334-f968d037eea7 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:55.973358 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cf4d3-9161-48e2-9334-f968d037eea7 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:55.976228 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3ddf2-4f70-4041-ad3e-dbd40f735cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe16b6f9b0e4c55abcf07a9bfab1b7d, user_id=e1faa842c0274575a2c4f1802ed17ccf, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:55.981392 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3ddf2-4f70-4041-ad3e-dbd40f735cf0 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:55.981569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be16098-1bfb-486a-bdea-d22317fff7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:55.982542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be16098-1bfb-486a-bdea-d22317fff7e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:55.983109 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be16098-1bfb-486a-bdea-d22317fff7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:55.984140 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be16098-1bfb-486a-bdea-d22317fff7e7 admin admin] PATH_INFO: `/v3/projects/f201d79d2228443fae07022bc53b97b2/users/8dad11600d5642d880603399a7252791/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:55.986577 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be16098-1bfb-486a-bdea-d22317fff7e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f201d79d2228443fae07022bc53b97b2, user_id=8dad11600d5642d880603399a7252791, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:55.990263 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be16098-1bfb-486a-bdea-d22317fff7e7 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:56.004781 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1011/2024] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:55 2022] PUT /identity/v3/projects/fbe16b6f9b0e4c55abcf07a9bfab1b7d/users/e1faa842c0274575a2c4f1802ed17ccf/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:57:56.012127 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1014/2025] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:55 2022] PUT /identity/v3/projects/f201d79d2228443fae07022bc53b97b2/users/8dad11600d5642d880603399a7252791/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:56.018518 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052a2a6-a8eb-4a62-92f5-b07906f91fc7 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:56.018671 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052a2a6-a8eb-4a62-92f5-b07906f91fc7 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:56.018912 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052a2a6-a8eb-4a62-92f5-b07906f91fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:56.065779 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-b052a2a6-a8eb-4a62-92f5-b07906f91fc7 None None] MFA Rules not processed for user `e1faa842c0274575a2c4f1802ed17ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:56.067147 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b052a2a6-a8eb-4a62-92f5-b07906f91fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:56.191248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1012/2026] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:56 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:56.197581 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be16098-1bfb-486a-bdea-d22317fff7e7 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:56.311700 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be16098-1bfb-486a-bdea-d22317fff7e7 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:56.316816 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ee1d2-cc38-4004-b3c1-6f7483ba396e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:56.317495 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ee1d2-cc38-4004-b3c1-6f7483ba396e admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:56.318030 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ee1d2-cc38-4004-b3c1-6f7483ba396e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:56.318546 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ee1d2-cc38-4004-b3c1-6f7483ba396e admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:56.319507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ee1d2-cc38-4004-b3c1-6f7483ba396e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:56.321797 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ee1d2-cc38-4004-b3c1-6f7483ba396e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:56.354451 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1015/2027] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:57:56 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:56.360375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052a2a6-a8eb-4a62-92f5-b07906f91fc7 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:56.374934 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052a2a6-a8eb-4a62-92f5-b07906f91fc7 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:56.475474 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6745a6-5a90-4d53-be75-068745a172e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:56.476328 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6745a6-5a90-4d53-be75-068745a172e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:56.476606 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6745a6-5a90-4d53-be75-068745a172e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:56.476909 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6745a6-5a90-4d53-be75-068745a172e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:56.477597 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6745a6-5a90-4d53-be75-068745a172e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:56.479500 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6745a6-5a90-4d53-be75-068745a172e0 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:56.504105 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1013/2028] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:57:56 2022] POST /identity/v3/users => generated 298 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:56.508322 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ee1d2-cc38-4004-b3c1-6f7483ba396e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:56.520100 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ee1d2-cc38-4004-b3c1-6f7483ba396e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:56.526357 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a45dde-99c9-4090-b81f-d511d97cf261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:56.527083 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a45dde-99c9-4090-b81f-d511d97cf261 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:56.527404 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a45dde-99c9-4090-b81f-d511d97cf261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:56.527701 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a45dde-99c9-4090-b81f-d511d97cf261 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:56.528549 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a45dde-99c9-4090-b81f-d511d97cf261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:56.530523 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a45dde-99c9-4090-b81f-d511d97cf261 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:56.548076 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1016/2029] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:56.554643 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6745a6-5a90-4d53-be75-068745a172e0 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:56.578800 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6745a6-5a90-4d53-be75-068745a172e0 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:56.586430 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de86cc-19b9-45ae-81ab-a0079925003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:56.587520 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de86cc-19b9-45ae-81ab-a0079925003b admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:56.587848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de86cc-19b9-45ae-81ab-a0079925003b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:56.588119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de86cc-19b9-45ae-81ab-a0079925003b admin admin] PATH_INFO: `/v3/projects/3efa7fb071134ab6a466eca3f5199ad2/users/a7b71297e062493ea8c06225ca4b8cba/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:56.617094 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de86cc-19b9-45ae-81ab-a0079925003b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efa7fb071134ab6a466eca3f5199ad2, user_id=a7b71297e062493ea8c06225ca4b8cba, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:56.619675 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de86cc-19b9-45ae-81ab-a0079925003b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:56.650085 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1014/2030] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:56 2022] PUT /identity/v3/projects/3efa7fb071134ab6a466eca3f5199ad2/users/a7b71297e062493ea8c06225ca4b8cba/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:56.652385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a45dde-99c9-4090-b81f-d511d97cf261 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:56.663814 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a45dde-99c9-4090-b81f-d511d97cf261 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:56.745858 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f752be9-cb4a-45fe-80b1-b647714fda5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:56.746279 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f752be9-cb4a-45fe-80b1-b647714fda5f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:56.746629 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f752be9-cb4a-45fe-80b1-b647714fda5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:56.747251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f752be9-cb4a-45fe-80b1-b647714fda5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:56.747759 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f752be9-cb4a-45fe-80b1-b647714fda5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:56.750698 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f752be9-cb4a-45fe-80b1-b647714fda5f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:56.775428 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1017/2031] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:56.777654 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de86cc-19b9-45ae-81ab-a0079925003b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:56.793010 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de86cc-19b9-45ae-81ab-a0079925003b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:56.799690 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6b96c-8cba-4501-a997-6a4a06886a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:56.801190 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6b96c-8cba-4501-a997-6a4a06886a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:56.801190 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6b96c-8cba-4501-a997-6a4a06886a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:56.801390 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6b96c-8cba-4501-a997-6a4a06886a84 admin admin] PATH_INFO: `/v3/projects/3efa7fb071134ab6a466eca3f5199ad2/users/a7b71297e062493ea8c06225ca4b8cba/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:56.803453 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6b96c-8cba-4501-a997-6a4a06886a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efa7fb071134ab6a466eca3f5199ad2, user_id=a7b71297e062493ea8c06225ca4b8cba, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:56.806943 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6b96c-8cba-4501-a997-6a4a06886a84 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:56.835914 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1015/2032] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:57:56 2022] PUT /identity/v3/projects/3efa7fb071134ab6a466eca3f5199ad2/users/a7b71297e062493ea8c06225ca4b8cba/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:57:56.848890 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508214cf-a83c-43e0-b0b5-c81f2cce7288 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:56.849685 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508214cf-a83c-43e0-b0b5-c81f2cce7288 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:56.850390 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508214cf-a83c-43e0-b0b5-c81f2cce7288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:56.888088 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-508214cf-a83c-43e0-b0b5-c81f2cce7288 None None] MFA Rules not processed for user `a7b71297e062493ea8c06225ca4b8cba`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:56.889702 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-508214cf-a83c-43e0-b0b5-c81f2cce7288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:56.973747 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1018/2033] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:57:56 2022] POST /identity/v3/auth/tokens => generated 3470 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:56.984407 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6b96c-8cba-4501-a997-6a4a06886a84 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:56.986197 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-d5b6b96c-8cba-4501-a997-6a4a06886a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:57.079834 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6b96c-8cba-4501-a997-6a4a06886a84 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:57.086734 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ce9d4-4151-4a44-bfee-9b38b9480128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:57.088249 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ce9d4-4151-4a44-bfee-9b38b9480128 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:57.088602 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ce9d4-4151-4a44-bfee-9b38b9480128 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:57.088963 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ce9d4-4151-4a44-bfee-9b38b9480128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:57.174647 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ce9d4-4151-4a44-bfee-9b38b9480128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:57.176747 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ce9d4-4151-4a44-bfee-9b38b9480128 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:57.191726 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1016/2034] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:56 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:02.947894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8417f-1dfe-4d79-8769-733a757be58c None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:02.949181 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8417f-1dfe-4d79-8769-733a757be58c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:02.949725 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8417f-1dfe-4d79-8769-733a757be58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:02.983694 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cbd35-98e9-4d01-a89e-b9e445f3a2cc None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:02.984275 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cbd35-98e9-4d01-a89e-b9e445f3a2cc None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:02.984490 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cbd35-98e9-4d01-a89e-b9e445f3a2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:03.041149 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-1c0cbd35-98e9-4d01-a89e-b9e445f3a2cc None None] MFA Rules not processed for user `8dad11600d5642d880603399a7252791`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:03.042652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1c0cbd35-98e9-4d01-a89e-b9e445f3a2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:03.169366 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-19d8417f-1dfe-4d79-8769-733a757be58c None None] MFA Rules not processed for user `1f57e62502564821b4be822554d9f5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:03.172202 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-19d8417f-1dfe-4d79-8769-733a757be58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:03.190362 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1017/2035] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:02 2022] POST /identity/v3/auth/tokens => generated 3466 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:58:03.213470 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cbd35-98e9-4d01-a89e-b9e445f3a2cc None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:03.216098 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1c0cbd35-98e9-4d01-a89e-b9e445f3a2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:03.272235 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1019/2036] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:02 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:03.370041 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cbd35-98e9-4d01-a89e-b9e445f3a2cc None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:03.380610 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c31f3-4805-44bf-8eaf-6fb4446ba9ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:03.381391 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c31f3-4805-44bf-8eaf-6fb4446ba9ac service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:03.381665 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c31f3-4805-44bf-8eaf-6fb4446ba9ac service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:03.382117 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c31f3-4805-44bf-8eaf-6fb4446ba9ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:03.388180 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-175c31f3-4805-44bf-8eaf-6fb4446ba9ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:03.521025 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c31f3-4805-44bf-8eaf-6fb4446ba9ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:03.528033 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c31f3-4805-44bf-8eaf-6fb4446ba9ac service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:03.569533 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1018/2037] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:03 2022] GET /identity/v3/auth/tokens => generated 3399 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:58:03.580597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8417f-1dfe-4d79-8769-733a757be58c None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:03.584566 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-19d8417f-1dfe-4d79-8769-733a757be58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:03.605764 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8417f-1dfe-4d79-8769-733a757be58c None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:03.611591 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11165e92-dcba-4479-bcce-6e2c0c63c840 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:03.612550 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11165e92-dcba-4479-bcce-6e2c0c63c840 service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:03.613011 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11165e92-dcba-4479-bcce-6e2c0c63c840 service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:03.613540 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11165e92-dcba-4479-bcce-6e2c0c63c840 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:03.630360 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11165e92-dcba-4479-bcce-6e2c0c63c840 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:03.631832 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11165e92-dcba-4479-bcce-6e2c0c63c840 service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:03.656231 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1020/2038] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:03 2022] GET /identity/v3/auth/tokens => generated 3470 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:04.359272 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c31f3-4805-44bf-8eaf-6fb4446ba9ac service nova] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:04.365646 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-175c31f3-4805-44bf-8eaf-6fb4446ba9ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:04.551027 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c31f3-4805-44bf-8eaf-6fb4446ba9ac service nova] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:04.562274 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdce12-45d4-435e-9d15-66a90a27c0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:04.563829 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdce12-45d4-435e-9d15-66a90a27c0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:04.565145 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdce12-45d4-435e-9d15-66a90a27c0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:04.565145 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdce12-45d4-435e-9d15-66a90a27c0a1 admin admin] PATH_INFO: `/v3/users/d62a8866a5dd404cbc333c640d85e6f2` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:04.567044 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fdce12-45d4-435e-9d15-66a90a27c0a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d62a8866a5dd404cbc333c640d85e6f2)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:04.569046 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fdce12-45d4-435e-9d15-66a90a27c0a1 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:04.661956 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-27fdce12-45d4-435e-9d15-66a90a27c0a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd62a8866a5dd404cbc333c640d85e6f2'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:04.663536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-27fdce12-45d4-435e-9d15-66a90a27c0a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd62a8866a5dd404cbc333c640d85e6f2'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:04.713204 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-27fdce12-45d4-435e-9d15-66a90a27c0a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd62a8866a5dd404cbc333c640d85e6f2'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:04.729285 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-27fdce12-45d4-435e-9d15-66a90a27c0a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd62a8866a5dd404cbc333c640d85e6f2'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:04.756762 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-27fdce12-45d4-435e-9d15-66a90a27c0a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd62a8866a5dd404cbc333c640d85e6f2'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:04.790203 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1019/2039] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:58:04 2022] DELETE /identity/v3/users/d62a8866a5dd404cbc333c640d85e6f2 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:05.198100 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11165e92-dcba-4479-bcce-6e2c0c63c840 service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:05.209973 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11165e92-dcba-4479-bcce-6e2c0c63c840 service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:05.349674 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6e18d-eebf-443f-8827-e4dce29bf1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:05.350942 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6e18d-eebf-443f-8827-e4dce29bf1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:05.351420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6e18d-eebf-443f-8827-e4dce29bf1af admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:05.352004 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6e18d-eebf-443f-8827-e4dce29bf1af admin admin] PATH_INFO: `/v3/projects/8c0aef26837b47059522707fb2ce8422` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:05.353609 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6e18d-eebf-443f-8827-e4dce29bf1af admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c0aef26837b47059522707fb2ce8422)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:05.355741 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6e18d-eebf-443f-8827-e4dce29bf1af admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:05.485744 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7af6e18d-eebf-443f-8827-e4dce29bf1af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0aef26837b47059522707fb2ce8422', 'request_id': 'req-7af6e18d-eebf-443f-8827-e4dce29bf1af'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:05.505540 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7af6e18d-eebf-443f-8827-e4dce29bf1af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0aef26837b47059522707fb2ce8422', 'request_id': 'req-7af6e18d-eebf-443f-8827-e4dce29bf1af'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:05.532852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7af6e18d-eebf-443f-8827-e4dce29bf1af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0aef26837b47059522707fb2ce8422', 'request_id': 'req-7af6e18d-eebf-443f-8827-e4dce29bf1af'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:05.575393 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7af6e18d-eebf-443f-8827-e4dce29bf1af admin admin] The token cache is being invalidate because project 8c0aef26837b47059522707fb2ce8422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:58:05.578147 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7af6e18d-eebf-443f-8827-e4dce29bf1af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:05.579251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7af6e18d-eebf-443f-8827-e4dce29bf1af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:05.584346 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1021/2040] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:58:05 2022] DELETE /identity/v3/projects/8c0aef26837b47059522707fb2ce8422 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:05.593662 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126266f-9c3a-4a82-a124-e0fba5b3b280 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:05.594212 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126266f-9c3a-4a82-a124-e0fba5b3b280 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:05.594417 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126266f-9c3a-4a82-a124-e0fba5b3b280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:05.641843 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-9126266f-9c3a-4a82-a124-e0fba5b3b280 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:05.641843 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-9126266f-9c3a-4a82-a124-e0fba5b3b280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:05.799468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1020/2041] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:05 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:05.809040 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9912c3-484a-4b5b-a538-e8ca82bfdaea None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:05.809741 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9912c3-484a-4b5b-a538-e8ca82bfdaea None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:05.810261 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9912c3-484a-4b5b-a538-e8ca82bfdaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:05.853041 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-7f9912c3-484a-4b5b-a538-e8ca82bfdaea None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:05.859359 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-7f9912c3-484a-4b5b-a538-e8ca82bfdaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:05.880576 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1022/2042] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:05 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:05.885647 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126266f-9c3a-4a82-a124-e0fba5b3b280 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:05.903493 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126266f-9c3a-4a82-a124-e0fba5b3b280 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:05.910474 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a9a4d-00c2-484f-9540-b44d59d4c336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:05.911519 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a9a4d-00c2-484f-9540-b44d59d4c336 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:05.912291 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a9a4d-00c2-484f-9540-b44d59d4c336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:05.912968 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a9a4d-00c2-484f-9540-b44d59d4c336 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:05.914276 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a9a4d-00c2-484f-9540-b44d59d4c336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:58:05.914797 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a9a4d-00c2-484f-9540-b44d59d4c336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:05.916876 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a9a4d-00c2-484f-9540-b44d59d4c336 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:05.943839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1021/2043] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:58:05.945603 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9912c3-484a-4b5b-a538-e8ca82bfdaea None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:05.959425 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9912c3-484a-4b5b-a538-e8ca82bfdaea None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:05.968467 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf2282-4174-4813-8e99-71793d5ad46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:05.969306 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf2282-4174-4813-8e99-71793d5ad46f admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:05.969758 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf2282-4174-4813-8e99-71793d5ad46f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:05.970103 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf2282-4174-4813-8e99-71793d5ad46f admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:05.970981 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf2282-4174-4813-8e99-71793d5ad46f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:05.973755 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf2282-4174-4813-8e99-71793d5ad46f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:06.019729 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a9a4d-00c2-484f-9540-b44d59d4c336 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:06.030486 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1023/2044] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:58:05 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:58:06.041161 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a9a4d-00c2-484f-9540-b44d59d4c336 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:06.139973 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459e457-8c3c-440b-92be-e9701c1dfab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:06.141554 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459e457-8c3c-440b-92be-e9701c1dfab4 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:06.142105 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459e457-8c3c-440b-92be-e9701c1dfab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:06.142545 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459e457-8c3c-440b-92be-e9701c1dfab4 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:06.144036 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459e457-8c3c-440b-92be-e9701c1dfab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:06.146986 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459e457-8c3c-440b-92be-e9701c1dfab4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:06.231071 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1022/2045] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:58:06 2022] POST /identity/v3/users => generated 291 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:06.235455 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf2282-4174-4813-8e99-71793d5ad46f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:06.251464 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf2282-4174-4813-8e99-71793d5ad46f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:06.260461 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e3bcb-6a4a-445e-8a6d-2453cd281be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:06.261286 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e3bcb-6a4a-445e-8a6d-2453cd281be9 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:06.261566 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e3bcb-6a4a-445e-8a6d-2453cd281be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:06.261853 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e3bcb-6a4a-445e-8a6d-2453cd281be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:06.263698 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e3bcb-6a4a-445e-8a6d-2453cd281be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:06.266393 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e3bcb-6a4a-445e-8a6d-2453cd281be9 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:06.280372 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1024/2046] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:58:06.294427 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459e457-8c3c-440b-92be-e9701c1dfab4 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:06.311291 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459e457-8c3c-440b-92be-e9701c1dfab4 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:06.325350 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47a0e2-ea27-42cf-b7bc-f90a3fafaba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:06.327384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47a0e2-ea27-42cf-b7bc-f90a3fafaba0 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:06.327952 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47a0e2-ea27-42cf-b7bc-f90a3fafaba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:06.329385 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47a0e2-ea27-42cf-b7bc-f90a3fafaba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:06.333275 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47a0e2-ea27-42cf-b7bc-f90a3fafaba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:06.335382 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47a0e2-ea27-42cf-b7bc-f90a3fafaba0 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:06.356142 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1023/2047] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:06.367390 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e3bcb-6a4a-445e-8a6d-2453cd281be9 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:06.396839 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e3bcb-6a4a-445e-8a6d-2453cd281be9 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:06.403534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6277b1b-ae47-40a2-883c-f2ce83722be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:06.405343 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6277b1b-ae47-40a2-883c-f2ce83722be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:06.405824 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6277b1b-ae47-40a2-883c-f2ce83722be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:06.406240 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6277b1b-ae47-40a2-883c-f2ce83722be3 admin admin] PATH_INFO: `/v3/projects/662bb990f6a64f92a935d094ff0d831c/users/22bf708b55b5424ea7111f825f7e2149/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:06.436939 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6277b1b-ae47-40a2-883c-f2ce83722be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=662bb990f6a64f92a935d094ff0d831c, user_id=22bf708b55b5424ea7111f825f7e2149, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:06.440731 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6277b1b-ae47-40a2-883c-f2ce83722be3 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:06.486718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1025/2048] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:06 2022] PUT /identity/v3/projects/662bb990f6a64f92a935d094ff0d831c/users/22bf708b55b5424ea7111f825f7e2149/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:06.500907 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fbcd1-eef9-4e00-b5ff-00d31b0dfe46 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:06.501303 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fbcd1-eef9-4e00-b5ff-00d31b0dfe46 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:06.501671 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fbcd1-eef9-4e00-b5ff-00d31b0dfe46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:06.562561 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-ce2fbcd1-eef9-4e00-b5ff-00d31b0dfe46 None None] MFA Rules not processed for user `22bf708b55b5424ea7111f825f7e2149`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:06.564842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ce2fbcd1-eef9-4e00-b5ff-00d31b0dfe46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:06.717065 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1024/2049] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:06 2022] POST /identity/v3/auth/tokens => generated 3401 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:58:06.723243 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6277b1b-ae47-40a2-883c-f2ce83722be3 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:06.904897 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6277b1b-ae47-40a2-883c-f2ce83722be3 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:06.915534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc165da-5f2b-41e0-a2d7-c47d2ba6e62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:06.916893 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc165da-5f2b-41e0-a2d7-c47d2ba6e62d admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:06.916893 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc165da-5f2b-41e0-a2d7-c47d2ba6e62d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:06.917265 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc165da-5f2b-41e0-a2d7-c47d2ba6e62d admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:06.918247 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc165da-5f2b-41e0-a2d7-c47d2ba6e62d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:06.921662 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc165da-5f2b-41e0-a2d7-c47d2ba6e62d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:06.998514 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1026/2050] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:58:06 2022] POST /identity/v3/projects => generated 383 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:58:07.002905 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fbcd1-eef9-4e00-b5ff-00d31b0dfe46 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:07.028859 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fbcd1-eef9-4e00-b5ff-00d31b0dfe46 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:07.214152 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a99a69-2815-45d3-91ef-a0f4d4d570f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:07.217727 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a99a69-2815-45d3-91ef-a0f4d4d570f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:07.218106 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a99a69-2815-45d3-91ef-a0f4d4d570f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:07.219305 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a99a69-2815-45d3-91ef-a0f4d4d570f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:07.220114 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a99a69-2815-45d3-91ef-a0f4d4d570f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:07.228951 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a99a69-2815-45d3-91ef-a0f4d4d570f6 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:07.259990 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1025/2051] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:58:07 2022] POST /identity/v3/users => generated 298 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:58:07.265223 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc165da-5f2b-41e0-a2d7-c47d2ba6e62d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:07.283346 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc165da-5f2b-41e0-a2d7-c47d2ba6e62d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:07.289724 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0375958-ce2d-4197-8377-37c29e282191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:07.290854 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0375958-ce2d-4197-8377-37c29e282191 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:07.291321 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0375958-ce2d-4197-8377-37c29e282191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:07.292443 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0375958-ce2d-4197-8377-37c29e282191 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:07.294022 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0375958-ce2d-4197-8377-37c29e282191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:07.296404 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0375958-ce2d-4197-8377-37c29e282191 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:07.311597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1027/2052] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:07.315585 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a99a69-2815-45d3-91ef-a0f4d4d570f6 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:07.329828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a99a69-2815-45d3-91ef-a0f4d4d570f6 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:07.335448 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf132f2-5555-407a-92c3-29060197b427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:07.336476 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf132f2-5555-407a-92c3-29060197b427 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:07.336889 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf132f2-5555-407a-92c3-29060197b427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:07.337262 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf132f2-5555-407a-92c3-29060197b427 admin admin] PATH_INFO: `/v3/projects/de3dc66ee9be42639d6650fefaf31c35/users/accbe24cfd7e457fb44d7fc39a338f26/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:07.391244 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf132f2-5555-407a-92c3-29060197b427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de3dc66ee9be42639d6650fefaf31c35, user_id=accbe24cfd7e457fb44d7fc39a338f26, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:07.395101 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf132f2-5555-407a-92c3-29060197b427 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:07.416320 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1026/2053] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:07 2022] PUT /identity/v3/projects/de3dc66ee9be42639d6650fefaf31c35/users/accbe24cfd7e457fb44d7fc39a338f26/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:07.438121 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0375958-ce2d-4197-8377-37c29e282191 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:07.485756 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0375958-ce2d-4197-8377-37c29e282191 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:07.658490 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ee698-63af-4042-b8d5-6e6ff7fd482d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:07.659990 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ee698-63af-4042-b8d5-6e6ff7fd482d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:07.660683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ee698-63af-4042-b8d5-6e6ff7fd482d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:07.662465 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ee698-63af-4042-b8d5-6e6ff7fd482d admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:07.663430 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ee698-63af-4042-b8d5-6e6ff7fd482d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:07.666133 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ee698-63af-4042-b8d5-6e6ff7fd482d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:07.699196 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1028/2054] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:07.700551 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf132f2-5555-407a-92c3-29060197b427 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:07.713395 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf132f2-5555-407a-92c3-29060197b427 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:07.721089 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a461396-258b-4f25-8cc4-bdc1c63260fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:07.722225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a461396-258b-4f25-8cc4-bdc1c63260fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:07.722572 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a461396-258b-4f25-8cc4-bdc1c63260fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:07.722769 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a461396-258b-4f25-8cc4-bdc1c63260fb admin admin] PATH_INFO: `/v3/projects/de3dc66ee9be42639d6650fefaf31c35/users/accbe24cfd7e457fb44d7fc39a338f26/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:07.724970 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a461396-258b-4f25-8cc4-bdc1c63260fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=de3dc66ee9be42639d6650fefaf31c35, user_id=accbe24cfd7e457fb44d7fc39a338f26, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:07.727918 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a461396-258b-4f25-8cc4-bdc1c63260fb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:07.761218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1027/2055] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:07 2022] PUT /identity/v3/projects/de3dc66ee9be42639d6650fefaf31c35/users/accbe24cfd7e457fb44d7fc39a338f26/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:07.771794 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c773d3f-917b-45b8-abb2-6428c7ede913 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:07.772161 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c773d3f-917b-45b8-abb2-6428c7ede913 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:07.772511 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c773d3f-917b-45b8-abb2-6428c7ede913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:07.821555 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-8c773d3f-917b-45b8-abb2-6428c7ede913 None None] MFA Rules not processed for user `accbe24cfd7e457fb44d7fc39a338f26`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:07.823293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-8c773d3f-917b-45b8-abb2-6428c7ede913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:08.072157 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1029/2056] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:07 2022] POST /identity/v3/auth/tokens => generated 3470 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:08.085109 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a461396-258b-4f25-8cc4-bdc1c63260fb admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:08.087256 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-6a461396-258b-4f25-8cc4-bdc1c63260fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:08.322969 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a461396-258b-4f25-8cc4-bdc1c63260fb admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:08.329415 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3b867-e9b8-4a1f-8b1f-d0d087230396 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:08.330497 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3b867-e9b8-4a1f-8b1f-d0d087230396 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:08.331050 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3b867-e9b8-4a1f-8b1f-d0d087230396 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:08.331631 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3b867-e9b8-4a1f-8b1f-d0d087230396 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:08.353746 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3b867-e9b8-4a1f-8b1f-d0d087230396 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:08.355687 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3b867-e9b8-4a1f-8b1f-d0d087230396 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:08.369999 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1028/2057] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:08 2022] GET /identity/v3/auth/tokens => generated 3470 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:08.526204 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c773d3f-917b-45b8-abb2-6428c7ede913 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:08.535217 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-8c773d3f-917b-45b8-abb2-6428c7ede913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:08.558536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c773d3f-917b-45b8-abb2-6428c7ede913 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:08.564668 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a65d1f-a7aa-4682-b9b9-bced3a63591b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:08.567743 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a65d1f-a7aa-4682-b9b9-bced3a63591b service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:08.568112 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a65d1f-a7aa-4682-b9b9-bced3a63591b service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:08.568543 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a65d1f-a7aa-4682-b9b9-bced3a63591b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:08.691732 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a65d1f-a7aa-4682-b9b9-bced3a63591b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:08.693272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a65d1f-a7aa-4682-b9b9-bced3a63591b service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:08.722380 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1030/2058] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:08 2022] GET /identity/v3/auth/tokens => generated 3401 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:09.558577 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3b867-e9b8-4a1f-8b1f-d0d087230396 service cinder] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:09.563190 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2ec3b867-e9b8-4a1f-8b1f-d0d087230396 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:09.658184 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3b867-e9b8-4a1f-8b1f-d0d087230396 service cinder] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:09.663910 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bc9f6-33d8-4c63-acff-b8b8c691ff18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:09.665390 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bc9f6-33d8-4c63-acff-b8b8c691ff18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:09.665879 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bc9f6-33d8-4c63-acff-b8b8c691ff18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:09.666345 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bc9f6-33d8-4c63-acff-b8b8c691ff18 admin admin] PATH_INFO: `/v3/users/e1faa842c0274575a2c4f1802ed17ccf` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:09.670221 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bc9f6-33d8-4c63-acff-b8b8c691ff18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1faa842c0274575a2c4f1802ed17ccf)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:09.673336 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bc9f6-33d8-4c63-acff-b8b8c691ff18 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:09.703244 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a65d1f-a7aa-4682-b9b9-bced3a63591b service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:09.705028 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c9a65d1f-a7aa-4682-b9b9-bced3a63591b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:09.722783 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a65d1f-a7aa-4682-b9b9-bced3a63591b service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:09.729680 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8823aac-86d3-4df6-9904-4aec302c94af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:09.730648 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8823aac-86d3-4df6-9904-4aec302c94af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:09.730890 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8823aac-86d3-4df6-9904-4aec302c94af admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:09.731150 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8823aac-86d3-4df6-9904-4aec302c94af admin admin] PATH_INFO: `/v3/users/e947eee956834b9d8502dcfaa7e87eb4` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:09.732993 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8823aac-86d3-4df6-9904-4aec302c94af admin admin] RBAC: Authorizing `identity:delete_user(user_id=e947eee956834b9d8502dcfaa7e87eb4)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:09.735204 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8823aac-86d3-4df6-9904-4aec302c94af admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:09.748182 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a15bc9f6-33d8-4c63-acff-b8b8c691ff18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1faa842c0274575a2c4f1802ed17ccf'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:09.753180 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a15bc9f6-33d8-4c63-acff-b8b8c691ff18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1faa842c0274575a2c4f1802ed17ccf'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:09.769624 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a15bc9f6-33d8-4c63-acff-b8b8c691ff18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1faa842c0274575a2c4f1802ed17ccf'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:09.779838 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a15bc9f6-33d8-4c63-acff-b8b8c691ff18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1faa842c0274575a2c4f1802ed17ccf'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:09.814312 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a15bc9f6-33d8-4c63-acff-b8b8c691ff18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1faa842c0274575a2c4f1802ed17ccf'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:09.816950 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-e8823aac-86d3-4df6-9904-4aec302c94af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e947eee956834b9d8502dcfaa7e87eb4'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:09.820683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-e8823aac-86d3-4df6-9904-4aec302c94af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e947eee956834b9d8502dcfaa7e87eb4'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:09.821428 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-e8823aac-86d3-4df6-9904-4aec302c94af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e947eee956834b9d8502dcfaa7e87eb4'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:09.832198 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1029/2059] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:58:09 2022] DELETE /identity/v3/users/e1faa842c0274575a2c4f1802ed17ccf => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:09.834217 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a739c-d450-4ba1-ad4c-8b710d08fc2f None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:09.834502 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a739c-d450-4ba1-ad4c-8b710d08fc2f None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:09.834778 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a739c-d450-4ba1-ad4c-8b710d08fc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:09.842221 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-e8823aac-86d3-4df6-9904-4aec302c94af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e947eee956834b9d8502dcfaa7e87eb4'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:09.859516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-e8823aac-86d3-4df6-9904-4aec302c94af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e947eee956834b9d8502dcfaa7e87eb4'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:09.870534 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-124a739c-d450-4ba1-ad4c-8b710d08fc2f None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:09.872100 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-124a739c-d450-4ba1-ad4c-8b710d08fc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:09.890218 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1031/2060] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:58:09 2022] DELETE /identity/v3/users/e947eee956834b9d8502dcfaa7e87eb4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:58:09.960141 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1030/2061] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:09 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:09.978519 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8823aac-86d3-4df6-9904-4aec302c94af admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:09.980735 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-e8823aac-86d3-4df6-9904-4aec302c94af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:10.071491 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8823aac-86d3-4df6-9904-4aec302c94af admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:10.078420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea91c0-6f2b-4ed3-a523-353915a5ddcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:10.079745 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea91c0-6f2b-4ed3-a523-353915a5ddcd service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:10.080567 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea91c0-6f2b-4ed3-a523-353915a5ddcd service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:10.081408 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea91c0-6f2b-4ed3-a523-353915a5ddcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:10.142779 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a739c-d450-4ba1-ad4c-8b710d08fc2f None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:10.144688 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-124a739c-d450-4ba1-ad4c-8b710d08fc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:10.160091 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a739c-d450-4ba1-ad4c-8b710d08fc2f None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:10.175271 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc231b66-2166-415e-b2bd-e8761380e5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:10.176598 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc231b66-2166-415e-b2bd-e8761380e5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:10.176992 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc231b66-2166-415e-b2bd-e8761380e5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:10.177793 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc231b66-2166-415e-b2bd-e8761380e5d6 admin admin] PATH_INFO: `/v3/projects/914f7f61b2e64e76904b9c71a44f55d6` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:10.178901 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea91c0-6f2b-4ed3-a523-353915a5ddcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:10.179255 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc231b66-2166-415e-b2bd-e8761380e5d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=914f7f61b2e64e76904b9c71a44f55d6)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:10.180760 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea91c0-6f2b-4ed3-a523-353915a5ddcd service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:10.183278 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc231b66-2166-415e-b2bd-e8761380e5d6 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:10.194143 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1032/2062] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:09 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:10.278316 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fc231b66-2166-415e-b2bd-e8761380e5d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914f7f61b2e64e76904b9c71a44f55d6', 'request_id': 'req-fc231b66-2166-415e-b2bd-e8761380e5d6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:10.288254 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fc231b66-2166-415e-b2bd-e8761380e5d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914f7f61b2e64e76904b9c71a44f55d6', 'request_id': 'req-fc231b66-2166-415e-b2bd-e8761380e5d6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:10.299172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fc231b66-2166-415e-b2bd-e8761380e5d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914f7f61b2e64e76904b9c71a44f55d6', 'request_id': 'req-fc231b66-2166-415e-b2bd-e8761380e5d6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:10.324469 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fc231b66-2166-415e-b2bd-e8761380e5d6 admin admin] The token cache is being invalidate because project 914f7f61b2e64e76904b9c71a44f55d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:58:10.324905 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fc231b66-2166-415e-b2bd-e8761380e5d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:10.325650 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fc231b66-2166-415e-b2bd-e8761380e5d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:10.328065 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1031/2063] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:58:10 2022] DELETE /identity/v3/projects/914f7f61b2e64e76904b9c71a44f55d6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:10.332148 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea91c0-6f2b-4ed3-a523-353915a5ddcd service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:10.350028 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea91c0-6f2b-4ed3-a523-353915a5ddcd service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:10.469301 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08f877-5f49-4704-acb1-33e831376edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:10.469301 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08f877-5f49-4704-acb1-33e831376edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:10.469301 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08f877-5f49-4704-acb1-33e831376edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:10.469301 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08f877-5f49-4704-acb1-33e831376edc admin admin] PATH_INFO: `/v3/users/44d4723c5aef49a8a28cc7af33f1640c` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:10.471550 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08f877-5f49-4704-acb1-33e831376edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d4723c5aef49a8a28cc7af33f1640c)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:10.474876 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08f877-5f49-4704-acb1-33e831376edc admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:10.566604 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-bd08f877-5f49-4704-acb1-33e831376edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d4723c5aef49a8a28cc7af33f1640c'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:10.567338 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-bd08f877-5f49-4704-acb1-33e831376edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d4723c5aef49a8a28cc7af33f1640c'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:10.568021 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-bd08f877-5f49-4704-acb1-33e831376edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d4723c5aef49a8a28cc7af33f1640c'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:10.584605 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc231b66-2166-415e-b2bd-e8761380e5d6 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:10.586480 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-fc231b66-2166-415e-b2bd-e8761380e5d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:10.591571 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-bd08f877-5f49-4704-acb1-33e831376edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d4723c5aef49a8a28cc7af33f1640c'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:10.602898 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-bd08f877-5f49-4704-acb1-33e831376edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d4723c5aef49a8a28cc7af33f1640c'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:10.622484 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1033/2064] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:58:10 2022] DELETE /identity/v3/users/44d4723c5aef49a8a28cc7af33f1640c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:10.628528 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc231b66-2166-415e-b2bd-e8761380e5d6 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:10.732763 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5fbd2-3889-40b7-98ed-eee918d870c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:10.737530 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5fbd2-3889-40b7-98ed-eee918d870c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:10.738216 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5fbd2-3889-40b7-98ed-eee918d870c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:10.738509 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5fbd2-3889-40b7-98ed-eee918d870c8 admin admin] PATH_INFO: `/v3/projects/fbe16b6f9b0e4c55abcf07a9bfab1b7d` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:10.741165 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5fbd2-3889-40b7-98ed-eee918d870c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe16b6f9b0e4c55abcf07a9bfab1b7d)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:10.743075 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5fbd2-3889-40b7-98ed-eee918d870c8 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:10.810964 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-96a5fbd2-3889-40b7-98ed-eee918d870c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe16b6f9b0e4c55abcf07a9bfab1b7d', 'request_id': 'req-96a5fbd2-3889-40b7-98ed-eee918d870c8'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:10.818735 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-96a5fbd2-3889-40b7-98ed-eee918d870c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe16b6f9b0e4c55abcf07a9bfab1b7d', 'request_id': 'req-96a5fbd2-3889-40b7-98ed-eee918d870c8'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:10.824250 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-96a5fbd2-3889-40b7-98ed-eee918d870c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe16b6f9b0e4c55abcf07a9bfab1b7d', 'request_id': 'req-96a5fbd2-3889-40b7-98ed-eee918d870c8'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:10.837894 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-96a5fbd2-3889-40b7-98ed-eee918d870c8 admin admin] The token cache is being invalidate because project fbe16b6f9b0e4c55abcf07a9bfab1b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:58:10.838269 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-96a5fbd2-3889-40b7-98ed-eee918d870c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:10.838947 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-96a5fbd2-3889-40b7-98ed-eee918d870c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:10.840648 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1032/2065] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:58:10 2022] DELETE /identity/v3/projects/fbe16b6f9b0e4c55abcf07a9bfab1b7d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:10.845445 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08f877-5f49-4704-acb1-33e831376edc admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:10.846901 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-bd08f877-5f49-4704-acb1-33e831376edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:10.863882 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08f877-5f49-4704-acb1-33e831376edc admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:10.927712 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff2dbc-7bfc-4eca-ad89-308127e01fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:10.928594 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff2dbc-7bfc-4eca-ad89-308127e01fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:10.928910 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff2dbc-7bfc-4eca-ad89-308127e01fed admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:10.929328 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff2dbc-7bfc-4eca-ad89-308127e01fed admin admin] PATH_INFO: `/v3/users/a7b71297e062493ea8c06225ca4b8cba` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:10.930739 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff2dbc-7bfc-4eca-ad89-308127e01fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7b71297e062493ea8c06225ca4b8cba)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:10.932812 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff2dbc-7bfc-4eca-ad89-308127e01fed admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:10.972368 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5fbd2-3889-40b7-98ed-eee918d870c8 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:10.974443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-96a5fbd2-3889-40b7-98ed-eee918d870c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:10.987541 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5fbd2-3889-40b7-98ed-eee918d870c8 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:10.995794 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-08ff2dbc-7bfc-4eca-ad89-308127e01fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7b71297e062493ea8c06225ca4b8cba'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:10.996694 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-08ff2dbc-7bfc-4eca-ad89-308127e01fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7b71297e062493ea8c06225ca4b8cba'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:10.997476 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-08ff2dbc-7bfc-4eca-ad89-308127e01fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7b71297e062493ea8c06225ca4b8cba'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:10.998499 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135841d-2553-4b39-b8ec-1675f3c8b069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:10.999393 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135841d-2553-4b39-b8ec-1675f3c8b069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:10.999678 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135841d-2553-4b39-b8ec-1675f3c8b069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:11.000185 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135841d-2553-4b39-b8ec-1675f3c8b069 admin admin] PATH_INFO: `/v3/projects/7bfbe773e86b4e3ea2f102f39cd297ff` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:11.001439 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135841d-2553-4b39-b8ec-1675f3c8b069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bfbe773e86b4e3ea2f102f39cd297ff)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:11.003319 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135841d-2553-4b39-b8ec-1675f3c8b069 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:11.015402 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-08ff2dbc-7bfc-4eca-ad89-308127e01fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7b71297e062493ea8c06225ca4b8cba'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:11.023251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-08ff2dbc-7bfc-4eca-ad89-308127e01fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7b71297e062493ea8c06225ca4b8cba'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:11.043126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1034/2066] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:58:10 2022] DELETE /identity/v3/users/a7b71297e062493ea8c06225ca4b8cba => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:11.059311 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e135841d-2553-4b39-b8ec-1675f3c8b069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bfbe773e86b4e3ea2f102f39cd297ff', 'request_id': 'req-e135841d-2553-4b39-b8ec-1675f3c8b069'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:11.066443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e135841d-2553-4b39-b8ec-1675f3c8b069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bfbe773e86b4e3ea2f102f39cd297ff', 'request_id': 'req-e135841d-2553-4b39-b8ec-1675f3c8b069'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:11.072321 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e135841d-2553-4b39-b8ec-1675f3c8b069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bfbe773e86b4e3ea2f102f39cd297ff', 'request_id': 'req-e135841d-2553-4b39-b8ec-1675f3c8b069'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:11.089273 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e135841d-2553-4b39-b8ec-1675f3c8b069 admin admin] The token cache is being invalidate because project 7bfbe773e86b4e3ea2f102f39cd297ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:58:11.089694 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e135841d-2553-4b39-b8ec-1675f3c8b069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:11.090620 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e135841d-2553-4b39-b8ec-1675f3c8b069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:11.096837 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1033/2067] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:58:10 2022] DELETE /identity/v3/projects/7bfbe773e86b4e3ea2f102f39cd297ff => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:11.099092 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e258-d4f1-4f1d-807e-45e988da0ce4 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:11.099905 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e258-d4f1-4f1d-807e-45e988da0ce4 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:11.100022 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e258-d4f1-4f1d-807e-45e988da0ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:11.120711 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-30d1e258-d4f1-4f1d-807e-45e988da0ce4 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:11.122560 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-30d1e258-d4f1-4f1d-807e-45e988da0ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:11.195568 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1035/2068] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:11 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:11.205267 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45bc28-14b1-4cbd-8024-d81a8af0638d None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:11.205982 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45bc28-14b1-4cbd-8024-d81a8af0638d None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:11.206497 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45bc28-14b1-4cbd-8024-d81a8af0638d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:11.229745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-1d45bc28-14b1-4cbd-8024-d81a8af0638d None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:11.230993 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1d45bc28-14b1-4cbd-8024-d81a8af0638d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:11.242839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1034/2069] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:11 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:11.246828 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1e258-d4f1-4f1d-807e-45e988da0ce4 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:11.264678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1e258-d4f1-4f1d-807e-45e988da0ce4 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:11.270997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d111b-5298-4a0a-be33-4f815efd5375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:11.272050 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d111b-5298-4a0a-be33-4f815efd5375 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:11.272561 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d111b-5298-4a0a-be33-4f815efd5375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:11.275177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d111b-5298-4a0a-be33-4f815efd5375 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:11.277705 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d111b-5298-4a0a-be33-4f815efd5375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:58:11.278452 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d111b-5298-4a0a-be33-4f815efd5375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:11.281781 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d111b-5298-4a0a-be33-4f815efd5375 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:11.299069 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1036/2070] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:58:11.300313 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45bc28-14b1-4cbd-8024-d81a8af0638d None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:11.312537 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45bc28-14b1-4cbd-8024-d81a8af0638d None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:11.318793 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b7815-e3a9-409a-af87-8dbb83746eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:11.319900 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b7815-e3a9-409a-af87-8dbb83746eed admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:11.320349 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b7815-e3a9-409a-af87-8dbb83746eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:11.320632 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b7815-e3a9-409a-af87-8dbb83746eed admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:11.321409 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b7815-e3a9-409a-af87-8dbb83746eed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:11.323312 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b7815-e3a9-409a-af87-8dbb83746eed admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:11.361586 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1035/2071] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:58:11 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:58:11.365917 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d111b-5298-4a0a-be33-4f815efd5375 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:11.376784 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b7815-e3a9-409a-af87-8dbb83746eed admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:11.380991 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c68b7815-e3a9-409a-af87-8dbb83746eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:11.383160 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d111b-5298-4a0a-be33-4f815efd5375 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:11.461587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9b852-2c7e-4b11-9a60-a29b38864be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:11.462317 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9b852-2c7e-4b11-9a60-a29b38864be6 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:11.462587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9b852-2c7e-4b11-9a60-a29b38864be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:11.462965 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9b852-2c7e-4b11-9a60-a29b38864be6 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:11.463087 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b7815-e3a9-409a-af87-8dbb83746eed admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:11.463686 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9b852-2c7e-4b11-9a60-a29b38864be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:11.467967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9b852-2c7e-4b11-9a60-a29b38864be6 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:11.471654 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c81c2c-76b1-48f0-b15d-27c6cc4360a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:11.472610 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c81c2c-76b1-48f0-b15d-27c6cc4360a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:11.473066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c81c2c-76b1-48f0-b15d-27c6cc4360a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:11.473411 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c81c2c-76b1-48f0-b15d-27c6cc4360a8 admin admin] PATH_INFO: `/v3/projects/3efa7fb071134ab6a466eca3f5199ad2` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:11.474929 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c81c2c-76b1-48f0-b15d-27c6cc4360a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3efa7fb071134ab6a466eca3f5199ad2)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:11.477002 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c81c2c-76b1-48f0-b15d-27c6cc4360a8 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:11.496379 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1037/2072] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:58:11 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:11.500686 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9b852-2c7e-4b11-9a60-a29b38864be6 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:11.511189 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9b852-2c7e-4b11-9a60-a29b38864be6 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:11.517340 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04af5c7-7a60-4d1a-a55d-6588277d8a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:11.517928 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04af5c7-7a60-4d1a-a55d-6588277d8a48 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:11.518140 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04af5c7-7a60-4d1a-a55d-6588277d8a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:11.518417 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04af5c7-7a60-4d1a-a55d-6588277d8a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:11.519327 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04af5c7-7a60-4d1a-a55d-6588277d8a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:11.520990 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04af5c7-7a60-4d1a-a55d-6588277d8a48 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:11.535652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-93c81c2c-76b1-48f0-b15d-27c6cc4360a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3efa7fb071134ab6a466eca3f5199ad2', 'request_id': 'req-93c81c2c-76b1-48f0-b15d-27c6cc4360a8'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:11.541751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1038/2073] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:11.542868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04af5c7-7a60-4d1a-a55d-6588277d8a48 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:11.544212 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-93c81c2c-76b1-48f0-b15d-27c6cc4360a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3efa7fb071134ab6a466eca3f5199ad2', 'request_id': 'req-93c81c2c-76b1-48f0-b15d-27c6cc4360a8'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:11.550651 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-93c81c2c-76b1-48f0-b15d-27c6cc4360a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3efa7fb071134ab6a466eca3f5199ad2', 'request_id': 'req-93c81c2c-76b1-48f0-b15d-27c6cc4360a8'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:11.555879 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04af5c7-7a60-4d1a-a55d-6588277d8a48 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:11.565952 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-93c81c2c-76b1-48f0-b15d-27c6cc4360a8 admin admin] The token cache is being invalidate because project 3efa7fb071134ab6a466eca3f5199ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:58:11.566304 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-93c81c2c-76b1-48f0-b15d-27c6cc4360a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:11.567134 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-93c81c2c-76b1-48f0-b15d-27c6cc4360a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:11.569142 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1036/2074] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:58:11 2022] DELETE /identity/v3/projects/3efa7fb071134ab6a466eca3f5199ad2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:58:11.576234 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa4962-e4ba-4d21-a712-726280c5840e None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:11.576539 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa4962-e4ba-4d21-a712-726280c5840e None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:11.577117 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa4962-e4ba-4d21-a712-726280c5840e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:11.622746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec541e-2dfe-4651-8397-296f6740bbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:11.624096 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec541e-2dfe-4651-8397-296f6740bbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:11.624539 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec541e-2dfe-4651-8397-296f6740bbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:11.624853 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec541e-2dfe-4651-8397-296f6740bbe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:11.625593 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec541e-2dfe-4651-8397-296f6740bbe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:11.627225 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec541e-2dfe-4651-8397-296f6740bbe5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:11.638808 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1039/2075] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:58:11.643427 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec541e-2dfe-4651-8397-296f6740bbe5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:11.645212 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-31ec541e-2dfe-4651-8397-296f6740bbe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:11.673221 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec541e-2dfe-4651-8397-296f6740bbe5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:11.679591 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf9e62-28d8-42a0-8f2d-b714a9b7355e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:11.682457 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf9e62-28d8-42a0-8f2d-b714a9b7355e admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:11.682457 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf9e62-28d8-42a0-8f2d-b714a9b7355e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:11.682457 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf9e62-28d8-42a0-8f2d-b714a9b7355e admin admin] PATH_INFO: `/v3/projects/3d6722e7a2754e339d0f4a9067af2285/users/4d8795ad57c5476db5f275d7581b7ab7/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:11.698926 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf9e62-28d8-42a0-8f2d-b714a9b7355e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d6722e7a2754e339d0f4a9067af2285, user_id=4d8795ad57c5476db5f275d7581b7ab7, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:11.704841 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf9e62-28d8-42a0-8f2d-b714a9b7355e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:11.718202 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1040/2076] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:11 2022] PUT /identity/v3/projects/3d6722e7a2754e339d0f4a9067af2285/users/4d8795ad57c5476db5f275d7581b7ab7/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:11.718407 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-7efa4962-e4ba-4d21-a712-726280c5840e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:11.719572 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-7efa4962-e4ba-4d21-a712-726280c5840e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:11.729144 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce89d53-9545-48e1-9f92-348e36fb8080 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:11.729321 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce89d53-9545-48e1-9f92-348e36fb8080 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:11.729603 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce89d53-9545-48e1-9f92-348e36fb8080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:11.768574 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-5ce89d53-9545-48e1-9f92-348e36fb8080 None None] MFA Rules not processed for user `4d8795ad57c5476db5f275d7581b7ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:11.769837 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-5ce89d53-9545-48e1-9f92-348e36fb8080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:11.788819 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1037/2077] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:11 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:58:11.798590 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6da1db-ba56-40ee-954f-0b013d8e7ec7 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:11.798895 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6da1db-ba56-40ee-954f-0b013d8e7ec7 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:11.799139 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6da1db-ba56-40ee-954f-0b013d8e7ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:11.825610 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-6a6da1db-ba56-40ee-954f-0b013d8e7ec7 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:11.827386 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-6a6da1db-ba56-40ee-954f-0b013d8e7ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:11.841390 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1038/2078] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:11 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:11.842584 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6da1db-ba56-40ee-954f-0b013d8e7ec7 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:11.851442 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6da1db-ba56-40ee-954f-0b013d8e7ec7 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:11.855976 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e170a0-c215-4f08-815d-ff42bb3c98a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:11.856625 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e170a0-c215-4f08-815d-ff42bb3c98a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:11.856928 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e170a0-c215-4f08-815d-ff42bb3c98a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:11.857480 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e170a0-c215-4f08-815d-ff42bb3c98a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:11.858034 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e170a0-c215-4f08-815d-ff42bb3c98a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:58:11.858337 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e170a0-c215-4f08-815d-ff42bb3c98a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:11.859932 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e170a0-c215-4f08-815d-ff42bb3c98a4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:11.870144 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1041/2079] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:11 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:11.874901 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1039/2080] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:58:11.875043 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce89d53-9545-48e1-9f92-348e36fb8080 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:11.875450 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-5ce89d53-9545-48e1-9f92-348e36fb8080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:11.877735 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e170a0-c215-4f08-815d-ff42bb3c98a4 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:11.887802 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e170a0-c215-4f08-815d-ff42bb3c98a4 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:11.889828 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce89d53-9545-48e1-9f92-348e36fb8080 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:11.893611 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2470965-4dc0-4982-b5f2-4d08f0e903bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:11.894278 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2470965-4dc0-4982-b5f2-4d08f0e903bf admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:11.894451 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf57d99-de25-439c-ad93-00fda4941c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:11.894573 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2470965-4dc0-4982-b5f2-4d08f0e903bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:11.894793 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2470965-4dc0-4982-b5f2-4d08f0e903bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:11.895424 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf57d99-de25-439c-ad93-00fda4941c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:11.895531 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2470965-4dc0-4982-b5f2-4d08f0e903bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:11.895701 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf57d99-de25-439c-ad93-00fda4941c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:11.895966 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf57d99-de25-439c-ad93-00fda4941c3e admin admin] PATH_INFO: `/v3/users/22bf708b55b5424ea7111f825f7e2149` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:11.897169 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf57d99-de25-439c-ad93-00fda4941c3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=22bf708b55b5424ea7111f825f7e2149)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:11.897355 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2470965-4dc0-4982-b5f2-4d08f0e903bf admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:11.899614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf57d99-de25-439c-ad93-00fda4941c3e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:11.930709 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1040/2081] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:58:11 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:11.935294 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2470965-4dc0-4982-b5f2-4d08f0e903bf admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:11.937257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c2470965-4dc0-4982-b5f2-4d08f0e903bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:11.956126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4cf57d99-de25-439c-ad93-00fda4941c3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22bf708b55b5424ea7111f825f7e2149'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:11.959712 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4cf57d99-de25-439c-ad93-00fda4941c3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22bf708b55b5424ea7111f825f7e2149'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:11.960398 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4cf57d99-de25-439c-ad93-00fda4941c3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22bf708b55b5424ea7111f825f7e2149'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:11.970859 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4cf57d99-de25-439c-ad93-00fda4941c3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22bf708b55b5424ea7111f825f7e2149'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:11.978526 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4cf57d99-de25-439c-ad93-00fda4941c3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22bf708b55b5424ea7111f825f7e2149'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:12.002311 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1042/2082] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:58:11 2022] DELETE /identity/v3/users/22bf708b55b5424ea7111f825f7e2149 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:12.002946 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf57d99-de25-439c-ad93-00fda4941c3e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:12.004300 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-4cf57d99-de25-439c-ad93-00fda4941c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:12.011103 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2470965-4dc0-4982-b5f2-4d08f0e903bf admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:12.060854 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ca6dd-e147-4ccf-b34d-9ae50dd9ee24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:12.061605 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ca6dd-e147-4ccf-b34d-9ae50dd9ee24 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:12.061890 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ca6dd-e147-4ccf-b34d-9ae50dd9ee24 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:12.062193 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ca6dd-e147-4ccf-b34d-9ae50dd9ee24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:12.064022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-456ca6dd-e147-4ccf-b34d-9ae50dd9ee24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:12.071893 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf57d99-de25-439c-ad93-00fda4941c3e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:12.077172 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2274a-8407-4b46-9388-7c66c7f1d436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:12.077829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2274a-8407-4b46-9388-7c66c7f1d436 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:12.078102 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2274a-8407-4b46-9388-7c66c7f1d436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:12.078368 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2274a-8407-4b46-9388-7c66c7f1d436 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:12.079038 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2274a-8407-4b46-9388-7c66c7f1d436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:12.082243 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2274a-8407-4b46-9388-7c66c7f1d436 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:12.103600 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1043/2083] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:58:12 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:12.105249 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e48f4-8d18-4506-97dd-f35519c7bc86 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:12.105533 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e48f4-8d18-4506-97dd-f35519c7bc86 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:12.105804 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e48f4-8d18-4506-97dd-f35519c7bc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:12.124170 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-3b6e48f4-8d18-4506-97dd-f35519c7bc86 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:12.125390 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-3b6e48f4-8d18-4506-97dd-f35519c7bc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:12.132844 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1044/2084] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:12.133523 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e48f4-8d18-4506-97dd-f35519c7bc86 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:12.133654 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ca6dd-e147-4ccf-b34d-9ae50dd9ee24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:12.134977 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ca6dd-e147-4ccf-b34d-9ae50dd9ee24 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:12.143133 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e48f4-8d18-4506-97dd-f35519c7bc86 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:12.148118 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1041/2085] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:11 2022] GET /identity/v3/auth/tokens => generated 3391 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:12.148290 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180eec0-6755-409a-8863-7f361ee2f305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:12.148831 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180eec0-6755-409a-8863-7f361ee2f305 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:12.149011 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ca6dd-e147-4ccf-b34d-9ae50dd9ee24 service cinder] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:12.149109 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180eec0-6755-409a-8863-7f361ee2f305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:12.149368 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180eec0-6755-409a-8863-7f361ee2f305 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:12.150088 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180eec0-6755-409a-8863-7f361ee2f305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:12.150567 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-456ca6dd-e147-4ccf-b34d-9ae50dd9ee24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:12.151958 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180eec0-6755-409a-8863-7f361ee2f305 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:12.164095 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1045/2086] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:12.168066 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180eec0-6755-409a-8863-7f361ee2f305 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:12.178669 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180eec0-6755-409a-8863-7f361ee2f305 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:12.183772 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbbdec-9d54-4156-87a8-11171a92232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:12.184431 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbbdec-9d54-4156-87a8-11171a92232b admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:12.184713 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbbdec-9d54-4156-87a8-11171a92232b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:12.185019 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbbdec-9d54-4156-87a8-11171a92232b admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:12.186267 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbbdec-9d54-4156-87a8-11171a92232b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:12.187861 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbbdec-9d54-4156-87a8-11171a92232b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:12.203781 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1046/2087] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:58:12.204695 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbbdec-9d54-4156-87a8-11171a92232b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:12.211618 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ca6dd-e147-4ccf-b34d-9ae50dd9ee24 service cinder] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:12.214681 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbbdec-9d54-4156-87a8-11171a92232b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:12.216310 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c8ed1-b7be-4454-bf1b-d0913b4057f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:12.216590 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c8ed1-b7be-4454-bf1b-d0913b4057f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:12.216824 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c8ed1-b7be-4454-bf1b-d0913b4057f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:12.217142 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c8ed1-b7be-4454-bf1b-d0913b4057f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:12.219734 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e95157-2167-40ff-b627-b5beda767edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:12.220612 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e95157-2167-40ff-b627-b5beda767edd admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:12.220937 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e95157-2167-40ff-b627-b5beda767edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:12.221355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e95157-2167-40ff-b627-b5beda767edd admin admin] PATH_INFO: `/v3/projects/905fbb6b5d0248fe8c7209eff78272b4/users/2519bec1ff2641789a40bd3669e71c78/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:12.227543 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c8ed1-b7be-4454-bf1b-d0913b4057f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:12.229012 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c8ed1-b7be-4454-bf1b-d0913b4057f5 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:12.236726 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e95157-2167-40ff-b627-b5beda767edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=905fbb6b5d0248fe8c7209eff78272b4, user_id=2519bec1ff2641789a40bd3669e71c78, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:12.239582 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e95157-2167-40ff-b627-b5beda767edd admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:12.239737 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1042/2088] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:12 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:12.254753 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1047/2089] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:12 2022] PUT /identity/v3/projects/905fbb6b5d0248fe8c7209eff78272b4/users/2519bec1ff2641789a40bd3669e71c78/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:12.267555 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9a968-f53d-419b-96dc-69777bbca07b None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:12.267837 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9a968-f53d-419b-96dc-69777bbca07b None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:12.268114 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9a968-f53d-419b-96dc-69777bbca07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:12.302331 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-39a9a968-f53d-419b-96dc-69777bbca07b None None] MFA Rules not processed for user `2519bec1ff2641789a40bd3669e71c78`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:12.303650 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-39a9a968-f53d-419b-96dc-69777bbca07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:12.415815 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1043/2090] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:12 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:12.427498 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e95157-2167-40ff-b627-b5beda767edd admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:12.429237 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-64e95157-2167-40ff-b627-b5beda767edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:12.519839 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e95157-2167-40ff-b627-b5beda767edd admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:12.525649 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b77ec9-1f67-4be1-98ab-0e9ae8dc8ce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:12.526716 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b77ec9-1f67-4be1-98ab-0e9ae8dc8ce7 service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:12.527063 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b77ec9-1f67-4be1-98ab-0e9ae8dc8ce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:12.527417 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b77ec9-1f67-4be1-98ab-0e9ae8dc8ce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:12.550621 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b77ec9-1f67-4be1-98ab-0e9ae8dc8ce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:12.552961 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b77ec9-1f67-4be1-98ab-0e9ae8dc8ce7 service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:12.565836 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1048/2091] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:12 2022] GET /identity/v3/auth/tokens => generated 3397 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:12.618251 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9a968-f53d-419b-96dc-69777bbca07b None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:12.619783 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-39a9a968-f53d-419b-96dc-69777bbca07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:12.703836 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9a968-f53d-419b-96dc-69777bbca07b None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:12.709062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809a37e-8ce7-4cf9-b2af-37bf49d43753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:12.709990 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809a37e-8ce7-4cf9-b2af-37bf49d43753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:12.710361 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809a37e-8ce7-4cf9-b2af-37bf49d43753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:12.711030 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809a37e-8ce7-4cf9-b2af-37bf49d43753 admin admin] PATH_INFO: `/v3/projects/662bb990f6a64f92a935d094ff0d831c` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:12.711934 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809a37e-8ce7-4cf9-b2af-37bf49d43753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=662bb990f6a64f92a935d094ff0d831c)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:12.713972 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809a37e-8ce7-4cf9-b2af-37bf49d43753 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:12.766568 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-2809a37e-8ce7-4cf9-b2af-37bf49d43753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662bb990f6a64f92a935d094ff0d831c', 'request_id': 'req-2809a37e-8ce7-4cf9-b2af-37bf49d43753'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:12.773025 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-2809a37e-8ce7-4cf9-b2af-37bf49d43753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662bb990f6a64f92a935d094ff0d831c', 'request_id': 'req-2809a37e-8ce7-4cf9-b2af-37bf49d43753'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:12.778894 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-2809a37e-8ce7-4cf9-b2af-37bf49d43753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662bb990f6a64f92a935d094ff0d831c', 'request_id': 'req-2809a37e-8ce7-4cf9-b2af-37bf49d43753'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:12.790032 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-2809a37e-8ce7-4cf9-b2af-37bf49d43753 admin admin] The token cache is being invalidate because project 662bb990f6a64f92a935d094ff0d831c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:58:12.790314 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-2809a37e-8ce7-4cf9-b2af-37bf49d43753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:12.790942 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-2809a37e-8ce7-4cf9-b2af-37bf49d43753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:12.792468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1044/2092] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:58:12 2022] DELETE /identity/v3/projects/662bb990f6a64f92a935d094ff0d831c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:12.797357 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b77ec9-1f67-4be1-98ab-0e9ae8dc8ce7 service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:12.808336 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b77ec9-1f67-4be1-98ab-0e9ae8dc8ce7 service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:12.895808 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e82f0b-f6a7-438b-ad39-401857aeacef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:12.896684 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e82f0b-f6a7-438b-ad39-401857aeacef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:12.896992 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e82f0b-f6a7-438b-ad39-401857aeacef admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:12.897269 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e82f0b-f6a7-438b-ad39-401857aeacef admin admin] PATH_INFO: `/v3/users/accbe24cfd7e457fb44d7fc39a338f26` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:12.898462 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e82f0b-f6a7-438b-ad39-401857aeacef admin admin] RBAC: Authorizing `identity:delete_user(user_id=accbe24cfd7e457fb44d7fc39a338f26)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:12.900367 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e82f0b-f6a7-438b-ad39-401857aeacef admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:12.973331 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-47e82f0b-f6a7-438b-ad39-401857aeacef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'accbe24cfd7e457fb44d7fc39a338f26'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:12.974010 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-47e82f0b-f6a7-438b-ad39-401857aeacef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'accbe24cfd7e457fb44d7fc39a338f26'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:12.974800 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-47e82f0b-f6a7-438b-ad39-401857aeacef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'accbe24cfd7e457fb44d7fc39a338f26'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:12.987038 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-47e82f0b-f6a7-438b-ad39-401857aeacef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'accbe24cfd7e457fb44d7fc39a338f26'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:12.997353 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-47e82f0b-f6a7-438b-ad39-401857aeacef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'accbe24cfd7e457fb44d7fc39a338f26'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:13.019843 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1049/2093] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:58:12 2022] DELETE /identity/v3/users/accbe24cfd7e457fb44d7fc39a338f26 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:13.287385 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809a37e-8ce7-4cf9-b2af-37bf49d43753 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:13.289211 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2809a37e-8ce7-4cf9-b2af-37bf49d43753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:13.304946 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809a37e-8ce7-4cf9-b2af-37bf49d43753 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:13.365279 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7caded-91f7-42b8-9e3c-8a70d5b373ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:13.366164 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7caded-91f7-42b8-9e3c-8a70d5b373ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:13.366443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7caded-91f7-42b8-9e3c-8a70d5b373ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:13.366740 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7caded-91f7-42b8-9e3c-8a70d5b373ec admin admin] PATH_INFO: `/v3/projects/de3dc66ee9be42639d6650fefaf31c35` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:13.367967 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7caded-91f7-42b8-9e3c-8a70d5b373ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=de3dc66ee9be42639d6650fefaf31c35)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:13.369897 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7caded-91f7-42b8-9e3c-8a70d5b373ec admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:13.419542 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6d7caded-91f7-42b8-9e3c-8a70d5b373ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de3dc66ee9be42639d6650fefaf31c35', 'request_id': 'req-6d7caded-91f7-42b8-9e3c-8a70d5b373ec'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:13.426311 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6d7caded-91f7-42b8-9e3c-8a70d5b373ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de3dc66ee9be42639d6650fefaf31c35', 'request_id': 'req-6d7caded-91f7-42b8-9e3c-8a70d5b373ec'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:13.431990 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6d7caded-91f7-42b8-9e3c-8a70d5b373ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de3dc66ee9be42639d6650fefaf31c35', 'request_id': 'req-6d7caded-91f7-42b8-9e3c-8a70d5b373ec'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:13.446821 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6d7caded-91f7-42b8-9e3c-8a70d5b373ec admin admin] The token cache is being invalidate because project de3dc66ee9be42639d6650fefaf31c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:58:13.447192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6d7caded-91f7-42b8-9e3c-8a70d5b373ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:13.448108 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6d7caded-91f7-42b8-9e3c-8a70d5b373ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:13.453682 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1045/2094] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:58:13 2022] DELETE /identity/v3/projects/de3dc66ee9be42639d6650fefaf31c35 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:13.460182 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98271d-7fbe-4c76-973f-4ea7875674e6 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:13.460542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98271d-7fbe-4c76-973f-4ea7875674e6 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:13.460859 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98271d-7fbe-4c76-973f-4ea7875674e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:13.479595 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-0f98271d-7fbe-4c76-973f-4ea7875674e6 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:13.480827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-0f98271d-7fbe-4c76-973f-4ea7875674e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:13.550836 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1050/2095] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:13 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:13.553315 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf7e7c-4796-4083-a0a8-da293dce2218 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:13.553984 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf7e7c-4796-4083-a0a8-da293dce2218 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:13.554532 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf7e7c-4796-4083-a0a8-da293dce2218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:13.579464 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-46cf7e7c-4796-4083-a0a8-da293dce2218 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:13.580981 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-46cf7e7c-4796-4083-a0a8-da293dce2218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:13.590052 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1046/2096] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:13 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:58:13.595355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98271d-7fbe-4c76-973f-4ea7875674e6 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:13.605139 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98271d-7fbe-4c76-973f-4ea7875674e6 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:13.611922 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fdcb9-696c-4110-bfbc-e51378fb2abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:13.612663 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fdcb9-696c-4110-bfbc-e51378fb2abe admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:13.613050 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fdcb9-696c-4110-bfbc-e51378fb2abe admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:13.613387 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fdcb9-696c-4110-bfbc-e51378fb2abe admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:13.614648 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fdcb9-696c-4110-bfbc-e51378fb2abe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:58:13.615317 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fdcb9-696c-4110-bfbc-e51378fb2abe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:13.617614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fdcb9-696c-4110-bfbc-e51378fb2abe admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:13.637179 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1051/2097] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:58:13.640143 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf7e7c-4796-4083-a0a8-da293dce2218 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:13.651418 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf7e7c-4796-4083-a0a8-da293dce2218 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:13.658090 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a14ff-23d3-4694-98ba-75405b8974a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:13.659038 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a14ff-23d3-4694-98ba-75405b8974a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:13.659291 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a14ff-23d3-4694-98ba-75405b8974a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:13.659615 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a14ff-23d3-4694-98ba-75405b8974a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:13.660296 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a14ff-23d3-4694-98ba-75405b8974a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:13.662546 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a14ff-23d3-4694-98ba-75405b8974a5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:13.707750 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fdcb9-696c-4110-bfbc-e51378fb2abe admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:13.708915 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1047/2098] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:58:13 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:13.739930 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fdcb9-696c-4110-bfbc-e51378fb2abe admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:13.842127 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a3721-3eb0-4887-8ef7-252e34cf81dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:13.842812 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a3721-3eb0-4887-8ef7-252e34cf81dc admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:13.843092 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a3721-3eb0-4887-8ef7-252e34cf81dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:13.843770 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a3721-3eb0-4887-8ef7-252e34cf81dc admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:13.844466 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a3721-3eb0-4887-8ef7-252e34cf81dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:13.848420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a3721-3eb0-4887-8ef7-252e34cf81dc admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:13.881097 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1052/2099] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:58:13 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:58:13.882271 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a14ff-23d3-4694-98ba-75405b8974a5 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:13.896520 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a14ff-23d3-4694-98ba-75405b8974a5 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:13.902110 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435c602-a8bb-437d-838f-f443a846fd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:13.902886 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435c602-a8bb-437d-838f-f443a846fd73 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:13.903253 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435c602-a8bb-437d-838f-f443a846fd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:13.903589 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435c602-a8bb-437d-838f-f443a846fd73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:13.904629 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435c602-a8bb-437d-838f-f443a846fd73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:13.906263 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435c602-a8bb-437d-838f-f443a846fd73 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:13.917764 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1048/2100] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:13.922245 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a3721-3eb0-4887-8ef7-252e34cf81dc admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:13.932665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a3721-3eb0-4887-8ef7-252e34cf81dc admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:13.944023 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460c718-b5c4-4e85-8dae-8419653127b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:13.945243 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460c718-b5c4-4e85-8dae-8419653127b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:13.945629 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460c718-b5c4-4e85-8dae-8419653127b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:13.946533 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460c718-b5c4-4e85-8dae-8419653127b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:13.947550 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460c718-b5c4-4e85-8dae-8419653127b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:13.949476 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460c718-b5c4-4e85-8dae-8419653127b3 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:13.963978 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1053/2101] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:13.971479 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435c602-a8bb-437d-838f-f443a846fd73 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:13.984323 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435c602-a8bb-437d-838f-f443a846fd73 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:13.989372 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd34f9f-a1cb-4574-9049-3686354527c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:13.990260 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd34f9f-a1cb-4574-9049-3686354527c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:13.990530 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd34f9f-a1cb-4574-9049-3686354527c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:13.990793 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd34f9f-a1cb-4574-9049-3686354527c1 admin admin] PATH_INFO: `/v3/projects/59d3a082fc2f4120af3bdf4cab09fe0b/users/e738f4f11b174a228ada7709eb9370a5/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:14.007299 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd34f9f-a1cb-4574-9049-3686354527c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d3a082fc2f4120af3bdf4cab09fe0b, user_id=e738f4f11b174a228ada7709eb9370a5, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:14.010255 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd34f9f-a1cb-4574-9049-3686354527c1 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:14.025821 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1049/2102] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:13 2022] PUT /identity/v3/projects/59d3a082fc2f4120af3bdf4cab09fe0b/users/e738f4f11b174a228ada7709eb9370a5/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:14.037256 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d5228-d128-4139-9030-241956d0e551 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:14.037536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d5228-d128-4139-9030-241956d0e551 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:14.037859 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d5228-d128-4139-9030-241956d0e551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:14.085898 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-a06d5228-d128-4139-9030-241956d0e551 None None] MFA Rules not processed for user `e738f4f11b174a228ada7709eb9370a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:14.087668 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a06d5228-d128-4139-9030-241956d0e551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:14.217475 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1054/2103] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:14 2022] POST /identity/v3/auth/tokens => generated 3385 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:14.221687 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd34f9f-a1cb-4574-9049-3686354527c1 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:14.343053 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd34f9f-a1cb-4574-9049-3686354527c1 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:14.347666 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725f186-3352-4a5a-9dcb-1a479b9f98e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:14.348325 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725f186-3352-4a5a-9dcb-1a479b9f98e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:14.348598 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725f186-3352-4a5a-9dcb-1a479b9f98e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:14.348909 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725f186-3352-4a5a-9dcb-1a479b9f98e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:14.349600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725f186-3352-4a5a-9dcb-1a479b9f98e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:14.351560 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725f186-3352-4a5a-9dcb-1a479b9f98e9 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:14.384629 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1050/2104] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:58:14 2022] POST /identity/v3/projects => generated 367 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:14.390718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d5228-d128-4139-9030-241956d0e551 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:14.411094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d5228-d128-4139-9030-241956d0e551 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:14.488946 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b917d-5bd5-4325-ad40-e8e875433aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:14.489843 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b917d-5bd5-4325-ad40-e8e875433aaa admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:14.490272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b917d-5bd5-4325-ad40-e8e875433aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:14.490552 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b917d-5bd5-4325-ad40-e8e875433aaa admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:14.491248 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b917d-5bd5-4325-ad40-e8e875433aaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:14.493245 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b917d-5bd5-4325-ad40-e8e875433aaa admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:14.521295 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1055/2105] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:58:14 2022] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:14.524049 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725f186-3352-4a5a-9dcb-1a479b9f98e9 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:14.547641 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725f186-3352-4a5a-9dcb-1a479b9f98e9 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:14.556652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3919a-97b4-4854-b570-2669babc48b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:14.557842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3919a-97b4-4854-b570-2669babc48b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:14.558263 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3919a-97b4-4854-b570-2669babc48b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:14.558726 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3919a-97b4-4854-b570-2669babc48b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:14.560024 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3919a-97b4-4854-b570-2669babc48b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:14.564105 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3919a-97b4-4854-b570-2669babc48b2 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:14.588256 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1051/2106] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:14.593761 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b917d-5bd5-4325-ad40-e8e875433aaa admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:14.604384 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b917d-5bd5-4325-ad40-e8e875433aaa admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:14.610710 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad04a76-2105-49bd-8335-761999ae6c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:14.611637 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad04a76-2105-49bd-8335-761999ae6c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:14.611914 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad04a76-2105-49bd-8335-761999ae6c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:14.612190 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad04a76-2105-49bd-8335-761999ae6c35 admin admin] PATH_INFO: `/v3/projects/106f325c67e046fc9717a6e0406aeef0/users/fcedcfe2de384daebba47b8badcf7bf6/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:14.630106 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad04a76-2105-49bd-8335-761999ae6c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=106f325c67e046fc9717a6e0406aeef0, user_id=fcedcfe2de384daebba47b8badcf7bf6, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:14.632862 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad04a76-2105-49bd-8335-761999ae6c35 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:14.650960 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1056/2107] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:14 2022] PUT /identity/v3/projects/106f325c67e046fc9717a6e0406aeef0/users/fcedcfe2de384daebba47b8badcf7bf6/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:58:14.656199 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3919a-97b4-4854-b570-2669babc48b2 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:14.666615 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3919a-97b4-4854-b570-2669babc48b2 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:14.740107 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad26e07-8417-4628-b228-57d58c474d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:14.740842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad26e07-8417-4628-b228-57d58c474d11 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:14.741109 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad26e07-8417-4628-b228-57d58c474d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:14.741384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad26e07-8417-4628-b228-57d58c474d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:14.742107 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad26e07-8417-4628-b228-57d58c474d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:14.743718 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad26e07-8417-4628-b228-57d58c474d11 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:14.755072 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1052/2108] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:58:14.759485 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad04a76-2105-49bd-8335-761999ae6c35 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:14.771293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad04a76-2105-49bd-8335-761999ae6c35 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:14.776387 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ba5ca-36a3-45f4-95f9-fb85dde4fe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:14.777368 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ba5ca-36a3-45f4-95f9-fb85dde4fe7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:14.777682 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ba5ca-36a3-45f4-95f9-fb85dde4fe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:14.777986 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ba5ca-36a3-45f4-95f9-fb85dde4fe7b admin admin] PATH_INFO: `/v3/projects/106f325c67e046fc9717a6e0406aeef0/users/fcedcfe2de384daebba47b8badcf7bf6/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:14.780310 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ba5ca-36a3-45f4-95f9-fb85dde4fe7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=106f325c67e046fc9717a6e0406aeef0, user_id=fcedcfe2de384daebba47b8badcf7bf6, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:14.783253 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ba5ca-36a3-45f4-95f9-fb85dde4fe7b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:14.797459 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1057/2109] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:14 2022] PUT /identity/v3/projects/106f325c67e046fc9717a6e0406aeef0/users/fcedcfe2de384daebba47b8badcf7bf6/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:58:14.808758 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6340b-ebc0-40da-93cf-45f95c7a9d1f None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:14.809076 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6340b-ebc0-40da-93cf-45f95c7a9d1f None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:14.809347 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6340b-ebc0-40da-93cf-45f95c7a9d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:14.844427 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-6ca6340b-ebc0-40da-93cf-45f95c7a9d1f None None] MFA Rules not processed for user `fcedcfe2de384daebba47b8badcf7bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:14.845708 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-6ca6340b-ebc0-40da-93cf-45f95c7a9d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:14.916951 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1053/2110] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:14 2022] POST /identity/v3/auth/tokens => generated 3454 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:14.930445 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ba5ca-36a3-45f4-95f9-fb85dde4fe7b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:14.934564 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-208ba5ca-36a3-45f4-95f9-fb85dde4fe7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:14.995933 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ba5ca-36a3-45f4-95f9-fb85dde4fe7b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:15.000477 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293829e7-d377-4b7e-80d4-264db9b02c1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:15.001159 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293829e7-d377-4b7e-80d4-264db9b02c1f service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:15.001438 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293829e7-d377-4b7e-80d4-264db9b02c1f service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:15.001707 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293829e7-d377-4b7e-80d4-264db9b02c1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:15.014486 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293829e7-d377-4b7e-80d4-264db9b02c1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:15.016117 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293829e7-d377-4b7e-80d4-264db9b02c1f service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:15.029218 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1058/2111] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:14 2022] GET /identity/v3/auth/tokens => generated 3454 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:15.126449 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6340b-ebc0-40da-93cf-45f95c7a9d1f None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:15.136385 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6340b-ebc0-40da-93cf-45f95c7a9d1f None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:15.140117 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2cb86-286f-4d3f-a9c4-77c9f587f5a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:15.140762 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2cb86-286f-4d3f-a9c4-77c9f587f5a9 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:15.141066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2cb86-286f-4d3f-a9c4-77c9f587f5a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:15.141342 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2cb86-286f-4d3f-a9c4-77c9f587f5a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:15.207093 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2cb86-286f-4d3f-a9c4-77c9f587f5a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:15.208526 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2cb86-286f-4d3f-a9c4-77c9f587f5a9 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:15.218755 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1054/2112] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:15 2022] GET /identity/v3/auth/tokens => generated 3385 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:18.745094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293829e7-d377-4b7e-80d4-264db9b02c1f service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:18.746545 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-293829e7-d377-4b7e-80d4-264db9b02c1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:18.817229 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293829e7-d377-4b7e-80d4-264db9b02c1f service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:18.824484 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b722d4-46e7-43b4-bd89-890a900f2bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:18.826918 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b722d4-46e7-43b4-bd89-890a900f2bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:18.827003 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b722d4-46e7-43b4-bd89-890a900f2bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:18.827338 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b722d4-46e7-43b4-bd89-890a900f2bb4 admin admin] PATH_INFO: `/v3/users/4d8795ad57c5476db5f275d7581b7ab7` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:18.829685 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b722d4-46e7-43b4-bd89-890a900f2bb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8795ad57c5476db5f275d7581b7ab7)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:18.832493 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b722d4-46e7-43b4-bd89-890a900f2bb4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:18.900971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-92b722d4-46e7-43b4-bd89-890a900f2bb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8795ad57c5476db5f275d7581b7ab7'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:18.902021 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-92b722d4-46e7-43b4-bd89-890a900f2bb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8795ad57c5476db5f275d7581b7ab7'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:18.902700 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-92b722d4-46e7-43b4-bd89-890a900f2bb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8795ad57c5476db5f275d7581b7ab7'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:18.914795 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-92b722d4-46e7-43b4-bd89-890a900f2bb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8795ad57c5476db5f275d7581b7ab7'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:18.927255 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-92b722d4-46e7-43b4-bd89-890a900f2bb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8795ad57c5476db5f275d7581b7ab7'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:18.945927 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1059/2113] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:58:18 2022] DELETE /identity/v3/users/4d8795ad57c5476db5f275d7581b7ab7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:18.952235 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9806b3-21af-43be-95b9-6045d4cd2de1 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:18.953078 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9806b3-21af-43be-95b9-6045d4cd2de1 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:18.953078 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9806b3-21af-43be-95b9-6045d4cd2de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:18.972962 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-2d9806b3-21af-43be-95b9-6045d4cd2de1 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:18.974279 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2d9806b3-21af-43be-95b9-6045d4cd2de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:19.054267 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1055/2114] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:18 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:19.064672 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b722d4-46e7-43b4-bd89-890a900f2bb4 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:19.066355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-92b722d4-46e7-43b4-bd89-890a900f2bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:19.131226 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b722d4-46e7-43b4-bd89-890a900f2bb4 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:19.134927 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d95837-5916-44dd-93f6-d08761061da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:19.135565 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d95837-5916-44dd-93f6-d08761061da2 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:19.135842 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d95837-5916-44dd-93f6-d08761061da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:19.136124 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d95837-5916-44dd-93f6-d08761061da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:19.146290 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d95837-5916-44dd-93f6-d08761061da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:19.147718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d95837-5916-44dd-93f6-d08761061da2 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:19.158269 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1060/2115] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:19 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:19.438069 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9806b3-21af-43be-95b9-6045d4cd2de1 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:19.439577 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2d9806b3-21af-43be-95b9-6045d4cd2de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:19.452741 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9806b3-21af-43be-95b9-6045d4cd2de1 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:19.461002 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b4652-faf6-4547-b8dc-7cdd251f6ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:19.463135 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b4652-faf6-4547-b8dc-7cdd251f6ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:19.463422 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b4652-faf6-4547-b8dc-7cdd251f6ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:19.463733 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b4652-faf6-4547-b8dc-7cdd251f6ef3 admin admin] PATH_INFO: `/v3/projects/3d6722e7a2754e339d0f4a9067af2285` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:19.465082 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b4652-faf6-4547-b8dc-7cdd251f6ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d6722e7a2754e339d0f4a9067af2285)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:19.468867 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b4652-faf6-4547-b8dc-7cdd251f6ef3 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:19.521322 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-172b4652-faf6-4547-b8dc-7cdd251f6ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d6722e7a2754e339d0f4a9067af2285', 'request_id': 'req-172b4652-faf6-4547-b8dc-7cdd251f6ef3'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:19.527950 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-172b4652-faf6-4547-b8dc-7cdd251f6ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d6722e7a2754e339d0f4a9067af2285', 'request_id': 'req-172b4652-faf6-4547-b8dc-7cdd251f6ef3'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:19.538949 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-172b4652-faf6-4547-b8dc-7cdd251f6ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d6722e7a2754e339d0f4a9067af2285', 'request_id': 'req-172b4652-faf6-4547-b8dc-7cdd251f6ef3'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:19.552198 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-172b4652-faf6-4547-b8dc-7cdd251f6ef3 admin admin] The token cache is being invalidate because project 3d6722e7a2754e339d0f4a9067af2285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:58:19.554946 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-172b4652-faf6-4547-b8dc-7cdd251f6ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:19.554946 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-172b4652-faf6-4547-b8dc-7cdd251f6ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:19.554946 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1056/2116] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:58:19 2022] DELETE /identity/v3/projects/3d6722e7a2754e339d0f4a9067af2285 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:19.560630 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129ce49-22fb-4f34-85db-1a723f6ec9c4 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:19.560973 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129ce49-22fb-4f34-85db-1a723f6ec9c4 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:19.561251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129ce49-22fb-4f34-85db-1a723f6ec9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:19.579881 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-f129ce49-22fb-4f34-85db-1a723f6ec9c4 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:19.581281 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-f129ce49-22fb-4f34-85db-1a723f6ec9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:19.650426 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1061/2117] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:19 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:19.659353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff41c2-a525-4546-9348-dcb58c1b0324 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:19.659632 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff41c2-a525-4546-9348-dcb58c1b0324 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:19.659915 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff41c2-a525-4546-9348-dcb58c1b0324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:19.678300 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-86ff41c2-a525-4546-9348-dcb58c1b0324 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:19.679502 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-86ff41c2-a525-4546-9348-dcb58c1b0324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:19.689816 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1057/2118] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:19 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:19.695018 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129ce49-22fb-4f34-85db-1a723f6ec9c4 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:19.705701 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129ce49-22fb-4f34-85db-1a723f6ec9c4 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:19.710611 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbdfb1-03a0-40bd-9474-1ebfb59c8c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:19.711280 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbdfb1-03a0-40bd-9474-1ebfb59c8c8a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:19.711559 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbdfb1-03a0-40bd-9474-1ebfb59c8c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:19.711856 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbdfb1-03a0-40bd-9474-1ebfb59c8c8a admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:19.712578 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbdfb1-03a0-40bd-9474-1ebfb59c8c8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:58:19.712914 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbdfb1-03a0-40bd-9474-1ebfb59c8c8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:19.714519 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbdfb1-03a0-40bd-9474-1ebfb59c8c8a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:19.730287 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1062/2119] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:58:19.734770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff41c2-a525-4546-9348-dcb58c1b0324 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:19.745625 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff41c2-a525-4546-9348-dcb58c1b0324 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:19.752504 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c987c-de51-4365-b8fe-76ba8a096a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:19.753198 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c987c-de51-4365-b8fe-76ba8a096a95 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:19.753479 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c987c-de51-4365-b8fe-76ba8a096a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:19.753752 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c987c-de51-4365-b8fe-76ba8a096a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:19.754961 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c987c-de51-4365-b8fe-76ba8a096a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:19.756381 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c987c-de51-4365-b8fe-76ba8a096a95 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:19.787027 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1058/2120] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:58:19 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:58:19.792303 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbdfb1-03a0-40bd-9474-1ebfb59c8c8a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:19.807264 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbdfb1-03a0-40bd-9474-1ebfb59c8c8a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:19.867490 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e923b-588d-41c6-97a5-cb86f1b6f93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:19.868156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e923b-588d-41c6-97a5-cb86f1b6f93f admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:19.868432 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e923b-588d-41c6-97a5-cb86f1b6f93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:19.868703 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e923b-588d-41c6-97a5-cb86f1b6f93f admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:19.869415 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e923b-588d-41c6-97a5-cb86f1b6f93f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:19.871326 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e923b-588d-41c6-97a5-cb86f1b6f93f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:19.893566 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1063/2121] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:58:19 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:19.897633 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c987c-de51-4365-b8fe-76ba8a096a95 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:19.907840 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c987c-de51-4365-b8fe-76ba8a096a95 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:19.920559 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14206afb-2478-4044-9224-34a0166d8e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:19.921809 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14206afb-2478-4044-9224-34a0166d8e61 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:19.922304 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14206afb-2478-4044-9224-34a0166d8e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:19.922836 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14206afb-2478-4044-9224-34a0166d8e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:19.924222 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14206afb-2478-4044-9224-34a0166d8e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:19.926353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14206afb-2478-4044-9224-34a0166d8e61 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:19.938717 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1059/2122] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:19.944139 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e923b-588d-41c6-97a5-cb86f1b6f93f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:19.957444 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e923b-588d-41c6-97a5-cb86f1b6f93f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:19.962220 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a427e3f-3866-40a7-88f4-39c5549ef402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:19.963054 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a427e3f-3866-40a7-88f4-39c5549ef402 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:19.963356 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a427e3f-3866-40a7-88f4-39c5549ef402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:19.963625 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a427e3f-3866-40a7-88f4-39c5549ef402 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:19.964348 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a427e3f-3866-40a7-88f4-39c5549ef402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:19.966023 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a427e3f-3866-40a7-88f4-39c5549ef402 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:19.984577 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1064/2123] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:19.989528 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14206afb-2478-4044-9224-34a0166d8e61 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:20.000907 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14206afb-2478-4044-9224-34a0166d8e61 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:20.005599 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e0a79-932b-447b-bef3-b1e374eca367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:20.006516 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e0a79-932b-447b-bef3-b1e374eca367 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:20.006791 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e0a79-932b-447b-bef3-b1e374eca367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:20.007062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e0a79-932b-447b-bef3-b1e374eca367 admin admin] PATH_INFO: `/v3/projects/dbe7cf6f7c4840e98efd612efcf9cac6/users/19c37c9ac0f54cf88b21c4f9cfb45461/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:20.022547 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e0a79-932b-447b-bef3-b1e374eca367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe7cf6f7c4840e98efd612efcf9cac6, user_id=19c37c9ac0f54cf88b21c4f9cfb45461, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:20.025176 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e0a79-932b-447b-bef3-b1e374eca367 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:20.039039 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1060/2124] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:19 2022] PUT /identity/v3/projects/dbe7cf6f7c4840e98efd612efcf9cac6/users/19c37c9ac0f54cf88b21c4f9cfb45461/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:20.051124 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f577e3-fd98-4aaa-a421-80ed0aa8af35 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:20.052664 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f577e3-fd98-4aaa-a421-80ed0aa8af35 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:20.053064 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f577e3-fd98-4aaa-a421-80ed0aa8af35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:20.084261 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-d1f577e3-fd98-4aaa-a421-80ed0aa8af35 None None] MFA Rules not processed for user `19c37c9ac0f54cf88b21c4f9cfb45461`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:20.085587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-d1f577e3-fd98-4aaa-a421-80ed0aa8af35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:20.162212 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1065/2125] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:20 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:20.164229 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e0a79-932b-447b-bef3-b1e374eca367 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:20.233884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e0a79-932b-447b-bef3-b1e374eca367 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:20.238602 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba0ed5-063e-4717-af39-7db28283ddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:20.239249 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba0ed5-063e-4717-af39-7db28283ddbb admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:20.239522 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba0ed5-063e-4717-af39-7db28283ddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:20.239878 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba0ed5-063e-4717-af39-7db28283ddbb admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:20.240560 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba0ed5-063e-4717-af39-7db28283ddbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:20.242464 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba0ed5-063e-4717-af39-7db28283ddbb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:20.277301 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1061/2126] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:58:20 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:20.281833 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f577e3-fd98-4aaa-a421-80ed0aa8af35 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:20.295504 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f577e3-fd98-4aaa-a421-80ed0aa8af35 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:20.353059 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c548a-6cdd-40bc-8816-98d910ec18c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:20.353725 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c548a-6cdd-40bc-8816-98d910ec18c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:20.353999 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c548a-6cdd-40bc-8816-98d910ec18c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:20.354267 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c548a-6cdd-40bc-8816-98d910ec18c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:20.354935 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c548a-6cdd-40bc-8816-98d910ec18c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:20.356904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c548a-6cdd-40bc-8816-98d910ec18c4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:20.379725 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1066/2127] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:58:20 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:20.383975 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba0ed5-063e-4717-af39-7db28283ddbb admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:20.395181 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba0ed5-063e-4717-af39-7db28283ddbb admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:20.407557 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b90e4-f3cc-41ca-8e09-e79394d4771f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:20.408333 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b90e4-f3cc-41ca-8e09-e79394d4771f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:20.408772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b90e4-f3cc-41ca-8e09-e79394d4771f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:20.409092 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b90e4-f3cc-41ca-8e09-e79394d4771f admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:20.409819 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b90e4-f3cc-41ca-8e09-e79394d4771f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:20.411400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b90e4-f3cc-41ca-8e09-e79394d4771f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:20.429733 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1062/2128] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:58:20.431657 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c548a-6cdd-40bc-8816-98d910ec18c4 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:20.450229 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c548a-6cdd-40bc-8816-98d910ec18c4 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:20.458790 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec2132-5000-4a68-ae11-cf42b83a900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:20.459546 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec2132-5000-4a68-ae11-cf42b83a900c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:20.459892 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec2132-5000-4a68-ae11-cf42b83a900c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:20.460235 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec2132-5000-4a68-ae11-cf42b83a900c admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:20.461074 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec2132-5000-4a68-ae11-cf42b83a900c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:20.462969 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec2132-5000-4a68-ae11-cf42b83a900c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:20.475994 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1067/2129] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:20.479786 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b90e4-f3cc-41ca-8e09-e79394d4771f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:20.490060 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b90e4-f3cc-41ca-8e09-e79394d4771f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:20.494856 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae6c2b-7b0e-4800-9a7a-2c980af5c135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:20.495740 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae6c2b-7b0e-4800-9a7a-2c980af5c135 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:20.496013 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae6c2b-7b0e-4800-9a7a-2c980af5c135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:20.496279 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae6c2b-7b0e-4800-9a7a-2c980af5c135 admin admin] PATH_INFO: `/v3/projects/5f683b75a27d44eb8d86d7fdb03c4012/users/4305e90af6b545a6b23dbeb1af71ddc4/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:20.511954 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae6c2b-7b0e-4800-9a7a-2c980af5c135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f683b75a27d44eb8d86d7fdb03c4012, user_id=4305e90af6b545a6b23dbeb1af71ddc4, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:20.514584 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae6c2b-7b0e-4800-9a7a-2c980af5c135 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:20.527378 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1063/2130] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:20 2022] PUT /identity/v3/projects/5f683b75a27d44eb8d86d7fdb03c4012/users/4305e90af6b545a6b23dbeb1af71ddc4/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:20.538268 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb794e-92d5-42a9-9ee8-52631f8a6620 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:20.538558 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb794e-92d5-42a9-9ee8-52631f8a6620 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:20.538831 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb794e-92d5-42a9-9ee8-52631f8a6620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:20.573994 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-0bbb794e-92d5-42a9-9ee8-52631f8a6620 None None] MFA Rules not processed for user `4305e90af6b545a6b23dbeb1af71ddc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:20.575222 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-0bbb794e-92d5-42a9-9ee8-52631f8a6620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:20.643227 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1068/2131] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:20 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:20.653742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae6c2b-7b0e-4800-9a7a-2c980af5c135 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:20.726855 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae6c2b-7b0e-4800-9a7a-2c980af5c135 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:20.731713 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13901dd2-716d-4187-9b4e-9fb90d5a5f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:20.733133 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13901dd2-716d-4187-9b4e-9fb90d5a5f05 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:20.733642 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13901dd2-716d-4187-9b4e-9fb90d5a5f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:20.733992 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13901dd2-716d-4187-9b4e-9fb90d5a5f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:20.734715 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13901dd2-716d-4187-9b4e-9fb90d5a5f05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:20.736603 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13901dd2-716d-4187-9b4e-9fb90d5a5f05 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:20.764475 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1064/2132] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:58:20 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:20.768635 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb794e-92d5-42a9-9ee8-52631f8a6620 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:20.785641 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb794e-92d5-42a9-9ee8-52631f8a6620 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:20.861972 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216521c5-d609-44e4-8ff5-9881ad6e2725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:20.864601 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216521c5-d609-44e4-8ff5-9881ad6e2725 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:20.864985 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216521c5-d609-44e4-8ff5-9881ad6e2725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:20.865324 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216521c5-d609-44e4-8ff5-9881ad6e2725 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:20.867047 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216521c5-d609-44e4-8ff5-9881ad6e2725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:20.869290 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216521c5-d609-44e4-8ff5-9881ad6e2725 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:20.901631 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1069/2133] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:58:20 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:20.907015 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13901dd2-716d-4187-9b4e-9fb90d5a5f05 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:20.921781 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13901dd2-716d-4187-9b4e-9fb90d5a5f05 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:20.932126 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea1134-0cf5-4287-b02c-08d0ceb44036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:20.932126 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea1134-0cf5-4287-b02c-08d0ceb44036 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:20.932126 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea1134-0cf5-4287-b02c-08d0ceb44036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:20.932126 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea1134-0cf5-4287-b02c-08d0ceb44036 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:20.932609 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea1134-0cf5-4287-b02c-08d0ceb44036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:20.934161 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea1134-0cf5-4287-b02c-08d0ceb44036 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:20.951027 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1065/2134] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:20.956350 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216521c5-d609-44e4-8ff5-9881ad6e2725 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:20.985034 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216521c5-d609-44e4-8ff5-9881ad6e2725 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:20.998448 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae97eb-e859-4a9d-8c1c-bd16398fd3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:21.001009 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae97eb-e859-4a9d-8c1c-bd16398fd3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:21.001009 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae97eb-e859-4a9d-8c1c-bd16398fd3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:21.001009 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae97eb-e859-4a9d-8c1c-bd16398fd3b7 admin admin] PATH_INFO: `/v3/projects/32955d8dd19e494e9cd784fe0a718768/users/030e1f67d94447a6b76ce239feec19f4/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:21.020349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae97eb-e859-4a9d-8c1c-bd16398fd3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32955d8dd19e494e9cd784fe0a718768, user_id=030e1f67d94447a6b76ce239feec19f4, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:21.027574 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae97eb-e859-4a9d-8c1c-bd16398fd3b7 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:21.045329 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1070/2135] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:20 2022] PUT /identity/v3/projects/32955d8dd19e494e9cd784fe0a718768/users/030e1f67d94447a6b76ce239feec19f4/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:58:21.052414 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea1134-0cf5-4287-b02c-08d0ceb44036 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:21.067866 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea1134-0cf5-4287-b02c-08d0ceb44036 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:21.147477 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7b844-65c5-4d4f-947c-79952bf5440e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:21.148165 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7b844-65c5-4d4f-947c-79952bf5440e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:21.148451 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7b844-65c5-4d4f-947c-79952bf5440e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:21.148716 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7b844-65c5-4d4f-947c-79952bf5440e admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:21.149516 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7b844-65c5-4d4f-947c-79952bf5440e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:21.151435 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7b844-65c5-4d4f-947c-79952bf5440e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:21.164441 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1066/2136] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:21.169565 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae97eb-e859-4a9d-8c1c-bd16398fd3b7 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:21.188582 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae97eb-e859-4a9d-8c1c-bd16398fd3b7 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:21.195637 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f69474-e70b-40a7-a12d-21c94becea56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:21.196525 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f69474-e70b-40a7-a12d-21c94becea56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:21.196887 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f69474-e70b-40a7-a12d-21c94becea56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:21.197165 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f69474-e70b-40a7-a12d-21c94becea56 admin admin] PATH_INFO: `/v3/projects/32955d8dd19e494e9cd784fe0a718768/users/030e1f67d94447a6b76ce239feec19f4/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:21.199338 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f69474-e70b-40a7-a12d-21c94becea56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32955d8dd19e494e9cd784fe0a718768, user_id=030e1f67d94447a6b76ce239feec19f4, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:21.202691 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f69474-e70b-40a7-a12d-21c94becea56 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:21.216287 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1071/2137] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:21 2022] PUT /identity/v3/projects/32955d8dd19e494e9cd784fe0a718768/users/030e1f67d94447a6b76ce239feec19f4/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:21.229939 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86674d4-c1a1-4158-988b-a869db62499a None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:21.235877 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86674d4-c1a1-4158-988b-a869db62499a None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:21.235877 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86674d4-c1a1-4158-988b-a869db62499a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:21.262286 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-f86674d4-c1a1-4158-988b-a869db62499a None None] MFA Rules not processed for user `030e1f67d94447a6b76ce239feec19f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:21.264161 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-f86674d4-c1a1-4158-988b-a869db62499a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:21.350406 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1067/2138] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:21 2022] POST /identity/v3/auth/tokens => generated 3462 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:21.362640 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f69474-e70b-40a7-a12d-21c94becea56 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:21.364656 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-60f69474-e70b-40a7-a12d-21c94becea56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:21.434376 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f69474-e70b-40a7-a12d-21c94becea56 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:21.439086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760acf1-af86-4825-858e-856a327c3bcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:21.439732 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760acf1-af86-4825-858e-856a327c3bcf service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:21.440015 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760acf1-af86-4825-858e-856a327c3bcf service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:21.440289 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760acf1-af86-4825-858e-856a327c3bcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:21.502707 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760acf1-af86-4825-858e-856a327c3bcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:21.504192 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760acf1-af86-4825-858e-856a327c3bcf service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:21.514650 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1072/2139] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:21 2022] GET /identity/v3/auth/tokens => generated 3397 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:23.071531 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86674d4-c1a1-4158-988b-a869db62499a None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:23.082171 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86674d4-c1a1-4158-988b-a869db62499a None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:23.086128 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa951eb2-8919-4b6a-8094-48b8675a3be7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:23.086790 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa951eb2-8919-4b6a-8094-48b8675a3be7 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:23.087099 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa951eb2-8919-4b6a-8094-48b8675a3be7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:23.087377 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa951eb2-8919-4b6a-8094-48b8675a3be7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:23.156769 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa951eb2-8919-4b6a-8094-48b8675a3be7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:23.158921 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa951eb2-8919-4b6a-8094-48b8675a3be7 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:23.169129 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1068/2140] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:23 2022] GET /identity/v3/auth/tokens => generated 3395 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:58:23.514245 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760acf1-af86-4825-858e-856a327c3bcf service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:23.516280 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-7760acf1-af86-4825-858e-856a327c3bcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:23.660203 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760acf1-af86-4825-858e-856a327c3bcf service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:23.675454 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed431925-67c7-42a8-be6f-e3cbfb51c614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:23.676750 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed431925-67c7-42a8-be6f-e3cbfb51c614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:23.678259 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed431925-67c7-42a8-be6f-e3cbfb51c614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:23.678704 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed431925-67c7-42a8-be6f-e3cbfb51c614 admin admin] PATH_INFO: `/v3/users/e738f4f11b174a228ada7709eb9370a5` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:23.680743 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed431925-67c7-42a8-be6f-e3cbfb51c614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e738f4f11b174a228ada7709eb9370a5)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:23.683336 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed431925-67c7-42a8-be6f-e3cbfb51c614 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:23.760428 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-ed431925-67c7-42a8-be6f-e3cbfb51c614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e738f4f11b174a228ada7709eb9370a5'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:23.761288 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-ed431925-67c7-42a8-be6f-e3cbfb51c614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e738f4f11b174a228ada7709eb9370a5'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:23.761924 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-ed431925-67c7-42a8-be6f-e3cbfb51c614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e738f4f11b174a228ada7709eb9370a5'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:23.771893 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-ed431925-67c7-42a8-be6f-e3cbfb51c614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e738f4f11b174a228ada7709eb9370a5'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:23.787762 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-ed431925-67c7-42a8-be6f-e3cbfb51c614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e738f4f11b174a228ada7709eb9370a5'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:23.811938 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1073/2141] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:58:23 2022] DELETE /identity/v3/users/e738f4f11b174a228ada7709eb9370a5 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:23.819347 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fda2fd-9781-464e-b589-967c975c740e None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:23.819838 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fda2fd-9781-464e-b589-967c975c740e None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:23.820308 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fda2fd-9781-464e-b589-967c975c740e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:23.854203 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-e1fda2fd-9781-464e-b589-967c975c740e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:23.858473 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-e1fda2fd-9781-464e-b589-967c975c740e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:23.946123 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1069/2142] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:23 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:23.956401 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed431925-67c7-42a8-be6f-e3cbfb51c614 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:23.957929 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-ed431925-67c7-42a8-be6f-e3cbfb51c614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:24.031517 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed431925-67c7-42a8-be6f-e3cbfb51c614 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:24.035444 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d73db-b376-4e6b-bbdf-37b52061520a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:24.036165 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d73db-b376-4e6b-bbdf-37b52061520a service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:24.036448 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d73db-b376-4e6b-bbdf-37b52061520a service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:24.036775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d73db-b376-4e6b-bbdf-37b52061520a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:24.051748 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d73db-b376-4e6b-bbdf-37b52061520a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:24.051979 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fda2fd-9781-464e-b589-967c975c740e None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:24.053328 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-e1fda2fd-9781-464e-b589-967c975c740e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:24.053642 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d73db-b376-4e6b-bbdf-37b52061520a service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:24.070759 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1074/2143] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:23 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:24.153172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fda2fd-9781-464e-b589-967c975c740e None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:24.161047 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fffa3a-11e7-4422-936f-2c504d9ca0d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:24.162200 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fffa3a-11e7-4422-936f-2c504d9ca0d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:24.162667 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fffa3a-11e7-4422-936f-2c504d9ca0d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:24.163108 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fffa3a-11e7-4422-936f-2c504d9ca0d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:24.166680 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-70fffa3a-11e7-4422-936f-2c504d9ca0d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:24.285392 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fffa3a-11e7-4422-936f-2c504d9ca0d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:24.287079 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fffa3a-11e7-4422-936f-2c504d9ca0d1 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:24.300315 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1070/2144] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:24 2022] GET /identity/v3/auth/tokens => generated 3462 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:58:24.439093 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d73db-b376-4e6b-bbdf-37b52061520a service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:24.448329 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-018d73db-b376-4e6b-bbdf-37b52061520a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:24.458112 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d73db-b376-4e6b-bbdf-37b52061520a service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:24.463271 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539475d-f299-4df9-8f55-0f139e1cfff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:24.464400 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539475d-f299-4df9-8f55-0f139e1cfff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:24.464682 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539475d-f299-4df9-8f55-0f139e1cfff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:24.464983 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539475d-f299-4df9-8f55-0f139e1cfff1 admin admin] PATH_INFO: `/v3/projects/59d3a082fc2f4120af3bdf4cab09fe0b` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:24.466218 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539475d-f299-4df9-8f55-0f139e1cfff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59d3a082fc2f4120af3bdf4cab09fe0b)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:24.468641 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539475d-f299-4df9-8f55-0f139e1cfff1 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:24.533153 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d539475d-f299-4df9-8f55-0f139e1cfff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d3a082fc2f4120af3bdf4cab09fe0b', 'request_id': 'req-d539475d-f299-4df9-8f55-0f139e1cfff1'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:24.545396 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d539475d-f299-4df9-8f55-0f139e1cfff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d3a082fc2f4120af3bdf4cab09fe0b', 'request_id': 'req-d539475d-f299-4df9-8f55-0f139e1cfff1'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:24.557430 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d539475d-f299-4df9-8f55-0f139e1cfff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d3a082fc2f4120af3bdf4cab09fe0b', 'request_id': 'req-d539475d-f299-4df9-8f55-0f139e1cfff1'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:24.580079 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d539475d-f299-4df9-8f55-0f139e1cfff1 admin admin] The token cache is being invalidate because project 59d3a082fc2f4120af3bdf4cab09fe0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:58:24.580387 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d539475d-f299-4df9-8f55-0f139e1cfff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:24.581312 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d539475d-f299-4df9-8f55-0f139e1cfff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:24.583091 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1075/2145] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:58:24 2022] DELETE /identity/v3/projects/59d3a082fc2f4120af3bdf4cab09fe0b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:24.587237 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fffa3a-11e7-4422-936f-2c504d9ca0d1 service cinder] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:24.599094 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fffa3a-11e7-4422-936f-2c504d9ca0d1 service cinder] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:24.659535 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e566773-86fa-449c-a627-405b50c04ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:24.660473 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e566773-86fa-449c-a627-405b50c04ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:24.660842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e566773-86fa-449c-a627-405b50c04ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:24.661248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e566773-86fa-449c-a627-405b50c04ce6 admin admin] PATH_INFO: `/v3/users/fcedcfe2de384daebba47b8badcf7bf6` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:24.662693 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e566773-86fa-449c-a627-405b50c04ce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcedcfe2de384daebba47b8badcf7bf6)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:24.665060 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e566773-86fa-449c-a627-405b50c04ce6 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:24.734766 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-3e566773-86fa-449c-a627-405b50c04ce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcedcfe2de384daebba47b8badcf7bf6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:24.735666 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-3e566773-86fa-449c-a627-405b50c04ce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcedcfe2de384daebba47b8badcf7bf6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:24.748578 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-3e566773-86fa-449c-a627-405b50c04ce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcedcfe2de384daebba47b8badcf7bf6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:24.761565 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-3e566773-86fa-449c-a627-405b50c04ce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcedcfe2de384daebba47b8badcf7bf6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:24.783258 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-3e566773-86fa-449c-a627-405b50c04ce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcedcfe2de384daebba47b8badcf7bf6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:24.793506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1071/2146] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:58:24 2022] DELETE /identity/v3/users/fcedcfe2de384daebba47b8badcf7bf6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:25.689404 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539475d-f299-4df9-8f55-0f139e1cfff1 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:25.691574 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-d539475d-f299-4df9-8f55-0f139e1cfff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:25.719009 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539475d-f299-4df9-8f55-0f139e1cfff1 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:25.841013 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f80d6c-a221-4962-9843-42e47c0106a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:25.842037 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f80d6c-a221-4962-9843-42e47c0106a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:25.842318 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f80d6c-a221-4962-9843-42e47c0106a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:25.842785 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f80d6c-a221-4962-9843-42e47c0106a3 admin admin] PATH_INFO: `/v3/projects/106f325c67e046fc9717a6e0406aeef0` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:25.856653 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f80d6c-a221-4962-9843-42e47c0106a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=106f325c67e046fc9717a6e0406aeef0)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:25.856653 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f80d6c-a221-4962-9843-42e47c0106a3 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:25.942723 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c1f80d6c-a221-4962-9843-42e47c0106a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '106f325c67e046fc9717a6e0406aeef0', 'request_id': 'req-c1f80d6c-a221-4962-9843-42e47c0106a3'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:25.949133 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c1f80d6c-a221-4962-9843-42e47c0106a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '106f325c67e046fc9717a6e0406aeef0', 'request_id': 'req-c1f80d6c-a221-4962-9843-42e47c0106a3'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:25.954538 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c1f80d6c-a221-4962-9843-42e47c0106a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '106f325c67e046fc9717a6e0406aeef0', 'request_id': 'req-c1f80d6c-a221-4962-9843-42e47c0106a3'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:25.969962 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c1f80d6c-a221-4962-9843-42e47c0106a3 admin admin] The token cache is being invalidate because project 106f325c67e046fc9717a6e0406aeef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:58:25.970190 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c1f80d6c-a221-4962-9843-42e47c0106a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:25.970974 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c1f80d6c-a221-4962-9843-42e47c0106a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:25.972532 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1076/2147] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:58:25 2022] DELETE /identity/v3/projects/106f325c67e046fc9717a6e0406aeef0 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:58:25.986376 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10276a13-5004-44c3-963b-f3d7292e3a22 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:25.987150 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10276a13-5004-44c3-963b-f3d7292e3a22 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:25.987434 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10276a13-5004-44c3-963b-f3d7292e3a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:26.007694 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-10276a13-5004-44c3-963b-f3d7292e3a22 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:26.008944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-10276a13-5004-44c3-963b-f3d7292e3a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:26.073886 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1072/2148] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:25 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:26.083820 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46359071-1afd-40c3-b7c7-d1064fcc98ea None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:26.083820 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46359071-1afd-40c3-b7c7-d1064fcc98ea None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:26.083820 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46359071-1afd-40c3-b7c7-d1064fcc98ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:26.101971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-46359071-1afd-40c3-b7c7-d1064fcc98ea None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:26.103187 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-46359071-1afd-40c3-b7c7-d1064fcc98ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:26.117531 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1077/2149] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:26 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:26.122269 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10276a13-5004-44c3-963b-f3d7292e3a22 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:26.133118 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10276a13-5004-44c3-963b-f3d7292e3a22 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:26.139124 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63e255-ee31-4a2e-932a-3dd65a04ff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:26.139824 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63e255-ee31-4a2e-932a-3dd65a04ff3f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:26.140100 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63e255-ee31-4a2e-932a-3dd65a04ff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:26.140557 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63e255-ee31-4a2e-932a-3dd65a04ff3f admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:26.141345 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63e255-ee31-4a2e-932a-3dd65a04ff3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:58:26.141854 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63e255-ee31-4a2e-932a-3dd65a04ff3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:26.143771 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63e255-ee31-4a2e-932a-3dd65a04ff3f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:26.159652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1073/2150] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:58:26.164127 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46359071-1afd-40c3-b7c7-d1064fcc98ea None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:26.181844 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46359071-1afd-40c3-b7c7-d1064fcc98ea None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:26.188162 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9dc69-2e3b-4ecc-9285-de9cc79447e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:26.188925 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9dc69-2e3b-4ecc-9285-de9cc79447e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:26.189205 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9dc69-2e3b-4ecc-9285-de9cc79447e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:26.189591 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9dc69-2e3b-4ecc-9285-de9cc79447e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:26.190280 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9dc69-2e3b-4ecc-9285-de9cc79447e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:26.192316 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9dc69-2e3b-4ecc-9285-de9cc79447e4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:26.224319 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1078/2151] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:58:26 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:26.228364 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63e255-ee31-4a2e-932a-3dd65a04ff3f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:26.240833 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63e255-ee31-4a2e-932a-3dd65a04ff3f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:26.316904 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f0095-0aa0-48d2-aa65-d8d1016c0e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:26.317586 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f0095-0aa0-48d2-aa65-d8d1016c0e75 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:26.318156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f0095-0aa0-48d2-aa65-d8d1016c0e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:26.318156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f0095-0aa0-48d2-aa65-d8d1016c0e75 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:26.318848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f0095-0aa0-48d2-aa65-d8d1016c0e75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:26.320743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f0095-0aa0-48d2-aa65-d8d1016c0e75 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:26.347319 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1074/2152] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:58:26 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:26.349129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9dc69-2e3b-4ecc-9285-de9cc79447e4 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:26.360451 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9dc69-2e3b-4ecc-9285-de9cc79447e4 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:26.365321 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5e195-4a6e-4cc8-8072-2cfe38e5d1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:26.366001 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5e195-4a6e-4cc8-8072-2cfe38e5d1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:26.366284 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5e195-4a6e-4cc8-8072-2cfe38e5d1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:26.366553 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5e195-4a6e-4cc8-8072-2cfe38e5d1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:26.367278 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5e195-4a6e-4cc8-8072-2cfe38e5d1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:26.368991 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5e195-4a6e-4cc8-8072-2cfe38e5d1b0 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:26.381029 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1079/2153] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:26.385396 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f0095-0aa0-48d2-aa65-d8d1016c0e75 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:26.396950 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f0095-0aa0-48d2-aa65-d8d1016c0e75 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:26.403593 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c28c0-e4a9-4c14-b238-5a9ffa2f8f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:26.411525 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c28c0-e4a9-4c14-b238-5a9ffa2f8f33 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:26.411525 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c28c0-e4a9-4c14-b238-5a9ffa2f8f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:26.411525 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c28c0-e4a9-4c14-b238-5a9ffa2f8f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:26.411525 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c28c0-e4a9-4c14-b238-5a9ffa2f8f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:26.411525 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c28c0-e4a9-4c14-b238-5a9ffa2f8f33 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:26.421277 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1075/2154] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:58:26.426045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5e195-4a6e-4cc8-8072-2cfe38e5d1b0 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:26.436784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5e195-4a6e-4cc8-8072-2cfe38e5d1b0 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:26.441746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc98e0f-5914-49d6-8614-87ace65b9269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:26.442646 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc98e0f-5914-49d6-8614-87ace65b9269 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:26.442926 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc98e0f-5914-49d6-8614-87ace65b9269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:26.443198 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc98e0f-5914-49d6-8614-87ace65b9269 admin admin] PATH_INFO: `/v3/projects/06563e948ece4aaa9dd3d52e885d513e/users/50491213dbe045bd99bdcc30660df490/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:26.460619 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc98e0f-5914-49d6-8614-87ace65b9269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06563e948ece4aaa9dd3d52e885d513e, user_id=50491213dbe045bd99bdcc30660df490, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:26.463653 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc98e0f-5914-49d6-8614-87ace65b9269 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:26.483344 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1080/2155] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:26 2022] PUT /identity/v3/projects/06563e948ece4aaa9dd3d52e885d513e/users/50491213dbe045bd99bdcc30660df490/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:26.494627 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd8d39-18fa-4b90-a077-6ebfd2e77dea None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:26.495018 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd8d39-18fa-4b90-a077-6ebfd2e77dea None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:26.495437 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd8d39-18fa-4b90-a077-6ebfd2e77dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:26.530851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-eecd8d39-18fa-4b90-a077-6ebfd2e77dea None None] MFA Rules not processed for user `50491213dbe045bd99bdcc30660df490`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:26.533167 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-eecd8d39-18fa-4b90-a077-6ebfd2e77dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:26.650316 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1076/2156] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:26 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:26.668771 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc98e0f-5914-49d6-8614-87ace65b9269 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:26.674341 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-3dc98e0f-5914-49d6-8614-87ace65b9269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:26.819597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc98e0f-5914-49d6-8614-87ace65b9269 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:26.826894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd20d2-7f38-4ce6-a80c-49c3018bbe5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:26.828302 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd20d2-7f38-4ce6-a80c-49c3018bbe5d service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:26.828943 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd20d2-7f38-4ce6-a80c-49c3018bbe5d service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:26.830486 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd20d2-7f38-4ce6-a80c-49c3018bbe5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:26.848494 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd20d2-7f38-4ce6-a80c-49c3018bbe5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:26.850868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd20d2-7f38-4ce6-a80c-49c3018bbe5d service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:26.884364 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1081/2157] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:26 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:31.783511 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09989759-f98f-40c2-8ad7-94a7b6b521b0 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:31.784225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09989759-f98f-40c2-8ad7-94a7b6b521b0 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:31.784472 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09989759-f98f-40c2-8ad7-94a7b6b521b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:31.808719 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-09989759-f98f-40c2-8ad7-94a7b6b521b0 None None] MFA Rules not processed for user `1f57e62502564821b4be822554d9f5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:31.810806 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-09989759-f98f-40c2-8ad7-94a7b6b521b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:31.896127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1077/2158] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:31 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:33.001453 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd20d2-7f38-4ce6-a80c-49c3018bbe5d service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:33.027203 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09989759-f98f-40c2-8ad7-94a7b6b521b0 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:33.029629 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-09989759-f98f-40c2-8ad7-94a7b6b521b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:33.143027 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09989759-f98f-40c2-8ad7-94a7b6b521b0 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:33.153415 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f3c0c-621d-455c-aee2-9831439602d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:33.156287 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f3c0c-621d-455c-aee2-9831439602d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:33.157303 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f3c0c-621d-455c-aee2-9831439602d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:33.158682 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f3c0c-621d-455c-aee2-9831439602d5 admin admin] PATH_INFO: `/v3/users/19c37c9ac0f54cf88b21c4f9cfb45461` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:33.161513 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f3c0c-621d-455c-aee2-9831439602d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19c37c9ac0f54cf88b21c4f9cfb45461)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:33.164574 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f3c0c-621d-455c-aee2-9831439602d5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:33.225404 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd20d2-7f38-4ce6-a80c-49c3018bbe5d service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:33.232580 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3932d9-38c1-473e-819f-5a1b795a2a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:33.233981 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3932d9-38c1-473e-819f-5a1b795a2a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:33.234409 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3932d9-38c1-473e-819f-5a1b795a2a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:33.234913 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3932d9-38c1-473e-819f-5a1b795a2a12 admin admin] PATH_INFO: `/v3/users/50491213dbe045bd99bdcc30660df490` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:33.239931 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3932d9-38c1-473e-819f-5a1b795a2a12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50491213dbe045bd99bdcc30660df490)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:33.242255 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1e7f3c0c-621d-455c-aee2-9831439602d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19c37c9ac0f54cf88b21c4f9cfb45461'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:33.243165 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1e7f3c0c-621d-455c-aee2-9831439602d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19c37c9ac0f54cf88b21c4f9cfb45461'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:33.243446 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3932d9-38c1-473e-819f-5a1b795a2a12 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:33.259210 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1e7f3c0c-621d-455c-aee2-9831439602d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19c37c9ac0f54cf88b21c4f9cfb45461'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:33.279971 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1e7f3c0c-621d-455c-aee2-9831439602d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19c37c9ac0f54cf88b21c4f9cfb45461'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:33.310563 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1e7f3c0c-621d-455c-aee2-9831439602d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19c37c9ac0f54cf88b21c4f9cfb45461'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:33.318577 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1078/2159] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:58:33 2022] DELETE /identity/v3/users/19c37c9ac0f54cf88b21c4f9cfb45461 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:33.323308 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef634b49-9972-4b1c-8e7f-6f90d849f6a3 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:33.323705 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef634b49-9972-4b1c-8e7f-6f90d849f6a3 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:33.323993 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef634b49-9972-4b1c-8e7f-6f90d849f6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:33.344671 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-ef634b49-9972-4b1c-8e7f-6f90d849f6a3 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:33.345945 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ef634b49-9972-4b1c-8e7f-6f90d849f6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:33.349504 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7b3932d9-38c1-473e-819f-5a1b795a2a12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50491213dbe045bd99bdcc30660df490'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:33.351602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7b3932d9-38c1-473e-819f-5a1b795a2a12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50491213dbe045bd99bdcc30660df490'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:33.352689 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7b3932d9-38c1-473e-819f-5a1b795a2a12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50491213dbe045bd99bdcc30660df490'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:33.369730 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7b3932d9-38c1-473e-819f-5a1b795a2a12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50491213dbe045bd99bdcc30660df490'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:33.383295 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7b3932d9-38c1-473e-819f-5a1b795a2a12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50491213dbe045bd99bdcc30660df490'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:33.413772 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1082/2160] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:58:32 2022] DELETE /identity/v3/users/50491213dbe045bd99bdcc30660df490 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:33.421434 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40933e0-88e7-4203-b3de-8a5a4ff0f2c3 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:33.421947 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40933e0-88e7-4203-b3de-8a5a4ff0f2c3 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:33.422390 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40933e0-88e7-4203-b3de-8a5a4ff0f2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:33.428647 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1079/2161] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:33 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:33.440743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef634b49-9972-4b1c-8e7f-6f90d849f6a3 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:33.442934 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ef634b49-9972-4b1c-8e7f-6f90d849f6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:33.452462 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-c40933e0-88e7-4203-b3de-8a5a4ff0f2c3 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:33.454871 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c40933e0-88e7-4203-b3de-8a5a4ff0f2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:33.548955 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef634b49-9972-4b1c-8e7f-6f90d849f6a3 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:33.569308 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1083/2162] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:33 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:33.580429 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40933e0-88e7-4203-b3de-8a5a4ff0f2c3 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:33.641967 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf024f7c-0110-4779-a467-8fa3a772df19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:33.643192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf024f7c-0110-4779-a467-8fa3a772df19 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:33.644629 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf024f7c-0110-4779-a467-8fa3a772df19 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:33.645173 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf024f7c-0110-4779-a467-8fa3a772df19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:33.661611 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40933e0-88e7-4203-b3de-8a5a4ff0f2c3 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:33.666371 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0611a-afc2-437b-a7ea-b685c6862ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:33.667130 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0611a-afc2-437b-a7ea-b685c6862ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:33.667475 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0611a-afc2-437b-a7ea-b685c6862ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:33.667754 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0611a-afc2-437b-a7ea-b685c6862ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:33.673585 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf024f7c-0110-4779-a467-8fa3a772df19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:33.675772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf024f7c-0110-4779-a467-8fa3a772df19 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:33.679197 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0611a-afc2-437b-a7ea-b685c6862ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:33.680721 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0611a-afc2-437b-a7ea-b685c6862ed2 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:33.691935 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1080/2163] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:33 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:58:33.698988 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1084/2164] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:33 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:58:34.177374 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf024f7c-0110-4779-a467-8fa3a772df19 service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:34.178977 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-bf024f7c-0110-4779-a467-8fa3a772df19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:34.205899 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf024f7c-0110-4779-a467-8fa3a772df19 service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:34.212005 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3056f53-f51b-4bd7-b680-738a70b3c0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:34.213075 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3056f53-f51b-4bd7-b680-738a70b3c0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:34.213814 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3056f53-f51b-4bd7-b680-738a70b3c0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:34.214204 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3056f53-f51b-4bd7-b680-738a70b3c0cf admin admin] PATH_INFO: `/v3/projects/dbe7cf6f7c4840e98efd612efcf9cac6` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:34.216659 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3056f53-f51b-4bd7-b680-738a70b3c0cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbe7cf6f7c4840e98efd612efcf9cac6)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:34.234744 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3056f53-f51b-4bd7-b680-738a70b3c0cf admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:34.279625 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0611a-afc2-437b-a7ea-b685c6862ed2 service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:34.281287 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c7e0611a-afc2-437b-a7ea-b685c6862ed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:34.300161 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-b3056f53-f51b-4bd7-b680-738a70b3c0cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbe7cf6f7c4840e98efd612efcf9cac6', 'request_id': 'req-b3056f53-f51b-4bd7-b680-738a70b3c0cf'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:34.304745 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0611a-afc2-437b-a7ea-b685c6862ed2 service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:34.313785 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-b3056f53-f51b-4bd7-b680-738a70b3c0cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbe7cf6f7c4840e98efd612efcf9cac6', 'request_id': 'req-b3056f53-f51b-4bd7-b680-738a70b3c0cf'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:34.331062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-b3056f53-f51b-4bd7-b680-738a70b3c0cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbe7cf6f7c4840e98efd612efcf9cac6', 'request_id': 'req-b3056f53-f51b-4bd7-b680-738a70b3c0cf'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:34.352468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-b3056f53-f51b-4bd7-b680-738a70b3c0cf admin admin] The token cache is being invalidate because project dbe7cf6f7c4840e98efd612efcf9cac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:58:34.352468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-b3056f53-f51b-4bd7-b680-738a70b3c0cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:34.352468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-b3056f53-f51b-4bd7-b680-738a70b3c0cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:34.354658 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1081/2165] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:58:34 2022] DELETE /identity/v3/projects/dbe7cf6f7c4840e98efd612efcf9cac6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:34.369907 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3056f53-f51b-4bd7-b680-738a70b3c0cf admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:34.371661 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b3056f53-f51b-4bd7-b680-738a70b3c0cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:34.445361 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eb067-3059-471e-8e67-2e824eb1d646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:34.446712 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eb067-3059-471e-8e67-2e824eb1d646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:34.447031 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eb067-3059-471e-8e67-2e824eb1d646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:34.447374 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eb067-3059-471e-8e67-2e824eb1d646 admin admin] PATH_INFO: `/v3/projects/06563e948ece4aaa9dd3d52e885d513e` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:34.463732 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eb067-3059-471e-8e67-2e824eb1d646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06563e948ece4aaa9dd3d52e885d513e)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:34.463732 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eb067-3059-471e-8e67-2e824eb1d646 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:34.478535 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3056f53-f51b-4bd7-b680-738a70b3c0cf admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:34.487485 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09f927-8c8b-4da6-9c82-c4271c4c4399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:34.488841 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09f927-8c8b-4da6-9c82-c4271c4c4399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:34.489364 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09f927-8c8b-4da6-9c82-c4271c4c4399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:34.489815 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09f927-8c8b-4da6-9c82-c4271c4c4399 admin admin] PATH_INFO: `/v3/users/4305e90af6b545a6b23dbeb1af71ddc4` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:34.491200 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09f927-8c8b-4da6-9c82-c4271c4c4399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4305e90af6b545a6b23dbeb1af71ddc4)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:34.493338 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09f927-8c8b-4da6-9c82-c4271c4c4399 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:34.509422 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a83eb067-3059-471e-8e67-2e824eb1d646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06563e948ece4aaa9dd3d52e885d513e', 'request_id': 'req-a83eb067-3059-471e-8e67-2e824eb1d646'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:34.518310 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a83eb067-3059-471e-8e67-2e824eb1d646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06563e948ece4aaa9dd3d52e885d513e', 'request_id': 'req-a83eb067-3059-471e-8e67-2e824eb1d646'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:34.526182 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a83eb067-3059-471e-8e67-2e824eb1d646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06563e948ece4aaa9dd3d52e885d513e', 'request_id': 'req-a83eb067-3059-471e-8e67-2e824eb1d646'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:34.558572 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a83eb067-3059-471e-8e67-2e824eb1d646 admin admin] The token cache is being invalidate because project 06563e948ece4aaa9dd3d52e885d513e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:58:34.558572 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a83eb067-3059-471e-8e67-2e824eb1d646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:34.559282 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a83eb067-3059-471e-8e67-2e824eb1d646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:34.561896 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1085/2166] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:58:34 2022] DELETE /identity/v3/projects/06563e948ece4aaa9dd3d52e885d513e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:58:34.571285 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055946ee-92bf-4c24-8ca2-6a05d7992254 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:34.571285 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055946ee-92bf-4c24-8ca2-6a05d7992254 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:34.571285 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055946ee-92bf-4c24-8ca2-6a05d7992254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:34.587338 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fe09f927-8c8b-4da6-9c82-c4271c4c4399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4305e90af6b545a6b23dbeb1af71ddc4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:34.588442 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fe09f927-8c8b-4da6-9c82-c4271c4c4399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4305e90af6b545a6b23dbeb1af71ddc4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:34.594393 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-055946ee-92bf-4c24-8ca2-6a05d7992254 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:34.595618 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-055946ee-92bf-4c24-8ca2-6a05d7992254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:34.601700 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fe09f927-8c8b-4da6-9c82-c4271c4c4399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4305e90af6b545a6b23dbeb1af71ddc4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:34.614397 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fe09f927-8c8b-4da6-9c82-c4271c4c4399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4305e90af6b545a6b23dbeb1af71ddc4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:34.629395 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fe09f927-8c8b-4da6-9c82-c4271c4c4399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4305e90af6b545a6b23dbeb1af71ddc4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:34.635308 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1082/2167] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:58:34 2022] DELETE /identity/v3/users/4305e90af6b545a6b23dbeb1af71ddc4 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:34.661687 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1086/2168] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:34.672384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb682be-9270-4095-a9d9-19f51645ecf7 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:34.672657 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb682be-9270-4095-a9d9-19f51645ecf7 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:34.672971 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb682be-9270-4095-a9d9-19f51645ecf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:34.691579 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-5fb682be-9270-4095-a9d9-19f51645ecf7 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:34.692887 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-5fb682be-9270-4095-a9d9-19f51645ecf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:34.788507 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1083/2169] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:58:34.793731 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055946ee-92bf-4c24-8ca2-6a05d7992254 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:34.815536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055946ee-92bf-4c24-8ca2-6a05d7992254 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:34.821291 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966ae6c-f09f-47be-bc0f-e946b8eb26e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:34.822125 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966ae6c-f09f-47be-bc0f-e946b8eb26e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:34.822577 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966ae6c-f09f-47be-bc0f-e946b8eb26e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:34.823036 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966ae6c-f09f-47be-bc0f-e946b8eb26e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:34.823911 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966ae6c-f09f-47be-bc0f-e946b8eb26e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:58:34.824324 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966ae6c-f09f-47be-bc0f-e946b8eb26e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:34.826827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966ae6c-f09f-47be-bc0f-e946b8eb26e2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:34.841091 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1087/2170] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:58:34.846442 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb682be-9270-4095-a9d9-19f51645ecf7 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:34.857033 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb682be-9270-4095-a9d9-19f51645ecf7 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:34.872272 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76148dc-0d3e-4393-b308-d2759d3b14df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:34.873619 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76148dc-0d3e-4393-b308-d2759d3b14df admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:34.874096 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76148dc-0d3e-4393-b308-d2759d3b14df admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:34.874434 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76148dc-0d3e-4393-b308-d2759d3b14df admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:34.875276 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76148dc-0d3e-4393-b308-d2759d3b14df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:34.877590 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76148dc-0d3e-4393-b308-d2759d3b14df admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:34.915462 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1084/2171] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:58:34 2022] POST /identity/v3/projects => generated 397 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:34.921426 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966ae6c-f09f-47be-bc0f-e946b8eb26e2 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:34.936524 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966ae6c-f09f-47be-bc0f-e946b8eb26e2 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:34.982514 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76148dc-0d3e-4393-b308-d2759d3b14df admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:34.984906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-a76148dc-0d3e-4393-b308-d2759d3b14df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:35.049864 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ac429-4769-4a5c-ac8a-1a7156d89f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:35.050618 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ac429-4769-4a5c-ac8a-1a7156d89f47 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:35.050956 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ac429-4769-4a5c-ac8a-1a7156d89f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:35.051295 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ac429-4769-4a5c-ac8a-1a7156d89f47 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:35.052047 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ac429-4769-4a5c-ac8a-1a7156d89f47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:35.054365 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ac429-4769-4a5c-ac8a-1a7156d89f47 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:35.076966 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76148dc-0d3e-4393-b308-d2759d3b14df admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:35.077415 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1088/2172] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:58:34 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:35.081670 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ac429-4769-4a5c-ac8a-1a7156d89f47 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:35.083517 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb3e01-e00c-4392-b7ab-e7f94c099221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:35.086205 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb3e01-e00c-4392-b7ab-e7f94c099221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:35.086205 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb3e01-e00c-4392-b7ab-e7f94c099221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:35.086205 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb3e01-e00c-4392-b7ab-e7f94c099221 admin admin] PATH_INFO: `/v3/projects/5f683b75a27d44eb8d86d7fdb03c4012` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:35.086205 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb3e01-e00c-4392-b7ab-e7f94c099221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f683b75a27d44eb8d86d7fdb03c4012)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:35.088021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb3e01-e00c-4392-b7ab-e7f94c099221 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:35.092766 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ac429-4769-4a5c-ac8a-1a7156d89f47 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:35.097766 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f9f0b-9cb8-4707-8be9-fec04ac67a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:35.098464 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f9f0b-9cb8-4707-8be9-fec04ac67a08 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:35.098743 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f9f0b-9cb8-4707-8be9-fec04ac67a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:35.099035 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f9f0b-9cb8-4707-8be9-fec04ac67a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:35.099787 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f9f0b-9cb8-4707-8be9-fec04ac67a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:35.101414 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f9f0b-9cb8-4707-8be9-fec04ac67a08 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:35.112417 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1089/2173] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:58:35.117065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f9f0b-9cb8-4707-8be9-fec04ac67a08 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:35.128994 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f9f0b-9cb8-4707-8be9-fec04ac67a08 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:35.136287 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-22cb3e01-e00c-4392-b7ab-e7f94c099221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f683b75a27d44eb8d86d7fdb03c4012', 'request_id': 'req-22cb3e01-e00c-4392-b7ab-e7f94c099221'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:35.143082 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-22cb3e01-e00c-4392-b7ab-e7f94c099221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f683b75a27d44eb8d86d7fdb03c4012', 'request_id': 'req-22cb3e01-e00c-4392-b7ab-e7f94c099221'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:35.148719 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-22cb3e01-e00c-4392-b7ab-e7f94c099221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f683b75a27d44eb8d86d7fdb03c4012', 'request_id': 'req-22cb3e01-e00c-4392-b7ab-e7f94c099221'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:35.164132 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-22cb3e01-e00c-4392-b7ab-e7f94c099221 admin admin] The token cache is being invalidate because project 5f683b75a27d44eb8d86d7fdb03c4012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:58:35.164399 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-22cb3e01-e00c-4392-b7ab-e7f94c099221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:35.165187 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-22cb3e01-e00c-4392-b7ab-e7f94c099221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:35.167505 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1085/2174] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:58:34 2022] DELETE /identity/v3/projects/5f683b75a27d44eb8d86d7fdb03c4012 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:35.171488 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb3e01-e00c-4392-b7ab-e7f94c099221 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:35.172991 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-22cb3e01-e00c-4392-b7ab-e7f94c099221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:35.191054 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73def27a-2ab0-4622-8796-882d4fb51f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:35.191707 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73def27a-2ab0-4622-8796-882d4fb51f6a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:35.191980 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73def27a-2ab0-4622-8796-882d4fb51f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:35.192244 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73def27a-2ab0-4622-8796-882d4fb51f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:35.192995 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73def27a-2ab0-4622-8796-882d4fb51f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:35.194578 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73def27a-2ab0-4622-8796-882d4fb51f6a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:35.205511 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1090/2175] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:58:35.211778 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73def27a-2ab0-4622-8796-882d4fb51f6a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:35.214191 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-73def27a-2ab0-4622-8796-882d4fb51f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:35.241326 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73def27a-2ab0-4622-8796-882d4fb51f6a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:35.246909 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bddc6-4ee5-4d33-a488-636d93c074b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:35.247829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bddc6-4ee5-4d33-a488-636d93c074b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:35.248127 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bddc6-4ee5-4d33-a488-636d93c074b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:35.248414 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bddc6-4ee5-4d33-a488-636d93c074b8 admin admin] PATH_INFO: `/v3/projects/9cc4c2ca418b45e48a2e3c2d9e51fd9b/users/252ce25684aa47faad4f97f22d23ca21/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:35.256224 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb3e01-e00c-4392-b7ab-e7f94c099221 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:35.261015 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e80f5-a5fe-47e5-9ba4-c420cf4b72a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:35.261824 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e80f5-a5fe-47e5-9ba4-c420cf4b72a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:35.262106 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e80f5-a5fe-47e5-9ba4-c420cf4b72a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:35.262379 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e80f5-a5fe-47e5-9ba4-c420cf4b72a2 admin admin] PATH_INFO: `/v3/users/030e1f67d94447a6b76ce239feec19f4` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:35.264743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e80f5-a5fe-47e5-9ba4-c420cf4b72a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=030e1f67d94447a6b76ce239feec19f4)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:35.265303 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bddc6-4ee5-4d33-a488-636d93c074b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc4c2ca418b45e48a2e3c2d9e51fd9b, user_id=252ce25684aa47faad4f97f22d23ca21, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:35.266813 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e80f5-a5fe-47e5-9ba4-c420cf4b72a2 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:35.268022 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bddc6-4ee5-4d33-a488-636d93c074b8 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:35.283239 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1091/2176] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:35 2022] PUT /identity/v3/projects/9cc4c2ca418b45e48a2e3c2d9e51fd9b/users/252ce25684aa47faad4f97f22d23ca21/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:35.293454 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b5ca1-1531-4215-b316-4948058e411b None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:35.293737 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b5ca1-1531-4215-b316-4948058e411b None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:35.294011 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b5ca1-1531-4215-b316-4948058e411b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:35.324183 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-ba7e80f5-a5fe-47e5-9ba4-c420cf4b72a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030e1f67d94447a6b76ce239feec19f4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:35.324428 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-775b5ca1-1531-4215-b316-4948058e411b None None] MFA Rules not processed for user `252ce25684aa47faad4f97f22d23ca21`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:35.325152 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-ba7e80f5-a5fe-47e5-9ba4-c420cf4b72a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030e1f67d94447a6b76ce239feec19f4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:35.326217 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-775b5ca1-1531-4215-b316-4948058e411b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:35.335014 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-ba7e80f5-a5fe-47e5-9ba4-c420cf4b72a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030e1f67d94447a6b76ce239feec19f4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:35.344180 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-ba7e80f5-a5fe-47e5-9ba4-c420cf4b72a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030e1f67d94447a6b76ce239feec19f4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:35.366755 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-ba7e80f5-a5fe-47e5-9ba4-c420cf4b72a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030e1f67d94447a6b76ce239feec19f4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:35.382940 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1086/2177] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:58:35 2022] DELETE /identity/v3/users/030e1f67d94447a6b76ce239feec19f4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:58:35.420671 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1092/2178] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:35 2022] POST /identity/v3/auth/tokens => generated 3417 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:58:35.431347 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e80f5-a5fe-47e5-9ba4-c420cf4b72a2 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:35.433661 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ba7e80f5-a5fe-47e5-9ba4-c420cf4b72a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:35.503370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e80f5-a5fe-47e5-9ba4-c420cf4b72a2 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:35.507221 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f9fdb-5766-4eba-904d-5a93e03dcce5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:35.507885 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f9fdb-5766-4eba-904d-5a93e03dcce5 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:35.508320 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f9fdb-5766-4eba-904d-5a93e03dcce5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:35.508611 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f9fdb-5766-4eba-904d-5a93e03dcce5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:35.578716 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f9fdb-5766-4eba-904d-5a93e03dcce5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:35.580350 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f9fdb-5766-4eba-904d-5a93e03dcce5 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:35.590525 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1087/2179] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:35 2022] GET /identity/v3/auth/tokens => generated 3417 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:35.804870 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b5ca1-1531-4215-b316-4948058e411b None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:35.806531 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-775b5ca1-1531-4215-b316-4948058e411b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:35.896485 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b5ca1-1531-4215-b316-4948058e411b None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:35.994124 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22a569-c220-4759-a86e-504db72e1563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:35.995014 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22a569-c220-4759-a86e-504db72e1563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:35.995292 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22a569-c220-4759-a86e-504db72e1563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:35.995563 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22a569-c220-4759-a86e-504db72e1563 admin admin] PATH_INFO: `/v3/projects/32955d8dd19e494e9cd784fe0a718768` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:35.996997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22a569-c220-4759-a86e-504db72e1563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32955d8dd19e494e9cd784fe0a718768)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:36.000026 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22a569-c220-4759-a86e-504db72e1563 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:36.064351 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4e22a569-c220-4759-a86e-504db72e1563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32955d8dd19e494e9cd784fe0a718768', 'request_id': 'req-4e22a569-c220-4759-a86e-504db72e1563'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:36.072416 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4e22a569-c220-4759-a86e-504db72e1563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32955d8dd19e494e9cd784fe0a718768', 'request_id': 'req-4e22a569-c220-4759-a86e-504db72e1563'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:36.081101 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4e22a569-c220-4759-a86e-504db72e1563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32955d8dd19e494e9cd784fe0a718768', 'request_id': 'req-4e22a569-c220-4759-a86e-504db72e1563'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:36.115099 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4e22a569-c220-4759-a86e-504db72e1563 admin admin] The token cache is being invalidate because project 32955d8dd19e494e9cd784fe0a718768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:58:36.115502 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4e22a569-c220-4759-a86e-504db72e1563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:36.116361 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-4e22a569-c220-4759-a86e-504db72e1563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:36.118986 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1093/2180] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:58:35 2022] DELETE /identity/v3/projects/32955d8dd19e494e9cd784fe0a718768 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:58:36.126398 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919fee5-4da5-41de-95c7-3e894e208f68 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:36.126694 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919fee5-4da5-41de-95c7-3e894e208f68 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:36.126981 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919fee5-4da5-41de-95c7-3e894e208f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:36.158392 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-9919fee5-4da5-41de-95c7-3e894e208f68 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:36.159908 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-9919fee5-4da5-41de-95c7-3e894e208f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:36.260627 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1088/2181] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:36 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:36.269477 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bc7de-df8b-4e6e-8299-48dac1442822 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:36.269737 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bc7de-df8b-4e6e-8299-48dac1442822 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:36.270015 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bc7de-df8b-4e6e-8299-48dac1442822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:36.297865 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-8e1bc7de-df8b-4e6e-8299-48dac1442822 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:36.299816 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-8e1bc7de-df8b-4e6e-8299-48dac1442822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:36.311762 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1094/2182] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:36 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:58:36.316528 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919fee5-4da5-41de-95c7-3e894e208f68 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:36.327925 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919fee5-4da5-41de-95c7-3e894e208f68 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:36.333527 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6d9e4-b120-49d1-909c-09f9046ba4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:36.334542 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6d9e4-b120-49d1-909c-09f9046ba4bc admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:36.334647 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6d9e4-b120-49d1-909c-09f9046ba4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:36.334992 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6d9e4-b120-49d1-909c-09f9046ba4bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:36.335792 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6d9e4-b120-49d1-909c-09f9046ba4bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:58:36.336504 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6d9e4-b120-49d1-909c-09f9046ba4bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:36.341882 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6d9e4-b120-49d1-909c-09f9046ba4bc admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:36.355718 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1089/2183] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:58:36.362504 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bc7de-df8b-4e6e-8299-48dac1442822 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:36.373678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bc7de-df8b-4e6e-8299-48dac1442822 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:36.379681 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3a991-96b1-4595-b5c0-c326e8157da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:36.380387 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3a991-96b1-4595-b5c0-c326e8157da3 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:36.380843 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3a991-96b1-4595-b5c0-c326e8157da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:36.381157 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3a991-96b1-4595-b5c0-c326e8157da3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:36.382241 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3a991-96b1-4595-b5c0-c326e8157da3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:36.384431 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3a991-96b1-4595-b5c0-c326e8157da3 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:36.412998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1095/2184] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:58:36 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:58:36.417460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6d9e4-b120-49d1-909c-09f9046ba4bc admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:36.428122 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6d9e4-b120-49d1-909c-09f9046ba4bc admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:36.484347 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56351abc-a544-4b2e-8852-a1a93a23059c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:36.485047 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56351abc-a544-4b2e-8852-a1a93a23059c admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:36.485328 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56351abc-a544-4b2e-8852-a1a93a23059c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:36.485601 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56351abc-a544-4b2e-8852-a1a93a23059c admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:36.486353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56351abc-a544-4b2e-8852-a1a93a23059c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:36.488257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56351abc-a544-4b2e-8852-a1a93a23059c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:36.509469 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1090/2185] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:58:36 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:36.514616 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3a991-96b1-4595-b5c0-c326e8157da3 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:36.525605 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3a991-96b1-4595-b5c0-c326e8157da3 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:36.531870 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f853ba8-b467-48d7-b077-42f04aaa6afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:36.532542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f853ba8-b467-48d7-b077-42f04aaa6afa admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:36.532843 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f853ba8-b467-48d7-b077-42f04aaa6afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:36.533336 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f853ba8-b467-48d7-b077-42f04aaa6afa admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:36.534119 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f853ba8-b467-48d7-b077-42f04aaa6afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:36.535659 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f853ba8-b467-48d7-b077-42f04aaa6afa admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:36.548311 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1096/2186] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:36.553958 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56351abc-a544-4b2e-8852-a1a93a23059c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:36.565651 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56351abc-a544-4b2e-8852-a1a93a23059c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:36.573888 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e1bfb-0932-402b-ac8e-debde7a41d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:36.575139 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e1bfb-0932-402b-ac8e-debde7a41d45 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:36.576469 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e1bfb-0932-402b-ac8e-debde7a41d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:36.576984 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e1bfb-0932-402b-ac8e-debde7a41d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:36.578344 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e1bfb-0932-402b-ac8e-debde7a41d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:36.581506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e1bfb-0932-402b-ac8e-debde7a41d45 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:36.604128 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1091/2187] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:36.609041 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f853ba8-b467-48d7-b077-42f04aaa6afa admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:36.624036 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f853ba8-b467-48d7-b077-42f04aaa6afa admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:36.628933 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388fa0e-ecd9-4ecd-8730-fd31ca2d9b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:36.629850 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388fa0e-ecd9-4ecd-8730-fd31ca2d9b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:36.630119 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388fa0e-ecd9-4ecd-8730-fd31ca2d9b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:36.630460 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388fa0e-ecd9-4ecd-8730-fd31ca2d9b66 admin admin] PATH_INFO: `/v3/projects/3a328d9209d148d193d1e914e2a37438/users/3f7ec1e873374fc1931ea78e25172166/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:36.648053 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388fa0e-ecd9-4ecd-8730-fd31ca2d9b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a328d9209d148d193d1e914e2a37438, user_id=3f7ec1e873374fc1931ea78e25172166, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:36.650713 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388fa0e-ecd9-4ecd-8730-fd31ca2d9b66 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:36.665053 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1097/2188] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:36 2022] PUT /identity/v3/projects/3a328d9209d148d193d1e914e2a37438/users/3f7ec1e873374fc1931ea78e25172166/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:36.675675 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb001a-a0a5-4490-8959-b1584c483f23 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:36.675959 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb001a-a0a5-4490-8959-b1584c483f23 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:36.676232 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb001a-a0a5-4490-8959-b1584c483f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:36.702840 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-49cb001a-a0a5-4490-8959-b1584c483f23 None None] MFA Rules not processed for user `3f7ec1e873374fc1931ea78e25172166`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:36.704087 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-49cb001a-a0a5-4490-8959-b1584c483f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:36.773059 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1092/2189] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:36 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:36.777840 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388fa0e-ecd9-4ecd-8730-fd31ca2d9b66 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:36.840308 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388fa0e-ecd9-4ecd-8730-fd31ca2d9b66 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:36.845908 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa48cd6-5d7f-4e3f-a3ac-d4d0ddf6242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:36.846561 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa48cd6-5d7f-4e3f-a3ac-d4d0ddf6242b admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:36.846836 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa48cd6-5d7f-4e3f-a3ac-d4d0ddf6242b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:36.847108 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa48cd6-5d7f-4e3f-a3ac-d4d0ddf6242b admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:36.847827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa48cd6-5d7f-4e3f-a3ac-d4d0ddf6242b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:36.849728 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa48cd6-5d7f-4e3f-a3ac-d4d0ddf6242b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:36.874541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1098/2190] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:58:36 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:36.878785 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb001a-a0a5-4490-8959-b1584c483f23 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:36.889891 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb001a-a0a5-4490-8959-b1584c483f23 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:36.947435 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb073fe-a263-4ad7-96eb-f9fe40a76e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:36.948125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb073fe-a263-4ad7-96eb-f9fe40a76e7d admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:36.948430 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb073fe-a263-4ad7-96eb-f9fe40a76e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:36.948701 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb073fe-a263-4ad7-96eb-f9fe40a76e7d admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:36.949471 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb073fe-a263-4ad7-96eb-f9fe40a76e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:36.952465 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb073fe-a263-4ad7-96eb-f9fe40a76e7d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:36.973780 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1093/2191] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:58:36 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:58:36.977740 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa48cd6-5d7f-4e3f-a3ac-d4d0ddf6242b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:36.988200 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa48cd6-5d7f-4e3f-a3ac-d4d0ddf6242b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:36.992753 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd0797-b252-4c29-a3cb-741e8c2539ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:36.993439 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd0797-b252-4c29-a3cb-741e8c2539ed admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:36.993716 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd0797-b252-4c29-a3cb-741e8c2539ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:36.993986 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd0797-b252-4c29-a3cb-741e8c2539ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:36.994695 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd0797-b252-4c29-a3cb-741e8c2539ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:36.996259 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd0797-b252-4c29-a3cb-741e8c2539ed admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:37.007854 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1099/2192] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:37.012069 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb073fe-a263-4ad7-96eb-f9fe40a76e7d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:37.022888 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb073fe-a263-4ad7-96eb-f9fe40a76e7d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:37.028141 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b662f8-9d0e-44d4-a529-62fe4d5335f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:37.029057 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b662f8-9d0e-44d4-a529-62fe4d5335f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:37.029533 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b662f8-9d0e-44d4-a529-62fe4d5335f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:37.029840 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b662f8-9d0e-44d4-a529-62fe4d5335f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:37.030587 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b662f8-9d0e-44d4-a529-62fe4d5335f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:37.032232 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b662f8-9d0e-44d4-a529-62fe4d5335f1 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:37.042823 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1094/2193] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:37.047592 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd0797-b252-4c29-a3cb-741e8c2539ed admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:37.057461 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd0797-b252-4c29-a3cb-741e8c2539ed admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:37.062763 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08bfa4-a640-4ea6-8244-e94bf3d9934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:37.063637 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08bfa4-a640-4ea6-8244-e94bf3d9934c admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:37.063912 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08bfa4-a640-4ea6-8244-e94bf3d9934c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:37.064177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08bfa4-a640-4ea6-8244-e94bf3d9934c admin admin] PATH_INFO: `/v3/projects/c097f517f04547f386a74cbf38dca4d9/users/be567f6c2a9743f380f2033d305c75f1/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:37.080760 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08bfa4-a640-4ea6-8244-e94bf3d9934c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c097f517f04547f386a74cbf38dca4d9, user_id=be567f6c2a9743f380f2033d305c75f1, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:37.083525 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08bfa4-a640-4ea6-8244-e94bf3d9934c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:37.099602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1100/2194] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:37 2022] PUT /identity/v3/projects/c097f517f04547f386a74cbf38dca4d9/users/be567f6c2a9743f380f2033d305c75f1/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:37.110898 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c45475-a7d6-46f3-8e5b-8a9d7ecc0e63 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:37.111184 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c45475-a7d6-46f3-8e5b-8a9d7ecc0e63 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:37.111462 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c45475-a7d6-46f3-8e5b-8a9d7ecc0e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:37.140008 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-f9c45475-a7d6-46f3-8e5b-8a9d7ecc0e63 None None] MFA Rules not processed for user `be567f6c2a9743f380f2033d305c75f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:37.141280 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-f9c45475-a7d6-46f3-8e5b-8a9d7ecc0e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:37.207084 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1095/2195] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:37 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:37.211868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08bfa4-a640-4ea6-8244-e94bf3d9934c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:37.275610 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08bfa4-a640-4ea6-8244-e94bf3d9934c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:37.281382 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9bfe0-6137-4fbc-ba9a-3bd2fa0fd9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:37.282087 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9bfe0-6137-4fbc-ba9a-3bd2fa0fd9db admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:37.282397 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9bfe0-6137-4fbc-ba9a-3bd2fa0fd9db admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:37.282681 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9bfe0-6137-4fbc-ba9a-3bd2fa0fd9db admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:37.283441 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9bfe0-6137-4fbc-ba9a-3bd2fa0fd9db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:37.285540 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9bfe0-6137-4fbc-ba9a-3bd2fa0fd9db admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:37.313321 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1101/2196] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:58:37 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:37.317556 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c45475-a7d6-46f3-8e5b-8a9d7ecc0e63 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:37.328690 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c45475-a7d6-46f3-8e5b-8a9d7ecc0e63 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:37.385365 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db3289-f64c-499b-afad-ce678a0457c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:37.385940 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db3289-f64c-499b-afad-ce678a0457c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:37.386216 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db3289-f64c-499b-afad-ce678a0457c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:37.386645 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db3289-f64c-499b-afad-ce678a0457c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:37.387707 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db3289-f64c-499b-afad-ce678a0457c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:37.389737 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db3289-f64c-499b-afad-ce678a0457c7 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:37.414214 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1096/2197] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:58:37 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:37.418682 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9bfe0-6137-4fbc-ba9a-3bd2fa0fd9db admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:37.429763 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9bfe0-6137-4fbc-ba9a-3bd2fa0fd9db admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:37.434652 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8422b55-1065-44f2-8211-268d94dbc7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:37.435997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8422b55-1065-44f2-8211-268d94dbc7ff admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:37.436275 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8422b55-1065-44f2-8211-268d94dbc7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:37.436552 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8422b55-1065-44f2-8211-268d94dbc7ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:37.437305 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8422b55-1065-44f2-8211-268d94dbc7ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:37.438886 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8422b55-1065-44f2-8211-268d94dbc7ff admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:37.449757 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1102/2198] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:37.454052 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db3289-f64c-499b-afad-ce678a0457c7 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:37.463990 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db3289-f64c-499b-afad-ce678a0457c7 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:37.469030 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454087a3-196c-4459-a3a5-9957d09a0732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:37.470221 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454087a3-196c-4459-a3a5-9957d09a0732 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:37.470553 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454087a3-196c-4459-a3a5-9957d09a0732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:37.470832 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454087a3-196c-4459-a3a5-9957d09a0732 admin admin] PATH_INFO: `/v3/projects/508945a25abe4b388fffebbbae8cfba0/users/e4c858653a7d4afba8e3c15a1d2488b4/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:37.487817 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454087a3-196c-4459-a3a5-9957d09a0732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=508945a25abe4b388fffebbbae8cfba0, user_id=e4c858653a7d4afba8e3c15a1d2488b4, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:37.490410 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454087a3-196c-4459-a3a5-9957d09a0732 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:37.505528 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1097/2199] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:37 2022] PUT /identity/v3/projects/508945a25abe4b388fffebbbae8cfba0/users/e4c858653a7d4afba8e3c15a1d2488b4/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:37.509690 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8422b55-1065-44f2-8211-268d94dbc7ff admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:37.519786 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8422b55-1065-44f2-8211-268d94dbc7ff admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:37.620776 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6670991-1169-4574-9267-c0f098bab34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:37.622222 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6670991-1169-4574-9267-c0f098bab34c admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:37.623302 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6670991-1169-4574-9267-c0f098bab34c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:37.623738 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6670991-1169-4574-9267-c0f098bab34c admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:37.625051 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6670991-1169-4574-9267-c0f098bab34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:37.628535 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6670991-1169-4574-9267-c0f098bab34c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:37.644964 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1103/2200] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:37.650482 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454087a3-196c-4459-a3a5-9957d09a0732 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:37.668738 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454087a3-196c-4459-a3a5-9957d09a0732 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:37.676734 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d88e2-814a-4dd6-ae6c-091d5c991986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:37.677871 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d88e2-814a-4dd6-ae6c-091d5c991986 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:37.678215 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d88e2-814a-4dd6-ae6c-091d5c991986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:37.678573 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d88e2-814a-4dd6-ae6c-091d5c991986 admin admin] PATH_INFO: `/v3/projects/508945a25abe4b388fffebbbae8cfba0/users/e4c858653a7d4afba8e3c15a1d2488b4/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:37.680689 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d88e2-814a-4dd6-ae6c-091d5c991986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=508945a25abe4b388fffebbbae8cfba0, user_id=e4c858653a7d4afba8e3c15a1d2488b4, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:37.683480 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d88e2-814a-4dd6-ae6c-091d5c991986 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:37.694917 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1098/2201] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:37 2022] PUT /identity/v3/projects/508945a25abe4b388fffebbbae8cfba0/users/e4c858653a7d4afba8e3c15a1d2488b4/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:37.708259 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933f458-ea49-4cda-a284-002e680b4d0c None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:37.708620 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933f458-ea49-4cda-a284-002e680b4d0c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:37.709282 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933f458-ea49-4cda-a284-002e680b4d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:37.741348 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-f933f458-ea49-4cda-a284-002e680b4d0c None None] MFA Rules not processed for user `e4c858653a7d4afba8e3c15a1d2488b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:37.742557 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-f933f458-ea49-4cda-a284-002e680b4d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:37.836253 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1104/2202] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:37 2022] POST /identity/v3/auth/tokens => generated 3472 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:37.847965 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d88e2-814a-4dd6-ae6c-091d5c991986 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:37.849831 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-4f3d88e2-814a-4dd6-ae6c-091d5c991986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:37.913736 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d88e2-814a-4dd6-ae6c-091d5c991986 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:37.917711 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b0610-f767-4c0e-9911-f1a96c800172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:37.918535 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b0610-f767-4c0e-9911-f1a96c800172 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:37.918920 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b0610-f767-4c0e-9911-f1a96c800172 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:37.919343 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b0610-f767-4c0e-9911-f1a96c800172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:37.984674 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b0610-f767-4c0e-9911-f1a96c800172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:37.986725 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b0610-f767-4c0e-9911-f1a96c800172 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:37.996290 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1099/2203] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:37 2022] GET /identity/v3/auth/tokens => generated 3405 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:40.591157 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933f458-ea49-4cda-a284-002e680b4d0c None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:40.592611 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-f933f458-ea49-4cda-a284-002e680b4d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:40.604602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933f458-ea49-4cda-a284-002e680b4d0c None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:40.609020 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f14ac3-b7f2-4c90-8c41-76ad5350f38d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:40.609716 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f14ac3-b7f2-4c90-8c41-76ad5350f38d service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:40.610017 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f14ac3-b7f2-4c90-8c41-76ad5350f38d service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:40.610346 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f14ac3-b7f2-4c90-8c41-76ad5350f38d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:40.670961 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f14ac3-b7f2-4c90-8c41-76ad5350f38d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:40.672445 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f14ac3-b7f2-4c90-8c41-76ad5350f38d service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:40.682290 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1105/2204] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:40 2022] GET /identity/v3/auth/tokens => generated 3405 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:42.798595 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b0610-f767-4c0e-9911-f1a96c800172 service cinder] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:42.807375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b0610-f767-4c0e-9911-f1a96c800172 service cinder] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:42.811135 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500e386-2d26-4054-bfe2-cddd0c62f3b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:42.811782 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500e386-2d26-4054-bfe2-cddd0c62f3b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:42.812147 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500e386-2d26-4054-bfe2-cddd0c62f3b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:42.812384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500e386-2d26-4054-bfe2-cddd0c62f3b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:42.822014 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500e386-2d26-4054-bfe2-cddd0c62f3b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:42.823460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500e386-2d26-4054-bfe2-cddd0c62f3b1 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:42.834136 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1100/2205] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:42 2022] GET /identity/v3/auth/tokens => generated 3472 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:45.952497 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f14ac3-b7f2-4c90-8c41-76ad5350f38d service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:45.957306 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a8f14ac3-b7f2-4c90-8c41-76ad5350f38d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:46.059540 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f14ac3-b7f2-4c90-8c41-76ad5350f38d service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:46.066370 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e2194-cb2b-4f74-bc0b-793e6989d117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:46.067707 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e2194-cb2b-4f74-bc0b-793e6989d117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:46.068173 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e2194-cb2b-4f74-bc0b-793e6989d117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:46.068706 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e2194-cb2b-4f74-bc0b-793e6989d117 admin admin] PATH_INFO: `/v3/users/2519bec1ff2641789a40bd3669e71c78` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:46.070451 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e2194-cb2b-4f74-bc0b-793e6989d117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2519bec1ff2641789a40bd3669e71c78)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:46.072665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e2194-cb2b-4f74-bc0b-793e6989d117 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:46.162686 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-956e2194-cb2b-4f74-bc0b-793e6989d117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2519bec1ff2641789a40bd3669e71c78'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:46.163738 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-956e2194-cb2b-4f74-bc0b-793e6989d117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2519bec1ff2641789a40bd3669e71c78'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:46.163927 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-956e2194-cb2b-4f74-bc0b-793e6989d117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2519bec1ff2641789a40bd3669e71c78'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:46.172641 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-956e2194-cb2b-4f74-bc0b-793e6989d117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2519bec1ff2641789a40bd3669e71c78'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:46.182230 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-956e2194-cb2b-4f74-bc0b-793e6989d117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2519bec1ff2641789a40bd3669e71c78'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:46.200331 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1106/2206] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:58:45 2022] DELETE /identity/v3/users/2519bec1ff2641789a40bd3669e71c78 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:46.205469 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f0ef4-80ae-40be-b8c9-eadb6f0da628 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:46.206022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f0ef4-80ae-40be-b8c9-eadb6f0da628 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:46.206022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f0ef4-80ae-40be-b8c9-eadb6f0da628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:46.223704 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-890f0ef4-80ae-40be-b8c9-eadb6f0da628 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:46.224976 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-890f0ef4-80ae-40be-b8c9-eadb6f0da628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:46.286536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1101/2207] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:46 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:46.298621 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e2194-cb2b-4f74-bc0b-793e6989d117 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:46.300044 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-956e2194-cb2b-4f74-bc0b-793e6989d117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:46.365266 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e2194-cb2b-4f74-bc0b-793e6989d117 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:46.368944 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa31f2d-2c39-4e57-95bb-d52672f0087c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:46.369594 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa31f2d-2c39-4e57-95bb-d52672f0087c service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:46.369872 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa31f2d-2c39-4e57-95bb-d52672f0087c service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:46.370144 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa31f2d-2c39-4e57-95bb-d52672f0087c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:46.380280 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa31f2d-2c39-4e57-95bb-d52672f0087c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:46.381743 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa31f2d-2c39-4e57-95bb-d52672f0087c service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:46.391544 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1107/2208] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:46 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:46.738703 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f0ef4-80ae-40be-b8c9-eadb6f0da628 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:46.741334 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-890f0ef4-80ae-40be-b8c9-eadb6f0da628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:46.755159 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f0ef4-80ae-40be-b8c9-eadb6f0da628 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:46.764342 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aaf595-d26f-4c10-ad7b-e74e6469c60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:46.769003 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aaf595-d26f-4c10-ad7b-e74e6469c60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:46.769579 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aaf595-d26f-4c10-ad7b-e74e6469c60d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:46.770032 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aaf595-d26f-4c10-ad7b-e74e6469c60d admin admin] PATH_INFO: `/v3/projects/905fbb6b5d0248fe8c7209eff78272b4` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:46.771836 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aaf595-d26f-4c10-ad7b-e74e6469c60d admin admin] RBAC: Authorizing `identity:delete_project(project_id=905fbb6b5d0248fe8c7209eff78272b4)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:46.776072 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aaf595-d26f-4c10-ad7b-e74e6469c60d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:46.845620 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-f6aaf595-d26f-4c10-ad7b-e74e6469c60d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '905fbb6b5d0248fe8c7209eff78272b4', 'request_id': 'req-f6aaf595-d26f-4c10-ad7b-e74e6469c60d'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:46.855724 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-f6aaf595-d26f-4c10-ad7b-e74e6469c60d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '905fbb6b5d0248fe8c7209eff78272b4', 'request_id': 'req-f6aaf595-d26f-4c10-ad7b-e74e6469c60d'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:46.862422 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-f6aaf595-d26f-4c10-ad7b-e74e6469c60d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '905fbb6b5d0248fe8c7209eff78272b4', 'request_id': 'req-f6aaf595-d26f-4c10-ad7b-e74e6469c60d'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:46.880422 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-f6aaf595-d26f-4c10-ad7b-e74e6469c60d admin admin] The token cache is being invalidate because project 905fbb6b5d0248fe8c7209eff78272b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:58:46.881485 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-f6aaf595-d26f-4c10-ad7b-e74e6469c60d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:46.885545 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-f6aaf595-d26f-4c10-ad7b-e74e6469c60d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:46.887387 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1102/2209] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:58:46 2022] DELETE /identity/v3/projects/905fbb6b5d0248fe8c7209eff78272b4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:46.894821 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d4912-4d72-4e0c-8967-7f038f4ec8be None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:46.894967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d4912-4d72-4e0c-8967-7f038f4ec8be None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:46.895243 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d4912-4d72-4e0c-8967-7f038f4ec8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:46.920561 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-772d4912-4d72-4e0c-8967-7f038f4ec8be None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:46.922334 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-772d4912-4d72-4e0c-8967-7f038f4ec8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:47.002006 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1108/2210] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:46 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:47.004375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e57cec-09ef-4e2c-b67f-89864ac52532 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.004741 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e57cec-09ef-4e2c-b67f-89864ac52532 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.009309 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e57cec-09ef-4e2c-b67f-89864ac52532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.038869 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-68e57cec-09ef-4e2c-b67f-89864ac52532 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:47.040328 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-68e57cec-09ef-4e2c-b67f-89864ac52532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:47.050621 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1103/2211] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:47 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:47.054977 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d4912-4d72-4e0c-8967-7f038f4ec8be None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:47.067304 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d4912-4d72-4e0c-8967-7f038f4ec8be None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:47.076106 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1ff32-9127-411b-a04f-aa487b5e4e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:47.077298 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1ff32-9127-411b-a04f-aa487b5e4e4e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.078469 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1ff32-9127-411b-a04f-aa487b5e4e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.078877 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1ff32-9127-411b-a04f-aa487b5e4e4e admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.079733 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1ff32-9127-411b-a04f-aa487b5e4e4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:58:47.080104 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1ff32-9127-411b-a04f-aa487b5e4e4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:47.082026 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1ff32-9127-411b-a04f-aa487b5e4e4e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:47.100917 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1109/2212] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:58:47.101980 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e57cec-09ef-4e2c-b67f-89864ac52532 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:47.113571 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e57cec-09ef-4e2c-b67f-89864ac52532 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:47.118520 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4b848-8625-4167-a2cb-e69ba0d18b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:47.119177 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4b848-8625-4167-a2cb-e69ba0d18b66 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.119447 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4b848-8625-4167-a2cb-e69ba0d18b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.119712 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4b848-8625-4167-a2cb-e69ba0d18b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.120400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4b848-8625-4167-a2cb-e69ba0d18b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:47.123263 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4b848-8625-4167-a2cb-e69ba0d18b66 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:47.131561 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1ff32-9127-411b-a04f-aa487b5e4e4e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:47.133348 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c3d1ff32-9127-411b-a04f-aa487b5e4e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:47.148140 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1ff32-9127-411b-a04f-aa487b5e4e4e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:47.154471 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1104/2213] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:58:47 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:58:47.154655 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f80ac-e91d-4a69-ab0a-159571cb6842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:47.154655 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f80ac-e91d-4a69-ab0a-159571cb6842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.154655 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f80ac-e91d-4a69-ab0a-159571cb6842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.154655 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f80ac-e91d-4a69-ab0a-159571cb6842 admin admin] PATH_INFO: `/v3/users/252ce25684aa47faad4f97f22d23ca21` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.155311 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4b848-8625-4167-a2cb-e69ba0d18b66 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:47.155860 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f80ac-e91d-4a69-ab0a-159571cb6842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=252ce25684aa47faad4f97f22d23ca21)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:47.157816 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f80ac-e91d-4a69-ab0a-159571cb6842 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:47.209340 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-328f80ac-e91d-4a69-ab0a-159571cb6842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252ce25684aa47faad4f97f22d23ca21'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:47.209997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-328f80ac-e91d-4a69-ab0a-159571cb6842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252ce25684aa47faad4f97f22d23ca21'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:47.210615 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-328f80ac-e91d-4a69-ab0a-159571cb6842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252ce25684aa47faad4f97f22d23ca21'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:47.218024 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-328f80ac-e91d-4a69-ab0a-159571cb6842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252ce25684aa47faad4f97f22d23ca21'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:47.224273 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4b848-8625-4167-a2cb-e69ba0d18b66 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:47.225297 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-328f80ac-e91d-4a69-ab0a-159571cb6842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252ce25684aa47faad4f97f22d23ca21'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:47.229273 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1ccc7-9e6f-474e-aea7-019705b26768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:47.229933 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1ccc7-9e6f-474e-aea7-019705b26768 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.230212 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1ccc7-9e6f-474e-aea7-019705b26768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.230482 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1ccc7-9e6f-474e-aea7-019705b26768 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.231156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1ccc7-9e6f-474e-aea7-019705b26768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:47.233659 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1ccc7-9e6f-474e-aea7-019705b26768 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:47.244980 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1110/2214] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:58:47 2022] DELETE /identity/v3/users/252ce25684aa47faad4f97f22d23ca21 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:58:47.249260 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d86f97-2083-45e3-bac3-021e741051c1 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.249628 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d86f97-2083-45e3-bac3-021e741051c1 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.249906 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d86f97-2083-45e3-bac3-021e741051c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.257654 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1105/2215] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:58:47 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:58:47.258762 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1ccc7-9e6f-474e-aea7-019705b26768 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:47.260368 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-16d1ccc7-9e6f-474e-aea7-019705b26768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:47.268283 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-a8d86f97-2083-45e3-bac3-021e741051c1 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:47.269662 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a8d86f97-2083-45e3-bac3-021e741051c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:47.272991 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1ccc7-9e6f-474e-aea7-019705b26768 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:47.325897 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36f029-e684-42f5-803e-9454c96a01fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:47.326566 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36f029-e684-42f5-803e-9454c96a01fa admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.326850 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36f029-e684-42f5-803e-9454c96a01fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.327120 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36f029-e684-42f5-803e-9454c96a01fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.327829 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36f029-e684-42f5-803e-9454c96a01fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:47.328296 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1111/2216] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:47 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:47.329591 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36f029-e684-42f5-803e-9454c96a01fa admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:47.338696 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d86f97-2083-45e3-bac3-021e741051c1 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:47.343357 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1106/2217] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:58:47.343517 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a8d86f97-2083-45e3-bac3-021e741051c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:47.344417 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36f029-e684-42f5-803e-9454c96a01fa admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:47.353790 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36f029-e684-42f5-803e-9454c96a01fa admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:47.358668 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93acee5-e130-41f9-907e-20ae7a3f1cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:47.359314 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93acee5-e130-41f9-907e-20ae7a3f1cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.359601 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93acee5-e130-41f9-907e-20ae7a3f1cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.359898 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93acee5-e130-41f9-907e-20ae7a3f1cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.360639 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93acee5-e130-41f9-907e-20ae7a3f1cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:47.362251 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93acee5-e130-41f9-907e-20ae7a3f1cfe admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:47.372052 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1107/2218] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:58:47.376040 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93acee5-e130-41f9-907e-20ae7a3f1cfe admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:47.385353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93acee5-e130-41f9-907e-20ae7a3f1cfe admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:47.391102 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10d409-ceef-4c74-906c-81e7fba20f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:47.391985 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10d409-ceef-4c74-906c-81e7fba20f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.392259 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10d409-ceef-4c74-906c-81e7fba20f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.392533 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10d409-ceef-4c74-906c-81e7fba20f26 admin admin] PATH_INFO: `/v3/projects/e22cd868f1be4fbd8f50c9232cdd7281/users/03044ab6cbce4e48a10dacb48d7bbeb8/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.396636 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d86f97-2083-45e3-bac3-021e741051c1 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:47.400323 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5233213-8081-443e-b6c1-1b339b7136d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:47.401013 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5233213-8081-443e-b6c1-1b339b7136d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.401291 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5233213-8081-443e-b6c1-1b339b7136d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.401813 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5233213-8081-443e-b6c1-1b339b7136d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.407832 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10d409-ceef-4c74-906c-81e7fba20f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22cd868f1be4fbd8f50c9232cdd7281, user_id=03044ab6cbce4e48a10dacb48d7bbeb8, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:47.410481 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10d409-ceef-4c74-906c-81e7fba20f26 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:47.411594 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5233213-8081-443e-b6c1-1b339b7136d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:47.413052 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5233213-8081-443e-b6c1-1b339b7136d0 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:47.424971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1112/2219] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:47 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:58:47.426016 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1108/2220] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:47 2022] PUT /identity/v3/projects/e22cd868f1be4fbd8f50c9232cdd7281/users/03044ab6cbce4e48a10dacb48d7bbeb8/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:58:47.436586 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5241-c2cb-4c3e-97d9-1d6dde5f17be None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.437125 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5241-c2cb-4c3e-97d9-1d6dde5f17be None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.437573 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5241-c2cb-4c3e-97d9-1d6dde5f17be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.468842 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-254e5241-c2cb-4c3e-97d9-1d6dde5f17be None None] MFA Rules not processed for user `03044ab6cbce4e48a10dacb48d7bbeb8`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:47.469977 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-254e5241-c2cb-4c3e-97d9-1d6dde5f17be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:47.556157 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1113/2221] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:47 2022] POST /identity/v3/auth/tokens => generated 3393 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:47.563331 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10d409-ceef-4c74-906c-81e7fba20f26 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:47.565564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ab10d409-ceef-4c74-906c-81e7fba20f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:47.639782 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10d409-ceef-4c74-906c-81e7fba20f26 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:47.644371 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db8ed6-45a6-4895-827f-bec1e0e1c2b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:47.645112 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db8ed6-45a6-4895-827f-bec1e0e1c2b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.645390 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db8ed6-45a6-4895-827f-bec1e0e1c2b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.645664 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db8ed6-45a6-4895-827f-bec1e0e1c2b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.654863 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db8ed6-45a6-4895-827f-bec1e0e1c2b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:47.656304 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db8ed6-45a6-4895-827f-bec1e0e1c2b2 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:47.665600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1109/2222] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:47 2022] GET /identity/v3/auth/tokens => generated 3393 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:47.724202 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e5241-c2cb-4c3e-97d9-1d6dde5f17be None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:47.726242 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-254e5241-c2cb-4c3e-97d9-1d6dde5f17be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:47.809431 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e5241-c2cb-4c3e-97d9-1d6dde5f17be None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:47.814655 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53157282-badc-4ff7-ad45-d35517519f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:47.815727 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53157282-badc-4ff7-ad45-d35517519f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.816008 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53157282-badc-4ff7-ad45-d35517519f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.816289 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53157282-badc-4ff7-ad45-d35517519f54 admin admin] PATH_INFO: `/v3/projects/9cc4c2ca418b45e48a2e3c2d9e51fd9b` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.817541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53157282-badc-4ff7-ad45-d35517519f54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc4c2ca418b45e48a2e3c2d9e51fd9b)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:47.819768 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53157282-badc-4ff7-ad45-d35517519f54 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:47.875570 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-53157282-badc-4ff7-ad45-d35517519f54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc4c2ca418b45e48a2e3c2d9e51fd9b', 'request_id': 'req-53157282-badc-4ff7-ad45-d35517519f54'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:47.882786 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-53157282-badc-4ff7-ad45-d35517519f54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc4c2ca418b45e48a2e3c2d9e51fd9b', 'request_id': 'req-53157282-badc-4ff7-ad45-d35517519f54'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:47.889092 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-53157282-badc-4ff7-ad45-d35517519f54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc4c2ca418b45e48a2e3c2d9e51fd9b', 'request_id': 'req-53157282-badc-4ff7-ad45-d35517519f54'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:47.902246 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-53157282-badc-4ff7-ad45-d35517519f54 admin admin] The token cache is being invalidate because project 9cc4c2ca418b45e48a2e3c2d9e51fd9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:58:47.902541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-53157282-badc-4ff7-ad45-d35517519f54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:47.903320 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-53157282-badc-4ff7-ad45-d35517519f54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:47.905798 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1114/2223] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:58:47 2022] DELETE /identity/v3/projects/9cc4c2ca418b45e48a2e3c2d9e51fd9b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:47.911957 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed9bc9-d3c8-462b-afbc-65fed9528964 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.912368 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed9bc9-d3c8-462b-afbc-65fed9528964 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.912576 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed9bc9-d3c8-462b-afbc-65fed9528964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.934179 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-6bed9bc9-d3c8-462b-afbc-65fed9528964 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:47.937463 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-6bed9bc9-d3c8-462b-afbc-65fed9528964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:48.139742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1110/2224] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:47 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:48.149280 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6aa726-8cc4-48ce-97de-72d858dc13f7 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:48.149760 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6aa726-8cc4-48ce-97de-72d858dc13f7 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:48.149861 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6aa726-8cc4-48ce-97de-72d858dc13f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:48.172552 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-bd6aa726-8cc4-48ce-97de-72d858dc13f7 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:48.174526 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-bd6aa726-8cc4-48ce-97de-72d858dc13f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:48.188384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed9bc9-d3c8-462b-afbc-65fed9528964 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:48.198558 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed9bc9-d3c8-462b-afbc-65fed9528964 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:48.199557 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1115/2225] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:48.206343 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55660272-3cb4-4a73-9d61-c45e53e0e3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:48.207014 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55660272-3cb4-4a73-9d61-c45e53e0e3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:48.207289 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55660272-3cb4-4a73-9d61-c45e53e0e3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:48.207560 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55660272-3cb4-4a73-9d61-c45e53e0e3d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:48.208279 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55660272-3cb4-4a73-9d61-c45e53e0e3d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:58:48.208638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55660272-3cb4-4a73-9d61-c45e53e0e3d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:48.215271 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55660272-3cb4-4a73-9d61-c45e53e0e3d7 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:48.218508 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6aa726-8cc4-48ce-97de-72d858dc13f7 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:48.220401 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-bd6aa726-8cc4-48ce-97de-72d858dc13f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:48.231879 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1111/2226] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:58:48.237179 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55660272-3cb4-4a73-9d61-c45e53e0e3d7 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:48.238216 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6aa726-8cc4-48ce-97de-72d858dc13f7 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:48.243914 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b76d2-3b21-4ad1-af58-43327b9e31e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:48.244826 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b76d2-3b21-4ad1-af58-43327b9e31e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:48.245129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b76d2-3b21-4ad1-af58-43327b9e31e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:48.245411 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b76d2-3b21-4ad1-af58-43327b9e31e6 admin admin] PATH_INFO: `/v3/users/3f7ec1e873374fc1931ea78e25172166` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:48.246870 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b76d2-3b21-4ad1-af58-43327b9e31e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f7ec1e873374fc1931ea78e25172166)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:48.249523 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b76d2-3b21-4ad1-af58-43327b9e31e6 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:48.250606 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55660272-3cb4-4a73-9d61-c45e53e0e3d7 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:48.255945 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f0793-217c-4f0c-9adb-c422273e017b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:48.256943 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f0793-217c-4f0c-9adb-c422273e017b admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:48.257428 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f0793-217c-4f0c-9adb-c422273e017b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:48.257903 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f0793-217c-4f0c-9adb-c422273e017b admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:48.258988 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f0793-217c-4f0c-9adb-c422273e017b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:48.262641 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f0793-217c-4f0c-9adb-c422273e017b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:48.295751 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1112/2227] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:58:48 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:48.299519 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f0793-217c-4f0c-9adb-c422273e017b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:48.303220 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a74b76d2-3b21-4ad1-af58-43327b9e31e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f7ec1e873374fc1931ea78e25172166'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:48.303944 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a74b76d2-3b21-4ad1-af58-43327b9e31e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f7ec1e873374fc1931ea78e25172166'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:48.305152 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a74b76d2-3b21-4ad1-af58-43327b9e31e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f7ec1e873374fc1931ea78e25172166'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:48.314936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a74b76d2-3b21-4ad1-af58-43327b9e31e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f7ec1e873374fc1931ea78e25172166'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:48.326283 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a74b76d2-3b21-4ad1-af58-43327b9e31e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f7ec1e873374fc1931ea78e25172166'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:48.345500 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1116/2228] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:58:48 2022] DELETE /identity/v3/users/3f7ec1e873374fc1931ea78e25172166 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:48.349930 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbf142-a28e-4338-a1c2-680378c5f4bb None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:48.350216 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbf142-a28e-4338-a1c2-680378c5f4bb None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:48.350493 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbf142-a28e-4338-a1c2-680378c5f4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:48.368723 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-3edbf142-a28e-4338-a1c2-680378c5f4bb None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:48.370021 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-3edbf142-a28e-4338-a1c2-680378c5f4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:48.377512 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f0793-217c-4f0c-9adb-c422273e017b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:48.431811 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1117/2229] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:58:48.442512 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbf142-a28e-4338-a1c2-680378c5f4bb None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:48.442706 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1622b-635a-445d-adcb-624d013926fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:48.443297 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1622b-635a-445d-adcb-624d013926fb admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:48.443577 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1622b-635a-445d-adcb-624d013926fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:48.444131 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1622b-635a-445d-adcb-624d013926fb admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:48.444259 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-3edbf142-a28e-4338-a1c2-680378c5f4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:48.444548 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1622b-635a-445d-adcb-624d013926fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:48.446505 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1622b-635a-445d-adcb-624d013926fb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:48.469159 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1113/2230] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:58:48 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:48.473191 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1622b-635a-445d-adcb-624d013926fb admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:48.474832 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-29a1622b-635a-445d-adcb-624d013926fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:48.486533 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1622b-635a-445d-adcb-624d013926fb admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:48.509707 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee78cb7-8486-4039-b822-eabba1539422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:48.510387 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee78cb7-8486-4039-b822-eabba1539422 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:48.510663 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee78cb7-8486-4039-b822-eabba1539422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:48.510932 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee78cb7-8486-4039-b822-eabba1539422 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:48.511658 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee78cb7-8486-4039-b822-eabba1539422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:48.513471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbf142-a28e-4338-a1c2-680378c5f4bb None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:48.513643 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee78cb7-8486-4039-b822-eabba1539422 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:48.517970 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92657b4c-b5ee-4a79-9ea7-85c11c5a08ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:48.518515 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92657b4c-b5ee-4a79-9ea7-85c11c5a08ae service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:48.518794 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92657b4c-b5ee-4a79-9ea7-85c11c5a08ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:48.519068 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92657b4c-b5ee-4a79-9ea7-85c11c5a08ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:48.529285 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1114/2231] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:58:48.529509 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92657b4c-b5ee-4a79-9ea7-85c11c5a08ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:48.530860 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92657b4c-b5ee-4a79-9ea7-85c11c5a08ae service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:48.534787 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee78cb7-8486-4039-b822-eabba1539422 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:48.543145 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1118/2232] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:48 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:58:48.550400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee78cb7-8486-4039-b822-eabba1539422 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:48.554670 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d5f65-b57b-4f70-b887-0156f788de43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:48.555693 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d5f65-b57b-4f70-b887-0156f788de43 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:48.556224 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d5f65-b57b-4f70-b887-0156f788de43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:48.556507 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d5f65-b57b-4f70-b887-0156f788de43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:48.557763 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d5f65-b57b-4f70-b887-0156f788de43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:48.559491 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d5f65-b57b-4f70-b887-0156f788de43 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:48.574266 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1115/2233] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:58:48.579191 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92657b4c-b5ee-4a79-9ea7-85c11c5a08ae service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:48.589730 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92657b4c-b5ee-4a79-9ea7-85c11c5a08ae service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:48.596287 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812fc0c-308c-4994-b18f-0eef878b2e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:48.597336 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812fc0c-308c-4994-b18f-0eef878b2e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:48.597617 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812fc0c-308c-4994-b18f-0eef878b2e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:48.597960 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812fc0c-308c-4994-b18f-0eef878b2e2b admin admin] PATH_INFO: `/v3/projects/50b9208765264efbb2e25f5ba4896b4a/users/a315151d7ab945cbbbe4c88adc4b7203/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:48.619075 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812fc0c-308c-4994-b18f-0eef878b2e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b9208765264efbb2e25f5ba4896b4a, user_id=a315151d7ab945cbbbe4c88adc4b7203, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:48.624420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812fc0c-308c-4994-b18f-0eef878b2e2b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:48.645012 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1119/2234] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:48 2022] PUT /identity/v3/projects/50b9208765264efbb2e25f5ba4896b4a/users/a315151d7ab945cbbbe4c88adc4b7203/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:48.647795 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac801ff-2612-47ad-b3bc-582f4c5887cd None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:48.648087 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac801ff-2612-47ad-b3bc-582f4c5887cd None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:48.648359 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac801ff-2612-47ad-b3bc-582f4c5887cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:48.669300 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-6ac801ff-2612-47ad-b3bc-582f4c5887cd None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:48.670609 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-6ac801ff-2612-47ad-b3bc-582f4c5887cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:48.731821 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1116/2235] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:48.742458 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812fc0c-308c-4994-b18f-0eef878b2e2b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:48.744654 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-e812fc0c-308c-4994-b18f-0eef878b2e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:48.813161 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812fc0c-308c-4994-b18f-0eef878b2e2b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:48.816387 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77714b-0c9c-46f1-aeb2-e9f74752349a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:48.817217 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77714b-0c9c-46f1-aeb2-e9f74752349a service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:48.817337 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77714b-0c9c-46f1-aeb2-e9f74752349a service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:48.817608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77714b-0c9c-46f1-aeb2-e9f74752349a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:48.828858 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77714b-0c9c-46f1-aeb2-e9f74752349a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:48.830402 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77714b-0c9c-46f1-aeb2-e9f74752349a service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:48.841717 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1120/2236] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:48 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:48.922536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac801ff-2612-47ad-b3bc-582f4c5887cd None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:48.924035 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-6ac801ff-2612-47ad-b3bc-582f4c5887cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:48.937440 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac801ff-2612-47ad-b3bc-582f4c5887cd None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:48.942282 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50856260-bd8d-4673-92dd-e3bbc19aa974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:48.943241 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50856260-bd8d-4673-92dd-e3bbc19aa974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:48.943588 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50856260-bd8d-4673-92dd-e3bbc19aa974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:48.943928 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50856260-bd8d-4673-92dd-e3bbc19aa974 admin admin] PATH_INFO: `/v3/projects/3a328d9209d148d193d1e914e2a37438` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:48.945170 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50856260-bd8d-4673-92dd-e3bbc19aa974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a328d9209d148d193d1e914e2a37438)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:48.947064 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50856260-bd8d-4673-92dd-e3bbc19aa974 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:49.018399 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-50856260-bd8d-4673-92dd-e3bbc19aa974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a328d9209d148d193d1e914e2a37438', 'request_id': 'req-50856260-bd8d-4673-92dd-e3bbc19aa974'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.025346 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-50856260-bd8d-4673-92dd-e3bbc19aa974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a328d9209d148d193d1e914e2a37438', 'request_id': 'req-50856260-bd8d-4673-92dd-e3bbc19aa974'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.032487 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-50856260-bd8d-4673-92dd-e3bbc19aa974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a328d9209d148d193d1e914e2a37438', 'request_id': 'req-50856260-bd8d-4673-92dd-e3bbc19aa974'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.046249 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-50856260-bd8d-4673-92dd-e3bbc19aa974 admin admin] The token cache is being invalidate because project 3a328d9209d148d193d1e914e2a37438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:58:49.046739 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-50856260-bd8d-4673-92dd-e3bbc19aa974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.047312 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-50856260-bd8d-4673-92dd-e3bbc19aa974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.049051 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1117/2237] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:58:48 2022] DELETE /identity/v3/projects/3a328d9209d148d193d1e914e2a37438 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:49.053090 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77714b-0c9c-46f1-aeb2-e9f74752349a service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:49.065327 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77714b-0c9c-46f1-aeb2-e9f74752349a service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:49.126332 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd3f40-eddb-4f5b-97a6-ab88d4314fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:49.126929 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd3f40-eddb-4f5b-97a6-ab88d4314fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:49.127287 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd3f40-eddb-4f5b-97a6-ab88d4314fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:49.127591 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd3f40-eddb-4f5b-97a6-ab88d4314fb9 admin admin] PATH_INFO: `/v3/users/be567f6c2a9743f380f2033d305c75f1` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:49.129128 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd3f40-eddb-4f5b-97a6-ab88d4314fb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be567f6c2a9743f380f2033d305c75f1)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:49.131795 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd3f40-eddb-4f5b-97a6-ab88d4314fb9 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:49.186614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-b8fd3f40-eddb-4f5b-97a6-ab88d4314fb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be567f6c2a9743f380f2033d305c75f1'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.186614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-b8fd3f40-eddb-4f5b-97a6-ab88d4314fb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be567f6c2a9743f380f2033d305c75f1'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.187263 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-b8fd3f40-eddb-4f5b-97a6-ab88d4314fb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be567f6c2a9743f380f2033d305c75f1'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.195099 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-b8fd3f40-eddb-4f5b-97a6-ab88d4314fb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be567f6c2a9743f380f2033d305c75f1'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.207019 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-b8fd3f40-eddb-4f5b-97a6-ab88d4314fb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be567f6c2a9743f380f2033d305c75f1'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.229652 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1121/2238] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:58:49 2022] DELETE /identity/v3/users/be567f6c2a9743f380f2033d305c75f1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:49.547130 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50856260-bd8d-4673-92dd-e3bbc19aa974 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:49.548617 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-50856260-bd8d-4673-92dd-e3bbc19aa974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:49.563972 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50856260-bd8d-4673-92dd-e3bbc19aa974 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:49.633437 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5158e2a-acc3-4d27-b8c4-8014bbfcceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:49.634377 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5158e2a-acc3-4d27-b8c4-8014bbfcceb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:49.634736 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5158e2a-acc3-4d27-b8c4-8014bbfcceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:49.634957 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5158e2a-acc3-4d27-b8c4-8014bbfcceb7 admin admin] PATH_INFO: `/v3/projects/c097f517f04547f386a74cbf38dca4d9` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:49.636240 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5158e2a-acc3-4d27-b8c4-8014bbfcceb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c097f517f04547f386a74cbf38dca4d9)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:49.638257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5158e2a-acc3-4d27-b8c4-8014bbfcceb7 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:49.703800 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e5158e2a-acc3-4d27-b8c4-8014bbfcceb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c097f517f04547f386a74cbf38dca4d9', 'request_id': 'req-e5158e2a-acc3-4d27-b8c4-8014bbfcceb7'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.710517 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e5158e2a-acc3-4d27-b8c4-8014bbfcceb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c097f517f04547f386a74cbf38dca4d9', 'request_id': 'req-e5158e2a-acc3-4d27-b8c4-8014bbfcceb7'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.717428 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e5158e2a-acc3-4d27-b8c4-8014bbfcceb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c097f517f04547f386a74cbf38dca4d9', 'request_id': 'req-e5158e2a-acc3-4d27-b8c4-8014bbfcceb7'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.733227 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e5158e2a-acc3-4d27-b8c4-8014bbfcceb7 admin admin] The token cache is being invalidate because project c097f517f04547f386a74cbf38dca4d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:58:49.733542 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e5158e2a-acc3-4d27-b8c4-8014bbfcceb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.734497 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e5158e2a-acc3-4d27-b8c4-8014bbfcceb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.736101 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1118/2239] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:58:49 2022] DELETE /identity/v3/projects/c097f517f04547f386a74cbf38dca4d9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:49.740096 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd3f40-eddb-4f5b-97a6-ab88d4314fb9 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:49.742364 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b8fd3f40-eddb-4f5b-97a6-ab88d4314fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:49.758701 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd3f40-eddb-4f5b-97a6-ab88d4314fb9 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:49.821874 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8e7a4-fe2c-4fbd-975c-131da3ba6d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:49.823076 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8e7a4-fe2c-4fbd-975c-131da3ba6d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:49.823076 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8e7a4-fe2c-4fbd-975c-131da3ba6d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:49.823076 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8e7a4-fe2c-4fbd-975c-131da3ba6d33 admin admin] PATH_INFO: `/v3/users/e4c858653a7d4afba8e3c15a1d2488b4` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:49.823076 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8e7a4-fe2c-4fbd-975c-131da3ba6d33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c858653a7d4afba8e3c15a1d2488b4)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:49.828391 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8e7a4-fe2c-4fbd-975c-131da3ba6d33 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:49.896060 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-8ea8e7a4-fe2c-4fbd-975c-131da3ba6d33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c858653a7d4afba8e3c15a1d2488b4'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.897169 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-8ea8e7a4-fe2c-4fbd-975c-131da3ba6d33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c858653a7d4afba8e3c15a1d2488b4'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.898346 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-8ea8e7a4-fe2c-4fbd-975c-131da3ba6d33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c858653a7d4afba8e3c15a1d2488b4'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.908947 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-8ea8e7a4-fe2c-4fbd-975c-131da3ba6d33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c858653a7d4afba8e3c15a1d2488b4'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.919334 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-8ea8e7a4-fe2c-4fbd-975c-131da3ba6d33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c858653a7d4afba8e3c15a1d2488b4'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:49.944375 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1122/2240] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:58:49 2022] DELETE /identity/v3/users/e4c858653a7d4afba8e3c15a1d2488b4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:58:50.415842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5158e2a-acc3-4d27-b8c4-8014bbfcceb7 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:50.417449 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-e5158e2a-acc3-4d27-b8c4-8014bbfcceb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:50.433536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5158e2a-acc3-4d27-b8c4-8014bbfcceb7 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:50.549370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191a464-8a21-410b-bac3-093a40e97b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:50.552004 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191a464-8a21-410b-bac3-093a40e97b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:50.553463 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191a464-8a21-410b-bac3-093a40e97b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:50.555875 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191a464-8a21-410b-bac3-093a40e97b4c admin admin] PATH_INFO: `/v3/projects/508945a25abe4b388fffebbbae8cfba0` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:50.559297 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191a464-8a21-410b-bac3-093a40e97b4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=508945a25abe4b388fffebbbae8cfba0)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:50.561382 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191a464-8a21-410b-bac3-093a40e97b4c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:50.619530 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-5191a464-8a21-410b-bac3-093a40e97b4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '508945a25abe4b388fffebbbae8cfba0', 'request_id': 'req-5191a464-8a21-410b-bac3-093a40e97b4c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:50.627515 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-5191a464-8a21-410b-bac3-093a40e97b4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '508945a25abe4b388fffebbbae8cfba0', 'request_id': 'req-5191a464-8a21-410b-bac3-093a40e97b4c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:50.633585 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-5191a464-8a21-410b-bac3-093a40e97b4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '508945a25abe4b388fffebbbae8cfba0', 'request_id': 'req-5191a464-8a21-410b-bac3-093a40e97b4c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:50.654216 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-5191a464-8a21-410b-bac3-093a40e97b4c admin admin] The token cache is being invalidate because project 508945a25abe4b388fffebbbae8cfba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:58:50.655204 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-5191a464-8a21-410b-bac3-093a40e97b4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:50.656086 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-5191a464-8a21-410b-bac3-093a40e97b4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:58:50.664088 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1119/2241] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:58:50 2022] DELETE /identity/v3/projects/508945a25abe4b388fffebbbae8cfba0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:50.665908 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2571d-ffdf-4176-af63-9b927ff7a382 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:50.666331 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2571d-ffdf-4176-af63-9b927ff7a382 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:50.666482 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2571d-ffdf-4176-af63-9b927ff7a382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:50.689056 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-78f2571d-ffdf-4176-af63-9b927ff7a382 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:50.691597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-78f2571d-ffdf-4176-af63-9b927ff7a382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:50.869358 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1123/2242] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:50 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:50.880630 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d9bc1-ebb1-4f94-b49f-350107bafa95 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:50.880841 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d9bc1-ebb1-4f94-b49f-350107bafa95 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:50.881085 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d9bc1-ebb1-4f94-b49f-350107bafa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:50.910177 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-f50d9bc1-ebb1-4f94-b49f-350107bafa95 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:50.910983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-f50d9bc1-ebb1-4f94-b49f-350107bafa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:50.928551 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1120/2243] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:50 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:50.932406 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2571d-ffdf-4176-af63-9b927ff7a382 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:50.945512 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2571d-ffdf-4176-af63-9b927ff7a382 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:50.951212 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9613e3-ba6b-4e41-9f6d-761a52178089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:50.951420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9613e3-ba6b-4e41-9f6d-761a52178089 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:50.951702 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9613e3-ba6b-4e41-9f6d-761a52178089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:50.951978 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9613e3-ba6b-4e41-9f6d-761a52178089 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:50.952848 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9613e3-ba6b-4e41-9f6d-761a52178089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:58:50.953112 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9613e3-ba6b-4e41-9f6d-761a52178089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:50.954812 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9613e3-ba6b-4e41-9f6d-761a52178089 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:50.970570 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1124/2244] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:58:50.975718 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d9bc1-ebb1-4f94-b49f-350107bafa95 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:50.992998 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d9bc1-ebb1-4f94-b49f-350107bafa95 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:50.998838 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec39faa-93eb-471e-9cbe-024c0015adde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:50.999656 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec39faa-93eb-471e-9cbe-024c0015adde admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:51.000011 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec39faa-93eb-471e-9cbe-024c0015adde admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:51.000455 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec39faa-93eb-471e-9cbe-024c0015adde admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:51.001289 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec39faa-93eb-471e-9cbe-024c0015adde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:51.003422 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec39faa-93eb-471e-9cbe-024c0015adde admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:51.040577 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1121/2245] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:58:50 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:51.042627 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9613e3-ba6b-4e41-9f6d-761a52178089 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:51.058834 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9613e3-ba6b-4e41-9f6d-761a52178089 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:51.141342 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78244d63-56fb-4c81-afe8-f2e338ff2cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:51.142085 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78244d63-56fb-4c81-afe8-f2e338ff2cdf admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:51.142651 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78244d63-56fb-4c81-afe8-f2e338ff2cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:51.143283 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78244d63-56fb-4c81-afe8-f2e338ff2cdf admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:51.144682 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78244d63-56fb-4c81-afe8-f2e338ff2cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:51.148020 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78244d63-56fb-4c81-afe8-f2e338ff2cdf admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:51.190551 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1125/2246] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:58:51 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:51.192758 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec39faa-93eb-471e-9cbe-024c0015adde admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:51.221244 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec39faa-93eb-471e-9cbe-024c0015adde admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:51.226468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ea849-382c-4441-8182-dc3495104386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:51.227185 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ea849-382c-4441-8182-dc3495104386 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:51.227554 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ea849-382c-4441-8182-dc3495104386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:51.227983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ea849-382c-4441-8182-dc3495104386 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:51.228848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ea849-382c-4441-8182-dc3495104386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:51.230535 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ea849-382c-4441-8182-dc3495104386 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:51.246622 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1122/2247] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:58:51.248841 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78244d63-56fb-4c81-afe8-f2e338ff2cdf admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:51.261732 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78244d63-56fb-4c81-afe8-f2e338ff2cdf admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:51.271644 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cca356-6408-4425-8417-40c59d0fa415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:51.272496 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cca356-6408-4425-8417-40c59d0fa415 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:51.272776 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cca356-6408-4425-8417-40c59d0fa415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:51.273145 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cca356-6408-4425-8417-40c59d0fa415 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:51.273893 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cca356-6408-4425-8417-40c59d0fa415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:51.275467 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cca356-6408-4425-8417-40c59d0fa415 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:51.287718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1126/2248] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:51.295407 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ea849-382c-4441-8182-dc3495104386 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:51.306702 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ea849-382c-4441-8182-dc3495104386 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:51.313714 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0802f7-2683-4db4-9b6a-ad138d006989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:51.314834 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0802f7-2683-4db4-9b6a-ad138d006989 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:51.315116 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0802f7-2683-4db4-9b6a-ad138d006989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:51.315826 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0802f7-2683-4db4-9b6a-ad138d006989 admin admin] PATH_INFO: `/v3/projects/928f3b35a68c4d94965f690f1295b09f/users/b8bec2e7abb74fa6b991aa9229a0e5a6/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:51.334098 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0802f7-2683-4db4-9b6a-ad138d006989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=928f3b35a68c4d94965f690f1295b09f, user_id=b8bec2e7abb74fa6b991aa9229a0e5a6, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:51.337362 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0802f7-2683-4db4-9b6a-ad138d006989 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:51.355020 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1123/2249] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:51 2022] PUT /identity/v3/projects/928f3b35a68c4d94965f690f1295b09f/users/b8bec2e7abb74fa6b991aa9229a0e5a6/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:51.369108 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230681b1-b70e-43d5-bf23-020961c23ad9 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:51.369748 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230681b1-b70e-43d5-bf23-020961c23ad9 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:51.370102 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230681b1-b70e-43d5-bf23-020961c23ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:51.431912 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-230681b1-b70e-43d5-bf23-020961c23ad9 None None] MFA Rules not processed for user `b8bec2e7abb74fa6b991aa9229a0e5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:51.433881 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-230681b1-b70e-43d5-bf23-020961c23ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:51.577244 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1127/2250] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:51 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:51.589996 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0802f7-2683-4db4-9b6a-ad138d006989 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:51.592822 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ae0802f7-2683-4db4-9b6a-ad138d006989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:51.692488 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0802f7-2683-4db4-9b6a-ad138d006989 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:51.696160 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573ca60-597c-4365-879f-ffaa39c06d58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07298acc960e4154be7c79f2368a1952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:51.696817 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573ca60-597c-4365-879f-ffaa39c06d58 service glance] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:51.697124 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573ca60-597c-4365-879f-ffaa39c06d58 service glance] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:51.697394 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573ca60-597c-4365-879f-ffaa39c06d58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:51.707727 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573ca60-597c-4365-879f-ffaa39c06d58 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:51.709905 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573ca60-597c-4365-879f-ffaa39c06d58 service glance] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:51.721791 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1124/2251] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:51 2022] GET /identity/v3/auth/tokens => generated 3391 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:54.260575 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51143a9e-cc80-45fc-a350-4c57a6827f73 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:54.261490 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51143a9e-cc80-45fc-a350-4c57a6827f73 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:54.261962 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51143a9e-cc80-45fc-a350-4c57a6827f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:54.309036 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-51143a9e-cc80-45fc-a350-4c57a6827f73 None None] MFA Rules not processed for user `a315151d7ab945cbbbe4c88adc4b7203`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:54.311996 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-51143a9e-cc80-45fc-a350-4c57a6827f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:54.421629 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1128/2252] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:54 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:54.427466 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573ca60-597c-4365-879f-ffaa39c06d58 service glance] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:54.430122 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-0573ca60-597c-4365-879f-ffaa39c06d58 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:54.515020 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573ca60-597c-4365-879f-ffaa39c06d58 service glance] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:54.520489 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe10b5-e161-4b53-8631-e089a33b8c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:54.521199 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe10b5-e161-4b53-8631-e089a33b8c7b admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:54.521482 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe10b5-e161-4b53-8631-e089a33b8c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:54.521750 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe10b5-e161-4b53-8631-e089a33b8c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:54.522468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe10b5-e161-4b53-8631-e089a33b8c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:54.524508 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe10b5-e161-4b53-8631-e089a33b8c7b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:54.578804 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1125/2253] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:58:54 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:54.582802 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51143a9e-cc80-45fc-a350-4c57a6827f73 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:54.597751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51143a9e-cc80-45fc-a350-4c57a6827f73 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:54.697100 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341559a-4dda-41e1-b9da-2307bfd10101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:54.697888 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341559a-4dda-41e1-b9da-2307bfd10101 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:54.698490 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341559a-4dda-41e1-b9da-2307bfd10101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:54.698718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341559a-4dda-41e1-b9da-2307bfd10101 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:54.699426 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341559a-4dda-41e1-b9da-2307bfd10101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:54.702708 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341559a-4dda-41e1-b9da-2307bfd10101 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:54.736059 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1129/2254] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:58:54 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:58:54.740988 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe10b5-e161-4b53-8631-e089a33b8c7b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:54.761587 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe10b5-e161-4b53-8631-e089a33b8c7b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:54.769926 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f25804-b232-4e98-9f55-d582d3035241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:54.787330 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f25804-b232-4e98-9f55-d582d3035241 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:54.789068 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f25804-b232-4e98-9f55-d582d3035241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:54.790414 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f25804-b232-4e98-9f55-d582d3035241 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:54.793207 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f25804-b232-4e98-9f55-d582d3035241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:54.796489 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f25804-b232-4e98-9f55-d582d3035241 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:54.830003 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1126/2255] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:54.832027 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341559a-4dda-41e1-b9da-2307bfd10101 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:54.849629 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341559a-4dda-41e1-b9da-2307bfd10101 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:54.870849 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bb87e-bbdd-4172-b392-c265448d424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:54.876571 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bb87e-bbdd-4172-b392-c265448d424f admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:54.877336 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bb87e-bbdd-4172-b392-c265448d424f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:54.877336 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bb87e-bbdd-4172-b392-c265448d424f admin admin] PATH_INFO: `/v3/projects/61de37e2667c4b58aca1e21e283ee42c/users/8e2c7de53bc7406ea4b5806362208952/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:54.913600 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bb87e-bbdd-4172-b392-c265448d424f admin admin] RBAC: Authorizing `identity:create_grant(project_id=61de37e2667c4b58aca1e21e283ee42c, user_id=8e2c7de53bc7406ea4b5806362208952, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:54.917326 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bb87e-bbdd-4172-b392-c265448d424f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:54.952779 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1130/2256] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:54 2022] PUT /identity/v3/projects/61de37e2667c4b58aca1e21e283ee42c/users/8e2c7de53bc7406ea4b5806362208952/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:54.959035 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f25804-b232-4e98-9f55-d582d3035241 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:54.970331 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f25804-b232-4e98-9f55-d582d3035241 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:55.092743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58e7ed-5efd-4909-95cf-1c7d7b017c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:55.093689 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58e7ed-5efd-4909-95cf-1c7d7b017c1c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:55.094119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58e7ed-5efd-4909-95cf-1c7d7b017c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:55.094536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58e7ed-5efd-4909-95cf-1c7d7b017c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:55.095411 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58e7ed-5efd-4909-95cf-1c7d7b017c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:55.097195 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58e7ed-5efd-4909-95cf-1c7d7b017c1c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:55.114904 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1127/2257] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:58:55.116699 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f6eac-c223-40d8-aa30-8439a23248bc None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:55.117037 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f6eac-c223-40d8-aa30-8439a23248bc None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:55.117305 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f6eac-c223-40d8-aa30-8439a23248bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:55.118749 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58e7ed-5efd-4909-95cf-1c7d7b017c1c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:55.133118 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58e7ed-5efd-4909-95cf-1c7d7b017c1c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:55.135660 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-167f6eac-c223-40d8-aa30-8439a23248bc None None] MFA Rules not processed for user `cd9cb4ec35524e859b828892c95130e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:55.136972 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-167f6eac-c223-40d8-aa30-8439a23248bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:55.138106 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac50a9a-4596-45f7-836d-eb68d4e8e3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:55.139261 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac50a9a-4596-45f7-836d-eb68d4e8e3b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:55.139541 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac50a9a-4596-45f7-836d-eb68d4e8e3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:55.139812 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac50a9a-4596-45f7-836d-eb68d4e8e3b3 admin admin] PATH_INFO: `/v3/projects/61de37e2667c4b58aca1e21e283ee42c/users/8e2c7de53bc7406ea4b5806362208952/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:55.141860 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac50a9a-4596-45f7-836d-eb68d4e8e3b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61de37e2667c4b58aca1e21e283ee42c, user_id=8e2c7de53bc7406ea4b5806362208952, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:55.144472 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac50a9a-4596-45f7-836d-eb68d4e8e3b3 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:55.156758 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1128/2258] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:58:55 2022] PUT /identity/v3/projects/61de37e2667c4b58aca1e21e283ee42c/users/8e2c7de53bc7406ea4b5806362208952/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:58:55.195007 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1131/2259] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:58:55 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:59:00.521614 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac50a9a-4596-45f7-836d-eb68d4e8e3b3 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:00.523859 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-dac50a9a-4596-45f7-836d-eb68d4e8e3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:00.759793 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac50a9a-4596-45f7-836d-eb68d4e8e3b3 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:00.791839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc9c10-b16a-4f52-9f63-107f1828f35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:00.792745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc9c10-b16a-4f52-9f63-107f1828f35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:00.801265 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc9c10-b16a-4f52-9f63-107f1828f35a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:00.801585 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc9c10-b16a-4f52-9f63-107f1828f35a admin admin] PATH_INFO: `/v3/users/56551a48f6df42eba6828a019f696705` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:00.805031 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc9c10-b16a-4f52-9f63-107f1828f35a admin admin] RBAC: Authorizing `identity:delete_user(user_id=56551a48f6df42eba6828a019f696705)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:00.807429 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc9c10-b16a-4f52-9f63-107f1828f35a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:00.999504 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-dccc9c10-b16a-4f52-9f63-107f1828f35a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56551a48f6df42eba6828a019f696705'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:01.011679 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-dccc9c10-b16a-4f52-9f63-107f1828f35a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56551a48f6df42eba6828a019f696705'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:01.033948 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-dccc9c10-b16a-4f52-9f63-107f1828f35a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56551a48f6df42eba6828a019f696705'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:01.055418 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-dccc9c10-b16a-4f52-9f63-107f1828f35a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56551a48f6df42eba6828a019f696705'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:01.121333 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-dccc9c10-b16a-4f52-9f63-107f1828f35a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56551a48f6df42eba6828a019f696705'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:01.142390 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1129/2260] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:59:00 2022] DELETE /identity/v3/users/56551a48f6df42eba6828a019f696705 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:59:01.144516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3918f8-6dab-4a27-b55f-5315fd11c150 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:01.144516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3918f8-6dab-4a27-b55f-5315fd11c150 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:01.145105 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3918f8-6dab-4a27-b55f-5315fd11c150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:01.205402 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-8a3918f8-6dab-4a27-b55f-5315fd11c150 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:01.206762 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-8a3918f8-6dab-4a27-b55f-5315fd11c150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:01.447445 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1132/2261] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:59:01 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:01.614336 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc9c10-b16a-4f52-9f63-107f1828f35a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:01.617054 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-dccc9c10-b16a-4f52-9f63-107f1828f35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:01.782404 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc9c10-b16a-4f52-9f63-107f1828f35a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:01.792683 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c705c2-eedf-4e62-9d1b-247cd00e4e24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:01.794032 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c705c2-eedf-4e62-9d1b-247cd00e4e24 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:01.794318 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c705c2-eedf-4e62-9d1b-247cd00e4e24 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:01.794589 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c705c2-eedf-4e62-9d1b-247cd00e4e24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:01.819501 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c705c2-eedf-4e62-9d1b-247cd00e4e24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:01.826777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c705c2-eedf-4e62-9d1b-247cd00e4e24 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:01.861299 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1130/2262] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:01 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:02.877632 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3918f8-6dab-4a27-b55f-5315fd11c150 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:02.880688 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-8a3918f8-6dab-4a27-b55f-5315fd11c150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:02.900386 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3918f8-6dab-4a27-b55f-5315fd11c150 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:02.916112 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f6fb0-87c5-4462-a462-1f7071a63a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:02.918221 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f6fb0-87c5-4462-a462-1f7071a63a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:02.918501 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f6fb0-87c5-4462-a462-1f7071a63a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:02.920041 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f6fb0-87c5-4462-a462-1f7071a63a78 admin admin] PATH_INFO: `/v3/projects/4ca8fbd98a1e4a1e9522728ee14b34a6` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:02.923467 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f6fb0-87c5-4462-a462-1f7071a63a78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ca8fbd98a1e4a1e9522728ee14b34a6)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:02.931864 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f6fb0-87c5-4462-a462-1f7071a63a78 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:03.114465 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c06f6fb0-87c5-4462-a462-1f7071a63a78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca8fbd98a1e4a1e9522728ee14b34a6', 'request_id': 'req-c06f6fb0-87c5-4462-a462-1f7071a63a78'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:03.159269 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c06f6fb0-87c5-4462-a462-1f7071a63a78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca8fbd98a1e4a1e9522728ee14b34a6', 'request_id': 'req-c06f6fb0-87c5-4462-a462-1f7071a63a78'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:03.199092 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c06f6fb0-87c5-4462-a462-1f7071a63a78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca8fbd98a1e4a1e9522728ee14b34a6', 'request_id': 'req-c06f6fb0-87c5-4462-a462-1f7071a63a78'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:03.260830 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c06f6fb0-87c5-4462-a462-1f7071a63a78 admin admin] The token cache is being invalidate because project 4ca8fbd98a1e4a1e9522728ee14b34a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:59:03.262390 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c06f6fb0-87c5-4462-a462-1f7071a63a78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:03.280103 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c06f6fb0-87c5-4462-a462-1f7071a63a78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:03.286126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1133/2263] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:59:02 2022] DELETE /identity/v3/projects/4ca8fbd98a1e4a1e9522728ee14b34a6 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:59:04.753669 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548da94f-6024-4707-ab18-c1cd38487b10 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:04.754636 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548da94f-6024-4707-ab18-c1cd38487b10 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:04.755120 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548da94f-6024-4707-ab18-c1cd38487b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:04.834628 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-548da94f-6024-4707-ab18-c1cd38487b10 None None] MFA Rules not processed for user `8e2c7de53bc7406ea4b5806362208952`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:04.837153 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-548da94f-6024-4707-ab18-c1cd38487b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:04.992227 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1131/2264] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:59:04 2022] POST /identity/v3/auth/tokens => generated 3460 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:05.059063 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f6fb0-87c5-4462-a462-1f7071a63a78 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:05.061281 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c06f6fb0-87c5-4462-a462-1f7071a63a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:05.211453 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f6fb0-87c5-4462-a462-1f7071a63a78 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:05.217048 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f37d6a-e036-43fa-b61c-1fe7297ac6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:05.217933 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f37d6a-e036-43fa-b61c-1fe7297ac6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:05.218210 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f37d6a-e036-43fa-b61c-1fe7297ac6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:05.218483 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f37d6a-e036-43fa-b61c-1fe7297ac6b0 admin admin] PATH_INFO: `/v3/users/03044ab6cbce4e48a10dacb48d7bbeb8` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:05.219726 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f37d6a-e036-43fa-b61c-1fe7297ac6b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03044ab6cbce4e48a10dacb48d7bbeb8)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:05.221757 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f37d6a-e036-43fa-b61c-1fe7297ac6b0 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:05.285065 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548da94f-6024-4707-ab18-c1cd38487b10 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:05.286746 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-548da94f-6024-4707-ab18-c1cd38487b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:05.291766 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f1f37d6a-e036-43fa-b61c-1fe7297ac6b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03044ab6cbce4e48a10dacb48d7bbeb8'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:05.292478 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f1f37d6a-e036-43fa-b61c-1fe7297ac6b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03044ab6cbce4e48a10dacb48d7bbeb8'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:05.293169 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f1f37d6a-e036-43fa-b61c-1fe7297ac6b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03044ab6cbce4e48a10dacb48d7bbeb8'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:05.302191 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f1f37d6a-e036-43fa-b61c-1fe7297ac6b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03044ab6cbce4e48a10dacb48d7bbeb8'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:05.310555 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f1f37d6a-e036-43fa-b61c-1fe7297ac6b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03044ab6cbce4e48a10dacb48d7bbeb8'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:05.330348 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1134/2265] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:59:05 2022] DELETE /identity/v3/users/03044ab6cbce4e48a10dacb48d7bbeb8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:59:05.335507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fb94e-55e0-4215-9ded-137b32b840bb None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:05.335924 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fb94e-55e0-4215-9ded-137b32b840bb None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:05.336262 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fb94e-55e0-4215-9ded-137b32b840bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:05.368187 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-704fb94e-55e0-4215-9ded-137b32b840bb None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:05.369846 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-704fb94e-55e0-4215-9ded-137b32b840bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:05.401215 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548da94f-6024-4707-ab18-c1cd38487b10 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:05.446407 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1135/2266] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:59:05 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:05.456832 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fb94e-55e0-4215-9ded-137b32b840bb None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:05.458419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-704fb94e-55e0-4215-9ded-137b32b840bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:05.489938 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c868f-4408-4d41-9044-772102dbab3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:05.490694 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c868f-4408-4d41-9044-772102dbab3f service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:05.490976 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c868f-4408-4d41-9044-772102dbab3f service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:05.491249 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c868f-4408-4d41-9044-772102dbab3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:05.493104 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2b2c868f-4408-4d41-9044-772102dbab3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:05.555614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fb94e-55e0-4215-9ded-137b32b840bb None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:05.561039 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5aaa17-4267-46ef-9a0b-bbec83fc6109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:05.561894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5aaa17-4267-46ef-9a0b-bbec83fc6109 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:05.562212 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5aaa17-4267-46ef-9a0b-bbec83fc6109 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:05.562491 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5aaa17-4267-46ef-9a0b-bbec83fc6109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:05.570640 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c868f-4408-4d41-9044-772102dbab3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:05.572157 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c868f-4408-4d41-9044-772102dbab3f service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:05.574241 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5aaa17-4267-46ef-9a0b-bbec83fc6109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:05.576631 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5aaa17-4267-46ef-9a0b-bbec83fc6109 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:05.585542 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1132/2267] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:05 2022] GET /identity/v3/auth/tokens => generated 3391 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:59:05.589586 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1136/2268] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:05 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:59:05.938321 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c868f-4408-4d41-9044-772102dbab3f service nova] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:05.940233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2b2c868f-4408-4d41-9044-772102dbab3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:05.957585 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c868f-4408-4d41-9044-772102dbab3f service nova] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:05.971874 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc188ff-38b1-4af4-96f0-535d8e29ca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:05.974379 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc188ff-38b1-4af4-96f0-535d8e29ca9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:05.974853 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc188ff-38b1-4af4-96f0-535d8e29ca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:05.975580 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc188ff-38b1-4af4-96f0-535d8e29ca9b admin admin] PATH_INFO: `/v3/projects/e22cd868f1be4fbd8f50c9232cdd7281` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:05.977485 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc188ff-38b1-4af4-96f0-535d8e29ca9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e22cd868f1be4fbd8f50c9232cdd7281)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:05.980152 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc188ff-38b1-4af4-96f0-535d8e29ca9b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:06.150377 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-dbc188ff-38b1-4af4-96f0-535d8e29ca9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e22cd868f1be4fbd8f50c9232cdd7281', 'request_id': 'req-dbc188ff-38b1-4af4-96f0-535d8e29ca9b'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:06.159989 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-dbc188ff-38b1-4af4-96f0-535d8e29ca9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e22cd868f1be4fbd8f50c9232cdd7281', 'request_id': 'req-dbc188ff-38b1-4af4-96f0-535d8e29ca9b'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:06.171210 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-dbc188ff-38b1-4af4-96f0-535d8e29ca9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e22cd868f1be4fbd8f50c9232cdd7281', 'request_id': 'req-dbc188ff-38b1-4af4-96f0-535d8e29ca9b'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:06.190397 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-dbc188ff-38b1-4af4-96f0-535d8e29ca9b admin admin] The token cache is being invalidate because project e22cd868f1be4fbd8f50c9232cdd7281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:59:06.190686 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-dbc188ff-38b1-4af4-96f0-535d8e29ca9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:06.192200 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-dbc188ff-38b1-4af4-96f0-535d8e29ca9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:06.194864 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1133/2269] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:59:05 2022] DELETE /identity/v3/projects/e22cd868f1be4fbd8f50c9232cdd7281 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:59:06.201254 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db74ac-8d6d-4913-9950-2ac8ea68b92b None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:06.202195 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db74ac-8d6d-4913-9950-2ac8ea68b92b None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:06.202646 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db74ac-8d6d-4913-9950-2ac8ea68b92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:06.285860 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-b1db74ac-8d6d-4913-9950-2ac8ea68b92b None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:06.290428 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b1db74ac-8d6d-4913-9950-2ac8ea68b92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:06.418121 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e677a17-7a25-4b92-9237-87741d590de7 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:06.418696 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e677a17-7a25-4b92-9237-87741d590de7 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:06.419196 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e677a17-7a25-4b92-9237-87741d590de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:06.421586 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1137/2270] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:59:06 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:59:06.445255 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-2e677a17-7a25-4b92-9237-87741d590de7 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:06.446796 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2e677a17-7a25-4b92-9237-87741d590de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:06.462904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db74ac-8d6d-4913-9950-2ac8ea68b92b None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:06.469708 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1134/2271] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:59:06 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:59:06.476056 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db74ac-8d6d-4913-9950-2ac8ea68b92b None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:06.485559 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea54c05-f1a4-45c2-8b17-376d7e7d46fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:06.486447 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea54c05-f1a4-45c2-8b17-376d7e7d46fa admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:06.486899 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea54c05-f1a4-45c2-8b17-376d7e7d46fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:06.487325 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea54c05-f1a4-45c2-8b17-376d7e7d46fa admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:06.488218 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea54c05-f1a4-45c2-8b17-376d7e7d46fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:59:06.488736 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea54c05-f1a4-45c2-8b17-376d7e7d46fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:06.493538 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea54c05-f1a4-45c2-8b17-376d7e7d46fa admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:06.522285 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1138/2272] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:06.527781 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e677a17-7a25-4b92-9237-87741d590de7 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:06.537923 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e677a17-7a25-4b92-9237-87741d590de7 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:06.543591 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee7fdb-b932-4801-af8d-ec50e49c6a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:06.545236 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee7fdb-b932-4801-af8d-ec50e49c6a10 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:06.545766 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee7fdb-b932-4801-af8d-ec50e49c6a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:06.546310 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee7fdb-b932-4801-af8d-ec50e49c6a10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:06.547448 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee7fdb-b932-4801-af8d-ec50e49c6a10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:06.549508 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee7fdb-b932-4801-af8d-ec50e49c6a10 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:06.606395 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea54c05-f1a4-45c2-8b17-376d7e7d46fa admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:06.611888 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1135/2273] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:59:06 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:59:06.625229 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea54c05-f1a4-45c2-8b17-376d7e7d46fa admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:06.818605 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7020a4-340a-42ef-af70-a289b5981097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:06.822363 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7020a4-340a-42ef-af70-a289b5981097 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:06.822363 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7020a4-340a-42ef-af70-a289b5981097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:06.822363 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7020a4-340a-42ef-af70-a289b5981097 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:06.827997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7020a4-340a-42ef-af70-a289b5981097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:06.830316 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7020a4-340a-42ef-af70-a289b5981097 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:06.878364 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1139/2274] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:59:06 2022] POST /identity/v3/users => generated 288 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:59:06.881010 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee7fdb-b932-4801-af8d-ec50e49c6a10 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:06.906884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee7fdb-b932-4801-af8d-ec50e49c6a10 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:06.912819 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a046c7a-cdb6-47a7-8c70-42e6a44796c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:06.913662 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a046c7a-cdb6-47a7-8c70-42e6a44796c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:06.913777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a046c7a-cdb6-47a7-8c70-42e6a44796c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:06.914047 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a046c7a-cdb6-47a7-8c70-42e6a44796c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:06.914796 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a046c7a-cdb6-47a7-8c70-42e6a44796c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:06.917625 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a046c7a-cdb6-47a7-8c70-42e6a44796c2 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:06.938653 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1136/2275] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:59:06.942578 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7020a4-340a-42ef-af70-a289b5981097 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:06.963635 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7020a4-340a-42ef-af70-a289b5981097 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:06.971761 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e08766-3429-493a-9ba9-4e7ef0ad8c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:06.972786 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e08766-3429-493a-9ba9-4e7ef0ad8c8e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:06.973156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e08766-3429-493a-9ba9-4e7ef0ad8c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:06.973487 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e08766-3429-493a-9ba9-4e7ef0ad8c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:06.974498 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e08766-3429-493a-9ba9-4e7ef0ad8c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:06.976851 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e08766-3429-493a-9ba9-4e7ef0ad8c8e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:06.994735 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1140/2276] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:59:07.001426 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a046c7a-cdb6-47a7-8c70-42e6a44796c2 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:07.025047 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a046c7a-cdb6-47a7-8c70-42e6a44796c2 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:07.033303 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec6898-2050-4bcf-a10d-cdf50439d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:07.035519 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec6898-2050-4bcf-a10d-cdf50439d17e admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:07.036103 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec6898-2050-4bcf-a10d-cdf50439d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:07.036543 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec6898-2050-4bcf-a10d-cdf50439d17e admin admin] PATH_INFO: `/v3/projects/703391c3a9b64cf8a323d0fe7e105a6b/users/838b55acbe1a43538bb82db1e60c4c3c/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:07.071958 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec6898-2050-4bcf-a10d-cdf50439d17e admin admin] RBAC: Authorizing `identity:create_grant(project_id=703391c3a9b64cf8a323d0fe7e105a6b, user_id=838b55acbe1a43538bb82db1e60c4c3c, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:07.075175 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec6898-2050-4bcf-a10d-cdf50439d17e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:07.118935 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1137/2277] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:59:06 2022] PUT /identity/v3/projects/703391c3a9b64cf8a323d0fe7e105a6b/users/838b55acbe1a43538bb82db1e60c4c3c/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:59:07.134941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e74feb-43c8-44ad-a461-713f362e61bf None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:07.135242 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e74feb-43c8-44ad-a461-713f362e61bf None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:07.136246 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e74feb-43c8-44ad-a461-713f362e61bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:07.235433 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-c0e74feb-43c8-44ad-a461-713f362e61bf None None] MFA Rules not processed for user `838b55acbe1a43538bb82db1e60c4c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:07.235433 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c0e74feb-43c8-44ad-a461-713f362e61bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:07.399724 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1141/2278] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:59:07 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:07.411545 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec6898-2050-4bcf-a10d-cdf50439d17e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:07.414223 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-baec6898-2050-4bcf-a10d-cdf50439d17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:07.527702 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec6898-2050-4bcf-a10d-cdf50439d17e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:07.554092 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a69649-d0f0-4de4-8cdd-fd49fe7d45a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:07.555011 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a69649-d0f0-4de4-8cdd-fd49fe7d45a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:07.556317 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a69649-d0f0-4de4-8cdd-fd49fe7d45a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:07.556788 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a69649-d0f0-4de4-8cdd-fd49fe7d45a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:07.571480 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a69649-d0f0-4de4-8cdd-fd49fe7d45a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:07.574400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a69649-d0f0-4de4-8cdd-fd49fe7d45a6 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:07.600404 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1138/2279] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:07 2022] GET /identity/v3/auth/tokens => generated 3395 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:07.931919 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b73cca-90e4-457b-af85-fac0dbf5290d None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:07.932303 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b73cca-90e4-457b-af85-fac0dbf5290d None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:07.933293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b73cca-90e4-457b-af85-fac0dbf5290d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:07.967995 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-c1b73cca-90e4-457b-af85-fac0dbf5290d None None] MFA Rules not processed for user `a315151d7ab945cbbbe4c88adc4b7203`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:07.971760 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c1b73cca-90e4-457b-af85-fac0dbf5290d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:08.141696 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1142/2280] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:59:07 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:09.330009 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a9784-6e1d-410b-92d3-511dc60122ce None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:09.330431 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a9784-6e1d-410b-92d3-511dc60122ce None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:09.330431 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a9784-6e1d-410b-92d3-511dc60122ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:09.350013 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-324a9784-6e1d-410b-92d3-511dc60122ce None None] MFA Rules not processed for user `838b55acbe1a43538bb82db1e60c4c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:09.351164 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-324a9784-6e1d-410b-92d3-511dc60122ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:09.359529 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1139/2281] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:59:09 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:10.303378 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cc308-49db-4621-b3a0-e3b1c6336017 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:10.303792 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cc308-49db-4621-b3a0-e3b1c6336017 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:10.303937 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cc308-49db-4621-b3a0-e3b1c6336017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:10.324582 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-980cc308-49db-4621-b3a0-e3b1c6336017 None None] MFA Rules not processed for user `1f57e62502564821b4be822554d9f5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:10.326314 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-980cc308-49db-4621-b3a0-e3b1c6336017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:10.397711 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1143/2282] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:59:10 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:26.150733 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a9784-6e1d-410b-92d3-511dc60122ce None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:26.152501 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-324a9784-6e1d-410b-92d3-511dc60122ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:26.231033 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a9784-6e1d-410b-92d3-511dc60122ce None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:26.238062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec744b-4c6a-4475-802d-2bb62a04ab9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:26.238062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec744b-4c6a-4475-802d-2bb62a04ab9b service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:26.238062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec744b-4c6a-4475-802d-2bb62a04ab9b service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:26.238062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec744b-4c6a-4475-802d-2bb62a04ab9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:26.240080 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-26ec744b-4c6a-4475-802d-2bb62a04ab9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:26.317846 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec744b-4c6a-4475-802d-2bb62a04ab9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:26.319332 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec744b-4c6a-4475-802d-2bb62a04ab9b service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:26.330163 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1140/2283] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:26 2022] GET /identity/v3/auth/tokens => generated 3466 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:36.966622 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cc308-49db-4621-b3a0-e3b1c6336017 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:36.968243 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-980cc308-49db-4621-b3a0-e3b1c6336017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:37.059454 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cc308-49db-4621-b3a0-e3b1c6336017 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:37.066606 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d03b5-dbec-4c1d-b57f-ef43c9355149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:37.068255 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d03b5-dbec-4c1d-b57f-ef43c9355149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:37.068255 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d03b5-dbec-4c1d-b57f-ef43c9355149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:37.068255 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d03b5-dbec-4c1d-b57f-ef43c9355149 admin admin] PATH_INFO: `/v3/users/b8bec2e7abb74fa6b991aa9229a0e5a6` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:37.076342 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d03b5-dbec-4c1d-b57f-ef43c9355149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8bec2e7abb74fa6b991aa9229a0e5a6)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:37.076342 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d03b5-dbec-4c1d-b57f-ef43c9355149 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:37.128924 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-af9d03b5-dbec-4c1d-b57f-ef43c9355149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8bec2e7abb74fa6b991aa9229a0e5a6'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:37.129747 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-af9d03b5-dbec-4c1d-b57f-ef43c9355149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8bec2e7abb74fa6b991aa9229a0e5a6'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:37.130429 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-af9d03b5-dbec-4c1d-b57f-ef43c9355149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8bec2e7abb74fa6b991aa9229a0e5a6'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:37.140349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-af9d03b5-dbec-4c1d-b57f-ef43c9355149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8bec2e7abb74fa6b991aa9229a0e5a6'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:37.151236 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-af9d03b5-dbec-4c1d-b57f-ef43c9355149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8bec2e7abb74fa6b991aa9229a0e5a6'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:37.174971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1144/2284] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:59:36 2022] DELETE /identity/v3/users/b8bec2e7abb74fa6b991aa9229a0e5a6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:59:37.180287 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fcd3b-7221-413f-8201-7bff5a8bb8dd None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:37.180872 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fcd3b-7221-413f-8201-7bff5a8bb8dd None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:37.181264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fcd3b-7221-413f-8201-7bff5a8bb8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:37.203179 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-0f7fcd3b-7221-413f-8201-7bff5a8bb8dd None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:37.204484 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-0f7fcd3b-7221-413f-8201-7bff5a8bb8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:37.285626 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1141/2285] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:59:37 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:37.296731 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d03b5-dbec-4c1d-b57f-ef43c9355149 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:37.298355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-af9d03b5-dbec-4c1d-b57f-ef43c9355149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:37.357085 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d03b5-dbec-4c1d-b57f-ef43c9355149 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:37.361003 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ae904-3398-432e-ae00-874e2bcb9f77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:37.361656 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ae904-3398-432e-ae00-874e2bcb9f77 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:37.361937 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ae904-3398-432e-ae00-874e2bcb9f77 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:37.362212 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ae904-3398-432e-ae00-874e2bcb9f77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:37.372371 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ae904-3398-432e-ae00-874e2bcb9f77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:37.373873 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ae904-3398-432e-ae00-874e2bcb9f77 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:37.383908 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1145/2286] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:37 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:37.750365 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18e7ea-7d15-47b3-be10-2fb3272b0739 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:37.751026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18e7ea-7d15-47b3-be10-2fb3272b0739 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:37.751546 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18e7ea-7d15-47b3-be10-2fb3272b0739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:37.793968 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ae904-3398-432e-ae00-874e2bcb9f77 service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:37.795727 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-0d4ae904-3398-432e-ae00-874e2bcb9f77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:37.799598 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-5f18e7ea-7d15-47b3-be10-2fb3272b0739 None None] MFA Rules not processed for user `591d508a3867412fac76d00134e58864`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:37.802311 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-5f18e7ea-7d15-47b3-be10-2fb3272b0739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:37.813565 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ae904-3398-432e-ae00-874e2bcb9f77 service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:37.822767 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a24ce-5d69-405b-a422-8d450c57e5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:37.823784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a24ce-5d69-405b-a422-8d450c57e5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:37.824052 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a24ce-5d69-405b-a422-8d450c57e5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:37.824325 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a24ce-5d69-405b-a422-8d450c57e5b2 admin admin] PATH_INFO: `/v3/projects/928f3b35a68c4d94965f690f1295b09f` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:37.826888 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a24ce-5d69-405b-a422-8d450c57e5b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=928f3b35a68c4d94965f690f1295b09f)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:37.829022 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a24ce-5d69-405b-a422-8d450c57e5b2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:37.893026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1142/2287] 10.222.0.96 () {58 vars in 1009 bytes} [Fri Jan 28 01:59:37 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:37.914158 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9b0a24ce-5d69-405b-a422-8d450c57e5b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '928f3b35a68c4d94965f690f1295b09f', 'request_id': 'req-9b0a24ce-5d69-405b-a422-8d450c57e5b2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:37.938568 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9b0a24ce-5d69-405b-a422-8d450c57e5b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '928f3b35a68c4d94965f690f1295b09f', 'request_id': 'req-9b0a24ce-5d69-405b-a422-8d450c57e5b2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:37.945356 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9b0a24ce-5d69-405b-a422-8d450c57e5b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '928f3b35a68c4d94965f690f1295b09f', 'request_id': 'req-9b0a24ce-5d69-405b-a422-8d450c57e5b2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:37.962701 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18e7ea-7d15-47b3-be10-2fb3272b0739 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:37.964347 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-5f18e7ea-7d15-47b3-be10-2fb3272b0739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:37.975654 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9b0a24ce-5d69-405b-a422-8d450c57e5b2 admin admin] The token cache is being invalidate because project 928f3b35a68c4d94965f690f1295b09f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:59:37.976243 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9b0a24ce-5d69-405b-a422-8d450c57e5b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:37.977010 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9b0a24ce-5d69-405b-a422-8d450c57e5b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:37.984852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1146/2288] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:59:37 2022] DELETE /identity/v3/projects/928f3b35a68c4d94965f690f1295b09f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:59:38.060658 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18e7ea-7d15-47b3-be10-2fb3272b0739 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:38.150551 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c3f08-b0d0-4e0c-a4b0-1b9823862aaa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a2c3b2815f46b0ac27944f004c4821', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:38.151342 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c3f08-b0d0-4e0c-a4b0-1b9823862aaa service swift] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:38.151793 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c3f08-b0d0-4e0c-a4b0-1b9823862aaa service swift] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:38.151997 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c3f08-b0d0-4e0c-a4b0-1b9823862aaa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:38.155265 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-396c3f08-b0d0-4e0c-a4b0-1b9823862aaa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:38.243903 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c3f08-b0d0-4e0c-a4b0-1b9823862aaa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:38.246153 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c3f08-b0d0-4e0c-a4b0-1b9823862aaa service swift] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:38.256444 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1143/2289] 10.222.0.96 () {60 vars in 1384 bytes} [Fri Jan 28 01:59:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:59:39.042165 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdb04e-7432-43f2-b0eb-9ac386608c88 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:39.042838 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdb04e-7432-43f2-b0eb-9ac386608c88 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:39.043254 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdb04e-7432-43f2-b0eb-9ac386608c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:39.064287 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-1cfdb04e-7432-43f2-b0eb-9ac386608c88 None None] MFA Rules not processed for user `591d508a3867412fac76d00134e58864`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:39.065789 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-1cfdb04e-7432-43f2-b0eb-9ac386608c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:39.073201 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1147/2290] 10.222.0.96 () {58 vars in 967 bytes} [Fri Jan 28 01:59:39 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:39.091189 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c3f08-b0d0-4e0c-a4b0-1b9823862aaa service swift] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:39.093007 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-396c3f08-b0d0-4e0c-a4b0-1b9823862aaa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:39.106833 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c3f08-b0d0-4e0c-a4b0-1b9823862aaa service swift] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:39.115127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb748a-a846-4ddc-a22e-865dc379ffd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a2c3b2815f46b0ac27944f004c4821', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:39.115808 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb748a-a846-4ddc-a22e-865dc379ffd7 service swift] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:39.116084 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb748a-a846-4ddc-a22e-865dc379ffd7 service swift] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:39.116351 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb748a-a846-4ddc-a22e-865dc379ffd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:39.125843 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb748a-a846-4ddc-a22e-865dc379ffd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:39.127491 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb748a-a846-4ddc-a22e-865dc379ffd7 service swift] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:39.137974 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1144/2291] 10.222.0.96 () {60 vars in 1384 bytes} [Fri Jan 28 01:59:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:59:39.326597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bef68e-1694-468f-b0bf-3b36366bf9b8 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:39.326883 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bef68e-1694-468f-b0bf-3b36366bf9b8 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:39.327163 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bef68e-1694-468f-b0bf-3b36366bf9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:39.349773 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-88bef68e-1694-468f-b0bf-3b36366bf9b8 None None] MFA Rules not processed for user `591d508a3867412fac76d00134e58864`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:39.350995 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-88bef68e-1694-468f-b0bf-3b36366bf9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:39.360602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1148/2292] 10.222.0.96 () {58 vars in 1009 bytes} [Fri Jan 28 01:59:39 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:39.379125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb748a-a846-4ddc-a22e-865dc379ffd7 service swift] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:39.389206 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab92aee-8caa-40b2-8198-fed896cd6abf None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:39.390100 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab92aee-8caa-40b2-8198-fed896cd6abf None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:39.391425 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab92aee-8caa-40b2-8198-fed896cd6abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:39.391729 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb748a-a846-4ddc-a22e-865dc379ffd7 service swift] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:39.399564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a58c8-bad0-4b42-8397-2341d99381be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a2c3b2815f46b0ac27944f004c4821', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:39.400957 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a58c8-bad0-4b42-8397-2341d99381be service swift] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:39.401443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a58c8-bad0-4b42-8397-2341d99381be service swift] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:39.401868 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a58c8-bad0-4b42-8397-2341d99381be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:39.415353 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-8ab92aee-8caa-40b2-8198-fed896cd6abf None None] MFA Rules not processed for user `591d508a3867412fac76d00134e58864`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:39.415572 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a58c8-bad0-4b42-8397-2341d99381be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:39.417301 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-8ab92aee-8caa-40b2-8198-fed896cd6abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:39.417442 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a58c8-bad0-4b42-8397-2341d99381be service swift] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:39.429735 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1145/2293] 10.222.0.96 () {60 vars in 1384 bytes} [Fri Jan 28 01:59:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:59:39.430973 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1149/2294] 10.222.0.96 () {58 vars in 1009 bytes} [Fri Jan 28 01:59:39 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:39.448565 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a58c8-bad0-4b42-8397-2341d99381be service swift] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:39.462992 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a58c8-bad0-4b42-8397-2341d99381be service swift] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:39.471137 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa6aa3-32a6-4b3d-a74a-3b187483de0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a2c3b2815f46b0ac27944f004c4821', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:39.471945 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa6aa3-32a6-4b3d-a74a-3b187483de0c service swift] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:39.472307 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa6aa3-32a6-4b3d-a74a-3b187483de0c service swift] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:39.472583 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa6aa3-32a6-4b3d-a74a-3b187483de0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:39.487124 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa6aa3-32a6-4b3d-a74a-3b187483de0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:39.489032 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa6aa3-32a6-4b3d-a74a-3b187483de0c service swift] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:39.514648 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1146/2295] 10.222.0.96 () {60 vars in 1384 bytes} [Fri Jan 28 01:59:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 01:59:39.939015 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568e52f-3bdd-4238-8822-fe714a314578 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:39.939300 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568e52f-3bdd-4238-8822-fe714a314578 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:39.939571 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568e52f-3bdd-4238-8822-fe714a314578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:39.961138 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-e568e52f-3bdd-4238-8822-fe714a314578 None None] MFA Rules not processed for user `591d508a3867412fac76d00134e58864`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:39.962845 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-e568e52f-3bdd-4238-8822-fe714a314578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:39.973226 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1150/2296] 10.222.0.96 () {58 vars in 967 bytes} [Fri Jan 28 01:59:39 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:40.018710 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa6aa3-32a6-4b3d-a74a-3b187483de0c service swift] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:40.037647 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa6aa3-32a6-4b3d-a74a-3b187483de0c service swift] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:40.046890 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51137a-1d1e-4537-9752-5db31fdb44ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a2c3b2815f46b0ac27944f004c4821', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:40.047809 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51137a-1d1e-4537-9752-5db31fdb44ef service swift] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:40.048464 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51137a-1d1e-4537-9752-5db31fdb44ef service swift] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:40.048991 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51137a-1d1e-4537-9752-5db31fdb44ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:40.087262 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51137a-1d1e-4537-9752-5db31fdb44ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:40.091168 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51137a-1d1e-4537-9752-5db31fdb44ef service swift] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:40.110308 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1147/2297] 10.222.0.96 () {60 vars in 1384 bytes} [Fri Jan 28 01:59:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:59:42.961042 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568e52f-3bdd-4238-8822-fe714a314578 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:42.963450 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-e568e52f-3bdd-4238-8822-fe714a314578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:43.114991 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568e52f-3bdd-4238-8822-fe714a314578 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:43.121288 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaf344-2eb3-41f1-8fe3-e1a76bd61a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:43.123407 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaf344-2eb3-41f1-8fe3-e1a76bd61a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:43.123761 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaf344-2eb3-41f1-8fe3-e1a76bd61a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:43.123993 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaf344-2eb3-41f1-8fe3-e1a76bd61a8b admin admin] PATH_INFO: `/v3/users/838b55acbe1a43538bb82db1e60c4c3c` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:43.125458 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aaf344-2eb3-41f1-8fe3-e1a76bd61a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=838b55acbe1a43538bb82db1e60c4c3c)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:43.127614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aaf344-2eb3-41f1-8fe3-e1a76bd61a8b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:43.280273 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-63aaf344-2eb3-41f1-8fe3-e1a76bd61a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '838b55acbe1a43538bb82db1e60c4c3c'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:43.281226 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-63aaf344-2eb3-41f1-8fe3-e1a76bd61a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '838b55acbe1a43538bb82db1e60c4c3c'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:43.281854 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-63aaf344-2eb3-41f1-8fe3-e1a76bd61a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '838b55acbe1a43538bb82db1e60c4c3c'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:43.293365 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-63aaf344-2eb3-41f1-8fe3-e1a76bd61a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '838b55acbe1a43538bb82db1e60c4c3c'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:43.307075 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-63aaf344-2eb3-41f1-8fe3-e1a76bd61a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '838b55acbe1a43538bb82db1e60c4c3c'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:43.329137 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1151/2298] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 01:59:42 2022] DELETE /identity/v3/users/838b55acbe1a43538bb82db1e60c4c3c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:59:43.335983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8c9c7-fea1-4f7c-96d2-d1c34206ce3e None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:43.336725 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8c9c7-fea1-4f7c-96d2-d1c34206ce3e None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:43.337258 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8c9c7-fea1-4f7c-96d2-d1c34206ce3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:43.415878 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-09f8c9c7-fea1-4f7c-96d2-d1c34206ce3e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:43.419585 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-09f8c9c7-fea1-4f7c-96d2-d1c34206ce3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:43.556116 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1148/2299] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:59:43 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:59:43.571589 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaf344-2eb3-41f1-8fe3-e1a76bd61a8b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:43.575185 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-63aaf344-2eb3-41f1-8fe3-e1a76bd61a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:43.667816 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaf344-2eb3-41f1-8fe3-e1a76bd61a8b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:43.678146 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef281a2-857d-4384-bb85-3516529ead69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:43.679244 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef281a2-857d-4384-bb85-3516529ead69 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:43.679967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef281a2-857d-4384-bb85-3516529ead69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:43.680479 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef281a2-857d-4384-bb85-3516529ead69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:43.708561 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef281a2-857d-4384-bb85-3516529ead69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:43.713174 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef281a2-857d-4384-bb85-3516529ead69 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:43.742125 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1152/2300] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:43 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:44.039425 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8c9c7-fea1-4f7c-96d2-d1c34206ce3e None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:44.041852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-09f8c9c7-fea1-4f7c-96d2-d1c34206ce3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:44.086649 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8c9c7-fea1-4f7c-96d2-d1c34206ce3e None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:44.103289 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db2dd9-65e1-419b-a4ed-062b24ad933f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:44.104435 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db2dd9-65e1-419b-a4ed-062b24ad933f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:44.104773 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db2dd9-65e1-419b-a4ed-062b24ad933f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:44.105010 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db2dd9-65e1-419b-a4ed-062b24ad933f admin admin] PATH_INFO: `/v3/projects/703391c3a9b64cf8a323d0fe7e105a6b` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:44.122527 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db2dd9-65e1-419b-a4ed-062b24ad933f admin admin] RBAC: Authorizing `identity:delete_project(project_id=703391c3a9b64cf8a323d0fe7e105a6b)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:44.132288 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db2dd9-65e1-419b-a4ed-062b24ad933f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:44.233625 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-79db2dd9-65e1-419b-a4ed-062b24ad933f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '703391c3a9b64cf8a323d0fe7e105a6b', 'request_id': 'req-79db2dd9-65e1-419b-a4ed-062b24ad933f'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:44.241398 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-79db2dd9-65e1-419b-a4ed-062b24ad933f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '703391c3a9b64cf8a323d0fe7e105a6b', 'request_id': 'req-79db2dd9-65e1-419b-a4ed-062b24ad933f'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:44.251988 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-79db2dd9-65e1-419b-a4ed-062b24ad933f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '703391c3a9b64cf8a323d0fe7e105a6b', 'request_id': 'req-79db2dd9-65e1-419b-a4ed-062b24ad933f'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:44.300874 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-79db2dd9-65e1-419b-a4ed-062b24ad933f admin admin] The token cache is being invalidate because project 703391c3a9b64cf8a323d0fe7e105a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:59:44.305485 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-79db2dd9-65e1-419b-a4ed-062b24ad933f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:44.306422 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-79db2dd9-65e1-419b-a4ed-062b24ad933f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:59:44.311448 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1149/2301] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 01:59:44 2022] DELETE /identity/v3/projects/703391c3a9b64cf8a323d0fe7e105a6b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:59:44.317757 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27902ea5-0ffe-4b70-bf24-e7f91fbdc7fb None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:44.318213 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27902ea5-0ffe-4b70-bf24-e7f91fbdc7fb None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:44.318545 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27902ea5-0ffe-4b70-bf24-e7f91fbdc7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:44.392518 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-27902ea5-0ffe-4b70-bf24-e7f91fbdc7fb None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:44.397180 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-27902ea5-0ffe-4b70-bf24-e7f91fbdc7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:44.522399 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1153/2302] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:59:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:44.525998 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d49a6-4c93-4de4-92f5-17ab474b599e None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:44.526522 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d49a6-4c93-4de4-92f5-17ab474b599e None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:44.526522 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d49a6-4c93-4de4-92f5-17ab474b599e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:44.565564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-c11d49a6-4c93-4de4-92f5-17ab474b599e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:44.566805 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c11d49a6-4c93-4de4-92f5-17ab474b599e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:44.581430 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1150/2303] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:59:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:44.589039 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27902ea5-0ffe-4b70-bf24-e7f91fbdc7fb None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:44.599549 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27902ea5-0ffe-4b70-bf24-e7f91fbdc7fb None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:44.604934 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82fd7d-bff1-4e84-942c-33729dfcd487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:44.606403 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82fd7d-bff1-4e84-942c-33729dfcd487 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:44.606782 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82fd7d-bff1-4e84-942c-33729dfcd487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:44.607394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82fd7d-bff1-4e84-942c-33729dfcd487 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:44.608244 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82fd7d-bff1-4e84-942c-33729dfcd487 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:59:44.609427 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82fd7d-bff1-4e84-942c-33729dfcd487 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:44.611220 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82fd7d-bff1-4e84-942c-33729dfcd487 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:44.636609 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1154/2304] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 01:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:44.641364 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d49a6-4c93-4de4-92f5-17ab474b599e None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:44.653671 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d49a6-4c93-4de4-92f5-17ab474b599e None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:44.669324 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79979c-712a-41ad-8d55-6a8effe94f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:44.670862 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79979c-712a-41ad-8d55-6a8effe94f7e admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:44.672288 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79979c-712a-41ad-8d55-6a8effe94f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:44.672873 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79979c-712a-41ad-8d55-6a8effe94f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:44.676220 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79979c-712a-41ad-8d55-6a8effe94f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:44.685537 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79979c-712a-41ad-8d55-6a8effe94f7e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:44.743934 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1151/2305] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 01:59:44 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:59:44.749177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82fd7d-bff1-4e84-942c-33729dfcd487 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:44.773184 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82fd7d-bff1-4e84-942c-33729dfcd487 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:44.858828 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127268b-850d-4b50-9b1b-268f242a31c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:44.859642 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127268b-850d-4b50-9b1b-268f242a31c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:44.860128 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127268b-850d-4b50-9b1b-268f242a31c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:44.860481 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127268b-850d-4b50-9b1b-268f242a31c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:44.861335 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127268b-850d-4b50-9b1b-268f242a31c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:44.863527 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127268b-850d-4b50-9b1b-268f242a31c1 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:44.889902 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1155/2306] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 01:59:44 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:59:44.895120 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79979c-712a-41ad-8d55-6a8effe94f7e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:44.915715 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79979c-712a-41ad-8d55-6a8effe94f7e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:44.922354 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7802ffb-4fc0-4b3b-8f29-7f36153990a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:44.923208 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7802ffb-4fc0-4b3b-8f29-7f36153990a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:44.923539 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7802ffb-4fc0-4b3b-8f29-7f36153990a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:44.923879 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7802ffb-4fc0-4b3b-8f29-7f36153990a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:44.924975 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7802ffb-4fc0-4b3b-8f29-7f36153990a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:44.926713 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7802ffb-4fc0-4b3b-8f29-7f36153990a3 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:44.940853 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1152/2307] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:59:44.947036 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127268b-850d-4b50-9b1b-268f242a31c1 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:44.991552 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127268b-850d-4b50-9b1b-268f242a31c1 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:45.005368 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c1702-6ab3-4bf4-8b58-e6e3ea5c9437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:45.007159 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c1702-6ab3-4bf4-8b58-e6e3ea5c9437 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:45.008220 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c1702-6ab3-4bf4-8b58-e6e3ea5c9437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:45.009346 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c1702-6ab3-4bf4-8b58-e6e3ea5c9437 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:45.011098 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c1702-6ab3-4bf4-8b58-e6e3ea5c9437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:45.014648 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c1702-6ab3-4bf4-8b58-e6e3ea5c9437 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:45.031486 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1156/2308] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 01:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:59:45.035658 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7802ffb-4fc0-4b3b-8f29-7f36153990a3 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:45.048218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7802ffb-4fc0-4b3b-8f29-7f36153990a3 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:45.054352 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85632cef-65b0-46a9-90ef-de397fafdff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:45.055871 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85632cef-65b0-46a9-90ef-de397fafdff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:45.056348 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85632cef-65b0-46a9-90ef-de397fafdff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:45.056780 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85632cef-65b0-46a9-90ef-de397fafdff5 admin admin] PATH_INFO: `/v3/projects/cf861e434da344c89d039fa373bd0742/users/4208d3afaa374826b47a3716a2e6d7cc/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:45.079766 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85632cef-65b0-46a9-90ef-de397fafdff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf861e434da344c89d039fa373bd0742, user_id=4208d3afaa374826b47a3716a2e6d7cc, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:45.083958 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85632cef-65b0-46a9-90ef-de397fafdff5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:45.111136 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1153/2309] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 01:59:45 2022] PUT /identity/v3/projects/cf861e434da344c89d039fa373bd0742/users/4208d3afaa374826b47a3716a2e6d7cc/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:59:45.116264 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3cc50-5294-4d31-839f-b4044b3063ce None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:45.116752 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3cc50-5294-4d31-839f-b4044b3063ce None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:45.117292 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3cc50-5294-4d31-839f-b4044b3063ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:45.142222 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-37f3cc50-5294-4d31-839f-b4044b3063ce None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:45.143704 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-37f3cc50-5294-4d31-839f-b4044b3063ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:45.243481 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1157/2310] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:59:45 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:45.252026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85632cef-65b0-46a9-90ef-de397fafdff5 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:45.254683 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-85632cef-65b0-46a9-90ef-de397fafdff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:45.347906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85632cef-65b0-46a9-90ef-de397fafdff5 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:45.354717 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c749e8c-2b20-4f71-bbc9-f4644be8c71d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:45.356652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c749e8c-2b20-4f71-bbc9-f4644be8c71d service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:45.357245 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c749e8c-2b20-4f71-bbc9-f4644be8c71d service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:45.357860 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c749e8c-2b20-4f71-bbc9-f4644be8c71d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:45.375412 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c749e8c-2b20-4f71-bbc9-f4644be8c71d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:45.378166 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c749e8c-2b20-4f71-bbc9-f4644be8c71d service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:45.410600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1154/2311] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:45 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:46.388926 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e073de5-c2de-4653-bdfe-583ee481b8fc None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:46.389751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e073de5-c2de-4653-bdfe-583ee481b8fc None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:46.389751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e073de5-c2de-4653-bdfe-583ee481b8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:46.429181 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-9e073de5-c2de-4653-bdfe-583ee481b8fc None None] MFA Rules not processed for user `4208d3afaa374826b47a3716a2e6d7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:46.430336 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-9e073de5-c2de-4653-bdfe-583ee481b8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:46.576759 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1158/2312] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:59:46 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:46.596398 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c749e8c-2b20-4f71-bbc9-f4644be8c71d service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:46.598216 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-3c749e8c-2b20-4f71-bbc9-f4644be8c71d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:46.766621 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c749e8c-2b20-4f71-bbc9-f4644be8c71d service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:46.772513 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4558cc3-fa38-4895-9406-f736f046c8e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:46.773689 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4558cc3-fa38-4895-9406-f736f046c8e4 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:46.773967 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4558cc3-fa38-4895-9406-f736f046c8e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:46.774449 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4558cc3-fa38-4895-9406-f736f046c8e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:46.787713 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4558cc3-fa38-4895-9406-f736f046c8e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:46.790404 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4558cc3-fa38-4895-9406-f736f046c8e4 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:46.803253 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1155/2313] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:46 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:48.571783 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc2543-0abd-4cad-8d31-68aeb97f9c88 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:48.572284 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc2543-0abd-4cad-8d31-68aeb97f9c88 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:48.572284 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc2543-0abd-4cad-8d31-68aeb97f9c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:48.607866 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-32cc2543-0abd-4cad-8d31-68aeb97f9c88 None None] MFA Rules not processed for user `4208d3afaa374826b47a3716a2e6d7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:48.609149 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-32cc2543-0abd-4cad-8d31-68aeb97f9c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:48.630932 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1159/2314] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 01:59:48 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:50.445544 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4558cc3-fa38-4895-9406-f736f046c8e4 service cinder] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:50.447421 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-a4558cc3-fa38-4895-9406-f736f046c8e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:50.671840 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4558cc3-fa38-4895-9406-f736f046c8e4 service cinder] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:50.684444 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378e1b5-3469-4dab-a976-1d99d3d6cbb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a16f0ecf3448428e969359be57dda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:50.685449 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378e1b5-3469-4dab-a976-1d99d3d6cbb3 service placement] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:50.686658 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378e1b5-3469-4dab-a976-1d99d3d6cbb3 service placement] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:50.686658 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378e1b5-3469-4dab-a976-1d99d3d6cbb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:50.700858 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-f378e1b5-3469-4dab-a976-1d99d3d6cbb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:50.723895 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378e1b5-3469-4dab-a976-1d99d3d6cbb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:50.725597 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378e1b5-3469-4dab-a976-1d99d3d6cbb3 service placement] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:50.764100 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1156/2315] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:50 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:00:00.207167 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaf870-4b4c-4ae0-8445-a33631005813 None None] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:00.207936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaf870-4b4c-4ae0-8445-a33631005813 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:00.208502 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaf870-4b4c-4ae0-8445-a33631005813 None None] PATH_INFO: `/` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:00.212232 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1160/2316] 10.222.0.96 () {54 vars in 921 bytes} [Fri Jan 28 02:00:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:00:00.219732 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45e724-6ac3-4020-bf31-3ea41a37fd9d None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:00.220344 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45e724-6ac3-4020-bf31-3ea41a37fd9d None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:00.220443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45e724-6ac3-4020-bf31-3ea41a37fd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:00.306369 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-de45e724-6ac3-4020-bf31-3ea41a37fd9d None None] MFA Rules not processed for user `cc85f5db9c3c47fca68ebab33b0bb73c`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:00.307950 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-de45e724-6ac3-4020-bf31-3ea41a37fd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:00.425979 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1157/2317] 10.222.0.96 () {58 vars in 1018 bytes} [Fri Jan 28 02:00:00 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:00.448882 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdaf870-4b4c-4ae0-8445-a33631005813 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:00.455853 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-8bdaf870-4b4c-4ae0-8445-a33631005813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:00.597215 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdaf870-4b4c-4ae0-8445-a33631005813 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:00.602680 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2a80c-bc70-43b4-9106-c06ff21795ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07298acc960e4154be7c79f2368a1952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:00.603747 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2a80c-bc70-43b4-9106-c06ff21795ad service glance] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:00.604221 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2a80c-bc70-43b4-9106-c06ff21795ad service glance] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:00.604539 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2a80c-bc70-43b4-9106-c06ff21795ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:00.623021 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2a80c-bc70-43b4-9106-c06ff21795ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:00.624719 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2a80c-bc70-43b4-9106-c06ff21795ad service glance] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:00.637715 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1161/2318] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:00 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:00:00.723786 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55f3f4-a0df-4063-9c9b-ba8da03d9d14 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:00.724094 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55f3f4-a0df-4063-9c9b-ba8da03d9d14 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:00.724365 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55f3f4-a0df-4063-9c9b-ba8da03d9d14 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:00.726217 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1158/2319] 10.222.0.96 () {54 vars in 921 bytes} [Fri Jan 28 02:00:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:00:00.732219 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22eb69-006b-4737-a51c-b8fa5c8d0b4e None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:00.732500 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22eb69-006b-4737-a51c-b8fa5c8d0b4e None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:00.732774 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22eb69-006b-4737-a51c-b8fa5c8d0b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:00.751429 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-5b22eb69-006b-4737-a51c-b8fa5c8d0b4e None None] MFA Rules not processed for user `4acc32735f0a418ba5620f6225500402`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:00.752644 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-5b22eb69-006b-4737-a51c-b8fa5c8d0b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:00.759276 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1162/2320] 10.222.0.96 () {58 vars in 1018 bytes} [Fri Jan 28 02:00:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:00:00.772659 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55f3f4-a0df-4063-9c9b-ba8da03d9d14 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:00.774427 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-5f55f3f4-a0df-4063-9c9b-ba8da03d9d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:00.787576 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55f3f4-a0df-4063-9c9b-ba8da03d9d14 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:00.791084 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb534c-c8a4-4ad7-a1fc-92cb4066ca1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:00.791713 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb534c-c8a4-4ad7-a1fc-92cb4066ca1f service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:00.791987 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb534c-c8a4-4ad7-a1fc-92cb4066ca1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:00.792254 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb534c-c8a4-4ad7-a1fc-92cb4066ca1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:00.799924 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb534c-c8a4-4ad7-a1fc-92cb4066ca1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:00.801366 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb534c-c8a4-4ad7-a1fc-92cb4066ca1f service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:00.810913 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1159/2321] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:00:04.913047 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211a0d6-519a-47fd-8d6a-2318689c27a9 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:04.913583 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211a0d6-519a-47fd-8d6a-2318689c27a9 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:04.913932 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211a0d6-519a-47fd-8d6a-2318689c27a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:05.005210 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-e211a0d6-519a-47fd-8d6a-2318689c27a9 None None] MFA Rules not processed for user `591d508a3867412fac76d00134e58864`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:05.008163 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-e211a0d6-519a-47fd-8d6a-2318689c27a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:05.100920 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1163/2322] 10.222.0.96 () {58 vars in 1009 bytes} [Fri Jan 28 02:00:04 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:05.115568 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb534c-c8a4-4ad7-a1fc-92cb4066ca1f service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:05.118369 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-dcbb534c-c8a4-4ad7-a1fc-92cb4066ca1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:05.279848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb534c-c8a4-4ad7-a1fc-92cb4066ca1f service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:05.286038 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742face-f3dc-46c1-ada3-37a1bf3b4197 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a2c3b2815f46b0ac27944f004c4821', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:05.287148 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742face-f3dc-46c1-ada3-37a1bf3b4197 service swift] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:05.287728 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742face-f3dc-46c1-ada3-37a1bf3b4197 service swift] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:05.288161 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742face-f3dc-46c1-ada3-37a1bf3b4197 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:05.299129 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742face-f3dc-46c1-ada3-37a1bf3b4197 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:05.301602 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742face-f3dc-46c1-ada3-37a1bf3b4197 service swift] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:05.313974 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1160/2323] 10.222.0.96 () {60 vars in 1384 bytes} [Fri Jan 28 02:00:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:00:05.635819 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211a0d6-519a-47fd-8d6a-2318689c27a9 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:05.656020 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211a0d6-519a-47fd-8d6a-2318689c27a9 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:05.662688 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9917f1-3176-44ce-bc17-b550852033b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:05.664172 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9917f1-3176-44ce-bc17-b550852033b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:05.664669 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9917f1-3176-44ce-bc17-b550852033b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:05.665219 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9917f1-3176-44ce-bc17-b550852033b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:05.669044 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-5d9917f1-3176-44ce-bc17-b550852033b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:05.762461 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9917f1-3176-44ce-bc17-b550852033b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:05.762461 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9917f1-3176-44ce-bc17-b550852033b7 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:05.762461 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1164/2324] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:05 2022] GET /identity/v3/auth/tokens => generated 3460 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:00:25.590463 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742face-f3dc-46c1-ada3-37a1bf3b4197 service swift] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:25.592454 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-3742face-f3dc-46c1-ada3-37a1bf3b4197 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:25.627238 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742face-f3dc-46c1-ada3-37a1bf3b4197 service swift] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:25.632965 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5e20d-5d17-435a-a181-f5a72e1e30ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:25.633837 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5e20d-5d17-435a-a181-f5a72e1e30ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:25.634108 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5e20d-5d17-435a-a181-f5a72e1e30ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:25.634375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5e20d-5d17-435a-a181-f5a72e1e30ba admin admin] PATH_INFO: `/v3/users/1f57e62502564821b4be822554d9f5a7` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:25.635580 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5e20d-5d17-435a-a181-f5a72e1e30ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f57e62502564821b4be822554d9f5a7)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:25.638527 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5e20d-5d17-435a-a181-f5a72e1e30ba admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:25.719043 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-8ea5e20d-5d17-435a-a181-f5a72e1e30ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f57e62502564821b4be822554d9f5a7'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:25.719996 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-8ea5e20d-5d17-435a-a181-f5a72e1e30ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f57e62502564821b4be822554d9f5a7'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:25.733166 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-8ea5e20d-5d17-435a-a181-f5a72e1e30ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f57e62502564821b4be822554d9f5a7'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:25.744508 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-8ea5e20d-5d17-435a-a181-f5a72e1e30ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f57e62502564821b4be822554d9f5a7'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:25.760916 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-8ea5e20d-5d17-435a-a181-f5a72e1e30ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f57e62502564821b4be822554d9f5a7'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:25.771860 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1161/2325] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:00:25 2022] DELETE /identity/v3/users/1f57e62502564821b4be822554d9f5a7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:00:25.962879 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9917f1-3176-44ce-bc17-b550852033b7 service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:25.975616 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9917f1-3176-44ce-bc17-b550852033b7 service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:26.041303 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2abd8-0fba-45f2-81f2-b74af54751e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:26.042156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2abd8-0fba-45f2-81f2-b74af54751e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:26.042962 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2abd8-0fba-45f2-81f2-b74af54751e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:26.043232 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2abd8-0fba-45f2-81f2-b74af54751e8 admin admin] PATH_INFO: `/v3/projects/f2f478fd06754a38b139c8415da6a514` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:26.044554 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2abd8-0fba-45f2-81f2-b74af54751e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f478fd06754a38b139c8415da6a514)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:26.046476 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2abd8-0fba-45f2-81f2-b74af54751e8 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:26.110545 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-62f2abd8-0fba-45f2-81f2-b74af54751e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f478fd06754a38b139c8415da6a514', 'request_id': 'req-62f2abd8-0fba-45f2-81f2-b74af54751e8'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:26.117159 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-62f2abd8-0fba-45f2-81f2-b74af54751e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f478fd06754a38b139c8415da6a514', 'request_id': 'req-62f2abd8-0fba-45f2-81f2-b74af54751e8'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:26.123792 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-62f2abd8-0fba-45f2-81f2-b74af54751e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f478fd06754a38b139c8415da6a514', 'request_id': 'req-62f2abd8-0fba-45f2-81f2-b74af54751e8'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:26.141534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-62f2abd8-0fba-45f2-81f2-b74af54751e8 admin admin] The token cache is being invalidate because project f2f478fd06754a38b139c8415da6a514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:00:26.141903 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-62f2abd8-0fba-45f2-81f2-b74af54751e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:26.142777 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-62f2abd8-0fba-45f2-81f2-b74af54751e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:26.145427 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1165/2326] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:00:25 2022] DELETE /identity/v3/projects/f2f478fd06754a38b139c8415da6a514 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:00:26.153820 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9e745-7987-4aee-b7cd-66379622e30b None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:26.153820 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9e745-7987-4aee-b7cd-66379622e30b None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:26.153820 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9e745-7987-4aee-b7cd-66379622e30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:26.176089 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-1cf9e745-7987-4aee-b7cd-66379622e30b None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:26.177416 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1cf9e745-7987-4aee-b7cd-66379622e30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:26.237428 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1162/2327] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:00:26 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:00:26.247797 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df7771-2e00-4eec-b558-575a43a22eb2 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:26.248089 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df7771-2e00-4eec-b558-575a43a22eb2 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:26.248365 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df7771-2e00-4eec-b558-575a43a22eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:26.267568 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-18df7771-2e00-4eec-b558-575a43a22eb2 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:26.268774 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-18df7771-2e00-4eec-b558-575a43a22eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:26.281097 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1166/2328] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:00:26 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:26.282517 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9e745-7987-4aee-b7cd-66379622e30b None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:26.294006 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9e745-7987-4aee-b7cd-66379622e30b None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:26.306536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daaf66b-ba39-417e-811b-1f3923ad1fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:26.307322 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daaf66b-ba39-417e-811b-1f3923ad1fca admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:26.307931 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daaf66b-ba39-417e-811b-1f3923ad1fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:26.308411 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daaf66b-ba39-417e-811b-1f3923ad1fca admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:26.309990 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daaf66b-ba39-417e-811b-1f3923ad1fca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:00:26.310693 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daaf66b-ba39-417e-811b-1f3923ad1fca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:26.314261 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daaf66b-ba39-417e-811b-1f3923ad1fca admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:26.336992 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1163/2329] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:00:26.344938 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df7771-2e00-4eec-b558-575a43a22eb2 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:26.369851 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df7771-2e00-4eec-b558-575a43a22eb2 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:26.378861 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab1e9f-7f79-4194-8178-8bb0a0b623e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:26.379791 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab1e9f-7f79-4194-8178-8bb0a0b623e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:26.380269 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab1e9f-7f79-4194-8178-8bb0a0b623e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:26.380758 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab1e9f-7f79-4194-8178-8bb0a0b623e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:26.382067 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab1e9f-7f79-4194-8178-8bb0a0b623e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:26.385767 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab1e9f-7f79-4194-8178-8bb0a0b623e1 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:26.451164 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1167/2330] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:00:26 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:00:26.453034 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daaf66b-ba39-417e-811b-1f3923ad1fca admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:26.474100 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daaf66b-ba39-417e-811b-1f3923ad1fca admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:26.568874 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de5831-91d4-4d9e-a6bc-d69795b1b02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:26.569654 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de5831-91d4-4d9e-a6bc-d69795b1b02a admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:26.569937 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de5831-91d4-4d9e-a6bc-d69795b1b02a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:26.570251 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de5831-91d4-4d9e-a6bc-d69795b1b02a admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:26.570940 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de5831-91d4-4d9e-a6bc-d69795b1b02a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:26.573260 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de5831-91d4-4d9e-a6bc-d69795b1b02a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:26.616867 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1164/2331] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:00:26 2022] POST /identity/v3/users => generated 284 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:00:26.619298 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab1e9f-7f79-4194-8178-8bb0a0b623e1 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:26.642417 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab1e9f-7f79-4194-8178-8bb0a0b623e1 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:26.650118 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3432ac-7ad7-472d-bef5-a245f4997ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:26.650801 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3432ac-7ad7-472d-bef5-a245f4997ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:26.651084 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3432ac-7ad7-472d-bef5-a245f4997ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:26.651358 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3432ac-7ad7-472d-bef5-a245f4997ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:26.652645 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3432ac-7ad7-472d-bef5-a245f4997ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:26.654537 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3432ac-7ad7-472d-bef5-a245f4997ab4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:26.666264 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1168/2332] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:00:26.670413 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de5831-91d4-4d9e-a6bc-d69795b1b02a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:26.682122 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de5831-91d4-4d9e-a6bc-d69795b1b02a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:26.689081 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64646f5c-e448-4946-b442-6ac26afc4e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:26.689813 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64646f5c-e448-4946-b442-6ac26afc4e1f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:26.690112 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64646f5c-e448-4946-b442-6ac26afc4e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:26.690404 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64646f5c-e448-4946-b442-6ac26afc4e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:26.691134 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64646f5c-e448-4946-b442-6ac26afc4e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:26.692737 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64646f5c-e448-4946-b442-6ac26afc4e1f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:26.705154 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1165/2333] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:00:26.709309 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3432ac-7ad7-472d-bef5-a245f4997ab4 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:26.721658 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3432ac-7ad7-472d-bef5-a245f4997ab4 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:26.726752 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680124f2-dd9c-4c22-87ad-3faa7b1ff6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:26.727654 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680124f2-dd9c-4c22-87ad-3faa7b1ff6a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:26.727928 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680124f2-dd9c-4c22-87ad-3faa7b1ff6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:26.728200 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680124f2-dd9c-4c22-87ad-3faa7b1ff6a9 admin admin] PATH_INFO: `/v3/projects/e0a1076cae1c440b8170dee36c8ff8d6/users/c48e3e19be384134992fb53a40bcc2f0/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:26.743775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680124f2-dd9c-4c22-87ad-3faa7b1ff6a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a1076cae1c440b8170dee36c8ff8d6, user_id=c48e3e19be384134992fb53a40bcc2f0, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:26.747206 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680124f2-dd9c-4c22-87ad-3faa7b1ff6a9 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:26.760725 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1169/2334] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:00:26 2022] PUT /identity/v3/projects/e0a1076cae1c440b8170dee36c8ff8d6/users/c48e3e19be384134992fb53a40bcc2f0/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:00:26.774008 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a056f9-62ba-45f2-a2c9-23043c851162 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:26.774726 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a056f9-62ba-45f2-a2c9-23043c851162 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:26.775066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a056f9-62ba-45f2-a2c9-23043c851162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:26.817328 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-66a056f9-62ba-45f2-a2c9-23043c851162 None None] MFA Rules not processed for user `c48e3e19be384134992fb53a40bcc2f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:26.818632 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-66a056f9-62ba-45f2-a2c9-23043c851162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:26.894371 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1166/2335] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:00:26 2022] POST /identity/v3/auth/tokens => generated 3387 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:00:26.905769 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680124f2-dd9c-4c22-87ad-3faa7b1ff6a9 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:26.907711 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-680124f2-dd9c-4c22-87ad-3faa7b1ff6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:26.974579 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680124f2-dd9c-4c22-87ad-3faa7b1ff6a9 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:26.978341 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ceff18-71bd-48b6-80ad-a7093f7a5983 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:26.979130 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ceff18-71bd-48b6-80ad-a7093f7a5983 service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:26.979407 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ceff18-71bd-48b6-80ad-a7093f7a5983 service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:26.979678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ceff18-71bd-48b6-80ad-a7093f7a5983 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:26.990408 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ceff18-71bd-48b6-80ad-a7093f7a5983 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:26.991854 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ceff18-71bd-48b6-80ad-a7093f7a5983 service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:27.001895 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1170/2336] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:26 2022] GET /identity/v3/auth/tokens => generated 3387 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:00:28.825394 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b9f5a-78f8-43c5-a07d-75d4c7350bfa None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:28.826049 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b9f5a-78f8-43c5-a07d-75d4c7350bfa None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:28.826049 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b9f5a-78f8-43c5-a07d-75d4c7350bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:28.867393 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-bf1b9f5a-78f8-43c5-a07d-75d4c7350bfa None None] MFA Rules not processed for user `591d508a3867412fac76d00134e58864`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:28.869478 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-bf1b9f5a-78f8-43c5-a07d-75d4c7350bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:28.977797 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1167/2337] 10.222.0.96 () {58 vars in 967 bytes} [Fri Jan 28 02:00:28 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:29.000265 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ceff18-71bd-48b6-80ad-a7093f7a5983 service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:29.001873 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-f6ceff18-71bd-48b6-80ad-a7093f7a5983 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:29.099790 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ceff18-71bd-48b6-80ad-a7093f7a5983 service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:29.105010 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29aa92-3de3-4cec-ac05-81ca01cf3466 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a2c3b2815f46b0ac27944f004c4821', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:29.105689 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29aa92-3de3-4cec-ac05-81ca01cf3466 service swift] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:29.105966 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29aa92-3de3-4cec-ac05-81ca01cf3466 service swift] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:29.106248 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29aa92-3de3-4cec-ac05-81ca01cf3466 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:29.115417 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29aa92-3de3-4cec-ac05-81ca01cf3466 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:29.117083 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29aa92-3de3-4cec-ac05-81ca01cf3466 service swift] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:29.127241 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1171/2338] 10.222.0.96 () {60 vars in 1384 bytes} [Fri Jan 28 02:00:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 02:00:35.804997 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b9f5a-78f8-43c5-a07d-75d4c7350bfa None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:35.871344 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b9f5a-78f8-43c5-a07d-75d4c7350bfa None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:35.876073 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eede47-66da-408c-9d97-dd9599d4f1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:35.876974 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eede47-66da-408c-9d97-dd9599d4f1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:35.877247 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eede47-66da-408c-9d97-dd9599d4f1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:35.877514 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eede47-66da-408c-9d97-dd9599d4f1f4 admin admin] PATH_INFO: `/v3/users/c48e3e19be384134992fb53a40bcc2f0` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:35.878717 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eede47-66da-408c-9d97-dd9599d4f1f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c48e3e19be384134992fb53a40bcc2f0)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:35.880621 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eede47-66da-408c-9d97-dd9599d4f1f4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:35.929312 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-30eede47-66da-408c-9d97-dd9599d4f1f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c48e3e19be384134992fb53a40bcc2f0'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:35.929950 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-30eede47-66da-408c-9d97-dd9599d4f1f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c48e3e19be384134992fb53a40bcc2f0'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:35.940692 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-30eede47-66da-408c-9d97-dd9599d4f1f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c48e3e19be384134992fb53a40bcc2f0'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:35.951430 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-30eede47-66da-408c-9d97-dd9599d4f1f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c48e3e19be384134992fb53a40bcc2f0'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:35.966267 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-30eede47-66da-408c-9d97-dd9599d4f1f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c48e3e19be384134992fb53a40bcc2f0'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:35.972312 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1168/2339] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:00:35 2022] DELETE /identity/v3/users/c48e3e19be384134992fb53a40bcc2f0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:00:35.984733 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d1a25-1ce7-43d2-bef3-4f8fcc059d4c None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:35.984733 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d1a25-1ce7-43d2-bef3-4f8fcc059d4c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:35.984733 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d1a25-1ce7-43d2-bef3-4f8fcc059d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:35.998388 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-ee9d1a25-1ce7-43d2-bef3-4f8fcc059d4c None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:35.999600 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-ee9d1a25-1ce7-43d2-bef3-4f8fcc059d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:36.059778 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1172/2340] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:00:35 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:00:36.069796 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eede47-66da-408c-9d97-dd9599d4f1f4 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:36.071208 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-30eede47-66da-408c-9d97-dd9599d4f1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:36.130630 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eede47-66da-408c-9d97-dd9599d4f1f4 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:36.134391 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd672a-1021-4f31-a3fa-6c31d08e2f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:36.135035 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd672a-1021-4f31-a3fa-6c31d08e2f57 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:36.135313 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd672a-1021-4f31-a3fa-6c31d08e2f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:36.135584 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd672a-1021-4f31-a3fa-6c31d08e2f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:36.146664 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd672a-1021-4f31-a3fa-6c31d08e2f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:36.148130 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd672a-1021-4f31-a3fa-6c31d08e2f57 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:36.159567 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1169/2341] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:36 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:00:36.494837 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d1a25-1ce7-43d2-bef3-4f8fcc059d4c None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:36.497574 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-ee9d1a25-1ce7-43d2-bef3-4f8fcc059d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:36.511971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d1a25-1ce7-43d2-bef3-4f8fcc059d4c None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:36.520630 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a84f5-36fc-4373-a50f-5d445906f2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:36.521718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a84f5-36fc-4373-a50f-5d445906f2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:36.522033 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a84f5-36fc-4373-a50f-5d445906f2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:36.522254 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a84f5-36fc-4373-a50f-5d445906f2ee admin admin] PATH_INFO: `/v3/projects/e0a1076cae1c440b8170dee36c8ff8d6` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:36.523659 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a84f5-36fc-4373-a50f-5d445906f2ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a1076cae1c440b8170dee36c8ff8d6)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:36.525591 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a84f5-36fc-4373-a50f-5d445906f2ee admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:36.579893 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-543a84f5-36fc-4373-a50f-5d445906f2ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a1076cae1c440b8170dee36c8ff8d6', 'request_id': 'req-543a84f5-36fc-4373-a50f-5d445906f2ee'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:36.587443 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-543a84f5-36fc-4373-a50f-5d445906f2ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a1076cae1c440b8170dee36c8ff8d6', 'request_id': 'req-543a84f5-36fc-4373-a50f-5d445906f2ee'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:36.593953 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-543a84f5-36fc-4373-a50f-5d445906f2ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a1076cae1c440b8170dee36c8ff8d6', 'request_id': 'req-543a84f5-36fc-4373-a50f-5d445906f2ee'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:36.607370 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-543a84f5-36fc-4373-a50f-5d445906f2ee admin admin] The token cache is being invalidate because project e0a1076cae1c440b8170dee36c8ff8d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:00:36.607665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-543a84f5-36fc-4373-a50f-5d445906f2ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:36.608493 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-543a84f5-36fc-4373-a50f-5d445906f2ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:36.610524 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1173/2342] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:00:36 2022] DELETE /identity/v3/projects/e0a1076cae1c440b8170dee36c8ff8d6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:00:36.616416 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb22436-51b7-4650-8a06-4ddea5228534 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:36.616586 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb22436-51b7-4650-8a06-4ddea5228534 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:36.616742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb22436-51b7-4650-8a06-4ddea5228534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:36.635075 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-3fb22436-51b7-4650-8a06-4ddea5228534 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:36.637178 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-3fb22436-51b7-4650-8a06-4ddea5228534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:36.705567 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1170/2343] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:00:36 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:36.713434 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519a957-d5b0-4a52-8a63-02acce6e5a80 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:36.713720 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519a957-d5b0-4a52-8a63-02acce6e5a80 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:36.713999 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519a957-d5b0-4a52-8a63-02acce6e5a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:36.734396 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-5519a957-d5b0-4a52-8a63-02acce6e5a80 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:36.735621 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-5519a957-d5b0-4a52-8a63-02acce6e5a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:36.743604 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1174/2344] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:00:36 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:36.748344 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb22436-51b7-4650-8a06-4ddea5228534 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:36.758131 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb22436-51b7-4650-8a06-4ddea5228534 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:36.762831 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e34b99-bb2e-460f-bbdd-f6b627bde21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:36.763483 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e34b99-bb2e-460f-bbdd-f6b627bde21d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:36.763755 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e34b99-bb2e-460f-bbdd-f6b627bde21d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:36.764025 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e34b99-bb2e-460f-bbdd-f6b627bde21d admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:36.764736 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e34b99-bb2e-460f-bbdd-f6b627bde21d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:00:36.765062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e34b99-bb2e-460f-bbdd-f6b627bde21d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:36.766657 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e34b99-bb2e-460f-bbdd-f6b627bde21d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:36.779251 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1171/2345] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:00:36.783524 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519a957-d5b0-4a52-8a63-02acce6e5a80 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:36.793422 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519a957-d5b0-4a52-8a63-02acce6e5a80 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:36.798112 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671afe7e-f17d-42cb-adea-83761dcaba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:36.798873 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671afe7e-f17d-42cb-adea-83761dcaba20 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:36.799029 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671afe7e-f17d-42cb-adea-83761dcaba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:36.799295 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671afe7e-f17d-42cb-adea-83761dcaba20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:36.799984 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671afe7e-f17d-42cb-adea-83761dcaba20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:36.801887 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671afe7e-f17d-42cb-adea-83761dcaba20 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:36.827962 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1175/2346] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:00:36 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:00:36.832113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e34b99-bb2e-460f-bbdd-f6b627bde21d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:36.843108 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e34b99-bb2e-460f-bbdd-f6b627bde21d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:36.898834 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcbf5b-2c74-4c2e-8d8b-2ac65b3eb885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:36.899418 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcbf5b-2c74-4c2e-8d8b-2ac65b3eb885 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:36.899708 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcbf5b-2c74-4c2e-8d8b-2ac65b3eb885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:36.899982 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcbf5b-2c74-4c2e-8d8b-2ac65b3eb885 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:36.900667 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcbf5b-2c74-4c2e-8d8b-2ac65b3eb885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:36.903697 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcbf5b-2c74-4c2e-8d8b-2ac65b3eb885 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:36.924817 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1172/2347] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:00:36 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:00:36.929000 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671afe7e-f17d-42cb-adea-83761dcaba20 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:36.939362 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671afe7e-f17d-42cb-adea-83761dcaba20 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:36.944203 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8836d1c-fb2d-4a0e-b945-a8037b5b8dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:36.944925 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8836d1c-fb2d-4a0e-b945-a8037b5b8dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:36.945201 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8836d1c-fb2d-4a0e-b945-a8037b5b8dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:36.945467 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8836d1c-fb2d-4a0e-b945-a8037b5b8dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:36.946179 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8836d1c-fb2d-4a0e-b945-a8037b5b8dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:36.947743 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8836d1c-fb2d-4a0e-b945-a8037b5b8dc9 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:36.959530 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1176/2348] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:00:36.963494 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcbf5b-2c74-4c2e-8d8b-2ac65b3eb885 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:36.974427 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcbf5b-2c74-4c2e-8d8b-2ac65b3eb885 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:36.979201 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc5e8c-b0ed-4764-926e-26fc1595ae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:36.979855 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc5e8c-b0ed-4764-926e-26fc1595ae01 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:36.980294 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc5e8c-b0ed-4764-926e-26fc1595ae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:36.980775 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc5e8c-b0ed-4764-926e-26fc1595ae01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:36.981657 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc5e8c-b0ed-4764-926e-26fc1595ae01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:36.983225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc5e8c-b0ed-4764-926e-26fc1595ae01 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:36.996686 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1173/2349] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:00:36.997962 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8836d1c-fb2d-4a0e-b945-a8037b5b8dc9 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:37.007949 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8836d1c-fb2d-4a0e-b945-a8037b5b8dc9 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:37.013311 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1c8da-b425-4d40-96bf-891f4a49459f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:37.014164 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1c8da-b425-4d40-96bf-891f4a49459f admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:37.014442 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1c8da-b425-4d40-96bf-891f4a49459f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:37.014712 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1c8da-b425-4d40-96bf-891f4a49459f admin admin] PATH_INFO: `/v3/projects/4c7d8ca1f6824017a8e983dc834de134/users/e2258033f56a40b1b3c601f97763879f/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:37.030696 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1c8da-b425-4d40-96bf-891f4a49459f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7d8ca1f6824017a8e983dc834de134, user_id=e2258033f56a40b1b3c601f97763879f, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:37.033361 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1c8da-b425-4d40-96bf-891f4a49459f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:37.047419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1177/2350] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:00:36 2022] PUT /identity/v3/projects/4c7d8ca1f6824017a8e983dc834de134/users/e2258033f56a40b1b3c601f97763879f/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:00:37.057541 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae57ee2-2ac6-413b-b04c-e7ef73df4a18 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:37.057924 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae57ee2-2ac6-413b-b04c-e7ef73df4a18 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:37.058139 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae57ee2-2ac6-413b-b04c-e7ef73df4a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:37.084857 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-8ae57ee2-2ac6-413b-b04c-e7ef73df4a18 None None] MFA Rules not processed for user `e2258033f56a40b1b3c601f97763879f`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:37.085884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-8ae57ee2-2ac6-413b-b04c-e7ef73df4a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:37.152865 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1174/2351] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:00:37 2022] POST /identity/v3/auth/tokens => generated 3393 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:37.155669 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1c8da-b425-4d40-96bf-891f4a49459f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:37.213356 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1c8da-b425-4d40-96bf-891f4a49459f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:37.218654 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4845b-cca0-48e0-a5bc-607445457712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:37.219303 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4845b-cca0-48e0-a5bc-607445457712 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:37.219582 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4845b-cca0-48e0-a5bc-607445457712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:37.219853 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4845b-cca0-48e0-a5bc-607445457712 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:37.220541 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4845b-cca0-48e0-a5bc-607445457712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:37.222458 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4845b-cca0-48e0-a5bc-607445457712 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:37.247973 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1178/2352] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:00:37 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:00:37.252181 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae57ee2-2ac6-413b-b04c-e7ef73df4a18 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:37.264282 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae57ee2-2ac6-413b-b04c-e7ef73df4a18 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:37.319709 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5e3b6-a13f-438a-84ae-fafcb61ee88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:37.320372 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5e3b6-a13f-438a-84ae-fafcb61ee88c admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:37.320648 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5e3b6-a13f-438a-84ae-fafcb61ee88c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:37.320952 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5e3b6-a13f-438a-84ae-fafcb61ee88c admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:37.321631 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5e3b6-a13f-438a-84ae-fafcb61ee88c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:37.323548 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5e3b6-a13f-438a-84ae-fafcb61ee88c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:37.344342 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1175/2353] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:00:37 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:00:37.348525 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4845b-cca0-48e0-a5bc-607445457712 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:37.359928 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4845b-cca0-48e0-a5bc-607445457712 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:37.364736 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93057be-07dd-42a3-9fd3-8ab5fbf2cf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:37.365426 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93057be-07dd-42a3-9fd3-8ab5fbf2cf36 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:37.365706 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93057be-07dd-42a3-9fd3-8ab5fbf2cf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:37.365978 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93057be-07dd-42a3-9fd3-8ab5fbf2cf36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:37.366690 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93057be-07dd-42a3-9fd3-8ab5fbf2cf36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:37.368275 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93057be-07dd-42a3-9fd3-8ab5fbf2cf36 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:37.381476 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1179/2354] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:00:37.385722 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5e3b6-a13f-438a-84ae-fafcb61ee88c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:37.396445 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5e3b6-a13f-438a-84ae-fafcb61ee88c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:37.401131 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9eb40-1660-4f9c-91a9-a9285c5e60de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:37.402335 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9eb40-1660-4f9c-91a9-a9285c5e60de admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:37.402723 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9eb40-1660-4f9c-91a9-a9285c5e60de admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:37.403319 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9eb40-1660-4f9c-91a9-a9285c5e60de admin admin] PATH_INFO: `/v3/projects/632ca1788cd1468f906e1ebb1e422c0f/users/0d158c15ab2642489a3a0cc022c1ee28/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:37.418105 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9eb40-1660-4f9c-91a9-a9285c5e60de admin admin] RBAC: Authorizing `identity:create_grant(project_id=632ca1788cd1468f906e1ebb1e422c0f, user_id=0d158c15ab2642489a3a0cc022c1ee28, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:37.420837 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9eb40-1660-4f9c-91a9-a9285c5e60de admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:37.435731 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1176/2355] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:00:37 2022] PUT /identity/v3/projects/632ca1788cd1468f906e1ebb1e422c0f/users/0d158c15ab2642489a3a0cc022c1ee28/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:00:37.439915 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93057be-07dd-42a3-9fd3-8ab5fbf2cf36 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:37.451171 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93057be-07dd-42a3-9fd3-8ab5fbf2cf36 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:37.510036 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026cc76-21d0-414e-bfab-134cfc86140b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:37.510727 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026cc76-21d0-414e-bfab-134cfc86140b admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:37.511004 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026cc76-21d0-414e-bfab-134cfc86140b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:37.512861 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026cc76-21d0-414e-bfab-134cfc86140b admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:37.513735 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026cc76-21d0-414e-bfab-134cfc86140b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:37.515356 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026cc76-21d0-414e-bfab-134cfc86140b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:37.526544 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1180/2356] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:00:37.534267 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9eb40-1660-4f9c-91a9-a9285c5e60de admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:37.546580 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9eb40-1660-4f9c-91a9-a9285c5e60de admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:37.551649 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a09c86-cccc-43ab-88e4-ee2646c49574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:37.552606 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a09c86-cccc-43ab-88e4-ee2646c49574 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:37.552936 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a09c86-cccc-43ab-88e4-ee2646c49574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:37.553209 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a09c86-cccc-43ab-88e4-ee2646c49574 admin admin] PATH_INFO: `/v3/projects/632ca1788cd1468f906e1ebb1e422c0f/users/0d158c15ab2642489a3a0cc022c1ee28/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:37.555369 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a09c86-cccc-43ab-88e4-ee2646c49574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=632ca1788cd1468f906e1ebb1e422c0f, user_id=0d158c15ab2642489a3a0cc022c1ee28, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:37.558824 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a09c86-cccc-43ab-88e4-ee2646c49574 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:37.571765 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1177/2357] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:00:37 2022] PUT /identity/v3/projects/632ca1788cd1468f906e1ebb1e422c0f/users/0d158c15ab2642489a3a0cc022c1ee28/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:00:37.586485 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbce76-1026-4c90-b1f9-78bfdae15437 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:37.586771 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbce76-1026-4c90-b1f9-78bfdae15437 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:37.587156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbce76-1026-4c90-b1f9-78bfdae15437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:37.615097 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-12fbce76-1026-4c90-b1f9-78bfdae15437 None None] MFA Rules not processed for user `0d158c15ab2642489a3a0cc022c1ee28`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:37.616309 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-12fbce76-1026-4c90-b1f9-78bfdae15437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:37.685911 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1181/2358] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:00:37 2022] POST /identity/v3/auth/tokens => generated 3460 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:37.696231 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a09c86-cccc-43ab-88e4-ee2646c49574 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:37.698104 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-38a09c86-cccc-43ab-88e4-ee2646c49574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:37.755717 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a09c86-cccc-43ab-88e4-ee2646c49574 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:37.759470 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293e084-6897-4c88-ab95-68afb74038f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:37.760112 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293e084-6897-4c88-ab95-68afb74038f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:37.760393 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293e084-6897-4c88-ab95-68afb74038f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:37.760672 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293e084-6897-4c88-ab95-68afb74038f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:37.770517 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293e084-6897-4c88-ab95-68afb74038f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:37.771951 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293e084-6897-4c88-ab95-68afb74038f9 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:37.782850 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1178/2359] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:37 2022] GET /identity/v3/auth/tokens => generated 3460 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:00:37.852564 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbce76-1026-4c90-b1f9-78bfdae15437 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:37.862730 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbce76-1026-4c90-b1f9-78bfdae15437 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:37.866442 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1b0f2-6072-4db3-9307-6355eb10d1f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:37.867083 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1b0f2-6072-4db3-9307-6355eb10d1f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:37.867363 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1b0f2-6072-4db3-9307-6355eb10d1f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:37.867637 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1b0f2-6072-4db3-9307-6355eb10d1f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:37.924416 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1b0f2-6072-4db3-9307-6355eb10d1f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:37.926003 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1b0f2-6072-4db3-9307-6355eb10d1f9 service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:37.935833 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1182/2360] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:37 2022] GET /identity/v3/auth/tokens => generated 3393 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:00:48.661722 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293e084-6897-4c88-ab95-68afb74038f9 service cinder] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:48.663249 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-d293e084-6897-4c88-ab95-68afb74038f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:48.737784 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293e084-6897-4c88-ab95-68afb74038f9 service cinder] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:48.743282 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c791ed-2b64-4b74-8b76-b585c7a8ee98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:48.744021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c791ed-2b64-4b74-8b76-b585c7a8ee98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:48.744298 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c791ed-2b64-4b74-8b76-b585c7a8ee98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:48.744576 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c791ed-2b64-4b74-8b76-b585c7a8ee98 admin admin] PATH_INFO: `/v3/users/7b8f259580b84c1da7ccd7dd9391e406` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:48.747070 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c791ed-2b64-4b74-8b76-b585c7a8ee98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b8f259580b84c1da7ccd7dd9391e406)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:48.749034 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c791ed-2b64-4b74-8b76-b585c7a8ee98 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:48.801232 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-20c791ed-2b64-4b74-8b76-b585c7a8ee98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b8f259580b84c1da7ccd7dd9391e406'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:48.801914 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-20c791ed-2b64-4b74-8b76-b585c7a8ee98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b8f259580b84c1da7ccd7dd9391e406'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:48.809591 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-20c791ed-2b64-4b74-8b76-b585c7a8ee98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b8f259580b84c1da7ccd7dd9391e406'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:48.818008 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-20c791ed-2b64-4b74-8b76-b585c7a8ee98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b8f259580b84c1da7ccd7dd9391e406'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:48.832143 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-20c791ed-2b64-4b74-8b76-b585c7a8ee98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b8f259580b84c1da7ccd7dd9391e406'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:48.838400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1179/2361] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:00:48 2022] DELETE /identity/v3/users/7b8f259580b84c1da7ccd7dd9391e406 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:00:49.015795 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1b0f2-6072-4db3-9307-6355eb10d1f9 service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:49.037802 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1b0f2-6072-4db3-9307-6355eb10d1f9 service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:49.096949 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9acfc-97e3-48b2-bc4b-a2497f3f883f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:49.097806 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9acfc-97e3-48b2-bc4b-a2497f3f883f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:49.098118 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9acfc-97e3-48b2-bc4b-a2497f3f883f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:49.098391 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9acfc-97e3-48b2-bc4b-a2497f3f883f admin admin] PATH_INFO: `/v3/projects/d068e263c4ba4c6fa1bc08b5e2c90d4d` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:49.099579 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9acfc-97e3-48b2-bc4b-a2497f3f883f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d068e263c4ba4c6fa1bc08b5e2c90d4d)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:49.101523 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9acfc-97e3-48b2-bc4b-a2497f3f883f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:49.149961 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-87b9acfc-97e3-48b2-bc4b-a2497f3f883f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'request_id': 'req-87b9acfc-97e3-48b2-bc4b-a2497f3f883f'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:49.156682 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-87b9acfc-97e3-48b2-bc4b-a2497f3f883f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'request_id': 'req-87b9acfc-97e3-48b2-bc4b-a2497f3f883f'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:49.162027 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-87b9acfc-97e3-48b2-bc4b-a2497f3f883f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd068e263c4ba4c6fa1bc08b5e2c90d4d', 'request_id': 'req-87b9acfc-97e3-48b2-bc4b-a2497f3f883f'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:49.175691 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-87b9acfc-97e3-48b2-bc4b-a2497f3f883f admin admin] The token cache is being invalidate because project d068e263c4ba4c6fa1bc08b5e2c90d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:00:49.175864 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-87b9acfc-97e3-48b2-bc4b-a2497f3f883f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:49.176413 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-87b9acfc-97e3-48b2-bc4b-a2497f3f883f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:00:49.178004 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1183/2362] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:00:49 2022] DELETE /identity/v3/projects/d068e263c4ba4c6fa1bc08b5e2c90d4d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:00:49.184436 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9abb7-d59b-4e0c-a100-ef7cef61b0ab None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:49.184715 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9abb7-d59b-4e0c-a100-ef7cef61b0ab None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:49.185031 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9abb7-d59b-4e0c-a100-ef7cef61b0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:49.203163 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-c9c9abb7-d59b-4e0c-a100-ef7cef61b0ab None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:49.204383 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c9c9abb7-d59b-4e0c-a100-ef7cef61b0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:49.264858 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1180/2363] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:00:49 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:49.272790 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632b9aa-7962-4818-8653-84653c2415ac None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:49.273096 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632b9aa-7962-4818-8653-84653c2415ac None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:49.273370 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632b9aa-7962-4818-8653-84653c2415ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:49.292963 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-5632b9aa-7962-4818-8653-84653c2415ac None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:49.294155 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-5632b9aa-7962-4818-8653-84653c2415ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:49.302014 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1184/2364] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:00:49 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:49.306266 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9abb7-d59b-4e0c-a100-ef7cef61b0ab None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:49.316769 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9abb7-d59b-4e0c-a100-ef7cef61b0ab None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:49.326804 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795c55b-72bb-4d94-90fe-4434558f5186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:49.327652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795c55b-72bb-4d94-90fe-4434558f5186 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:49.328532 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795c55b-72bb-4d94-90fe-4434558f5186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:49.328655 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795c55b-72bb-4d94-90fe-4434558f5186 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:49.329811 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795c55b-72bb-4d94-90fe-4434558f5186 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:00:49.330288 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795c55b-72bb-4d94-90fe-4434558f5186 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:49.331934 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795c55b-72bb-4d94-90fe-4434558f5186 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:49.344750 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1181/2365] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:00:49.349151 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632b9aa-7962-4818-8653-84653c2415ac None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:49.359004 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632b9aa-7962-4818-8653-84653c2415ac None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:49.365026 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6f115-6d40-4a58-853c-fd2d448f49e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:49.365697 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6f115-6d40-4a58-853c-fd2d448f49e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:49.365974 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6f115-6d40-4a58-853c-fd2d448f49e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:49.366242 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6f115-6d40-4a58-853c-fd2d448f49e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:49.366941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6f115-6d40-4a58-853c-fd2d448f49e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:49.369530 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6f115-6d40-4a58-853c-fd2d448f49e6 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:49.402849 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1185/2366] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:00:49 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:00:49.407378 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795c55b-72bb-4d94-90fe-4434558f5186 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:49.417355 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795c55b-72bb-4d94-90fe-4434558f5186 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:49.470904 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28022d4b-a5ec-480b-895f-e39c3cf8eed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:49.471593 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28022d4b-a5ec-480b-895f-e39c3cf8eed5 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:49.471869 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28022d4b-a5ec-480b-895f-e39c3cf8eed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:49.472143 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28022d4b-a5ec-480b-895f-e39c3cf8eed5 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:49.472837 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28022d4b-a5ec-480b-895f-e39c3cf8eed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:49.474722 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28022d4b-a5ec-480b-895f-e39c3cf8eed5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:49.494726 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1182/2367] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:00:49 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:00:49.499602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6f115-6d40-4a58-853c-fd2d448f49e6 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:49.509706 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6f115-6d40-4a58-853c-fd2d448f49e6 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:49.515055 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc64af6-e779-40da-b168-0ee766e1f850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:49.515733 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc64af6-e779-40da-b168-0ee766e1f850 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:49.516010 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc64af6-e779-40da-b168-0ee766e1f850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:49.516284 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc64af6-e779-40da-b168-0ee766e1f850 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:49.517175 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc64af6-e779-40da-b168-0ee766e1f850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:49.518758 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc64af6-e779-40da-b168-0ee766e1f850 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:49.532940 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1186/2368] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:00:49.534213 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28022d4b-a5ec-480b-895f-e39c3cf8eed5 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:49.545952 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28022d4b-a5ec-480b-895f-e39c3cf8eed5 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:49.550712 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2967b-93ab-4402-b10e-e2f8bdef6381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:49.552200 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2967b-93ab-4402-b10e-e2f8bdef6381 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:49.552200 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2967b-93ab-4402-b10e-e2f8bdef6381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:49.552466 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2967b-93ab-4402-b10e-e2f8bdef6381 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:49.553210 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2967b-93ab-4402-b10e-e2f8bdef6381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:49.554993 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2967b-93ab-4402-b10e-e2f8bdef6381 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:49.567366 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1183/2369] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:00:49.571763 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc64af6-e779-40da-b168-0ee766e1f850 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:49.583790 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc64af6-e779-40da-b168-0ee766e1f850 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:49.588663 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09799a-cd66-41cf-a531-724759b466bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:49.589814 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09799a-cd66-41cf-a531-724759b466bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:49.590196 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09799a-cd66-41cf-a531-724759b466bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:49.590470 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09799a-cd66-41cf-a531-724759b466bd admin admin] PATH_INFO: `/v3/projects/a20883c8bb00403490e966953c48afa7/users/cb4b6e4c21f34cbd8d89686ce74fe07a/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:49.606078 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09799a-cd66-41cf-a531-724759b466bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a20883c8bb00403490e966953c48afa7, user_id=cb4b6e4c21f34cbd8d89686ce74fe07a, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:49.608910 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09799a-cd66-41cf-a531-724759b466bd admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:49.623099 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1187/2370] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:00:49 2022] PUT /identity/v3/projects/a20883c8bb00403490e966953c48afa7/users/cb4b6e4c21f34cbd8d89686ce74fe07a/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:00:49.628668 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd3a74-421f-4004-8d89-a560730b845d None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:49.628996 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd3a74-421f-4004-8d89-a560730b845d None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:49.629219 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd3a74-421f-4004-8d89-a560730b845d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:49.648445 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-80bd3a74-421f-4004-8d89-a560730b845d None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:49.649727 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-80bd3a74-421f-4004-8d89-a560730b845d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:49.717886 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1184/2371] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:00:49 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:00:49.727753 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09799a-cd66-41cf-a531-724759b466bd admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:49.730117 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-ff09799a-cd66-41cf-a531-724759b466bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:49.787975 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09799a-cd66-41cf-a531-724759b466bd admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:49.792623 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d6a52-b90f-4fa5-bb60-2606fc635e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:49.793614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d6a52-b90f-4fa5-bb60-2606fc635e1f service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:49.793894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d6a52-b90f-4fa5-bb60-2606fc635e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:49.794162 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d6a52-b90f-4fa5-bb60-2606fc635e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:49.804036 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d6a52-b90f-4fa5-bb60-2606fc635e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:49.805548 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d6a52-b90f-4fa5-bb60-2606fc635e1f service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:49.816746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1188/2372] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:49 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:00:54.063681 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaeeb0-855c-4198-8d25-44f49ec0681b None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:54.064202 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaeeb0-855c-4198-8d25-44f49ec0681b None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:54.064202 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaeeb0-855c-4198-8d25-44f49ec0681b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:54.096722 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-19eaeeb0-855c-4198-8d25-44f49ec0681b None None] MFA Rules not processed for user `cb4b6e4c21f34cbd8d89686ce74fe07a`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:54.096722 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-19eaeeb0-855c-4198-8d25-44f49ec0681b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:54.179374 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1185/2373] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:00:54 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:54.191778 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d6a52-b90f-4fa5-bb60-2606fc635e1f service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:54.193228 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-064d6a52-b90f-4fa5-bb60-2606fc635e1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:54.267489 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d6a52-b90f-4fa5-bb60-2606fc635e1f service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:54.274306 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2abd33-3ebc-4a3c-b5d2-cc3031ea89d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:54.275048 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2abd33-3ebc-4a3c-b5d2-cc3031ea89d9 service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:54.275337 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2abd33-3ebc-4a3c-b5d2-cc3031ea89d9 service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:54.275610 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2abd33-3ebc-4a3c-b5d2-cc3031ea89d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:54.286116 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2abd33-3ebc-4a3c-b5d2-cc3031ea89d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:54.289590 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2abd33-3ebc-4a3c-b5d2-cc3031ea89d9 service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:54.307409 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1189/2374] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:54 2022] GET /identity/v3/auth/tokens => generated 3395 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:00:55.918194 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2549ebb-71a6-4a25-a8c0-e23705a38e64 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:55.918896 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2549ebb-71a6-4a25-a8c0-e23705a38e64 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:55.918896 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2549ebb-71a6-4a25-a8c0-e23705a38e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:55.937613 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-b2549ebb-71a6-4a25-a8c0-e23705a38e64 None None] MFA Rules not processed for user `cb4b6e4c21f34cbd8d89686ce74fe07a`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:55.938895 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b2549ebb-71a6-4a25-a8c0-e23705a38e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:55.946029 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1186/2375] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:00:55 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:22.037877 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3f0a7-f7a3-4f54-952b-c35ea3d89d52 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:22.038562 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3f0a7-f7a3-4f54-952b-c35ea3d89d52 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:22.038562 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3f0a7-f7a3-4f54-952b-c35ea3d89d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:22.055775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-60b3f0a7-f7a3-4f54-952b-c35ea3d89d52 None None] MFA Rules not processed for user `4208d3afaa374826b47a3716a2e6d7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:22.057026 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-60b3f0a7-f7a3-4f54-952b-c35ea3d89d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:22.114567 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1190/2376] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:01:22 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:29.519968 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2549ebb-71a6-4a25-a8c0-e23705a38e64 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:29.521561 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b2549ebb-71a6-4a25-a8c0-e23705a38e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:29.545978 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2549ebb-71a6-4a25-a8c0-e23705a38e64 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:29.551915 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260faa0f-cf34-43ab-8ec5-80c487d4d994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:29.553203 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260faa0f-cf34-43ab-8ec5-80c487d4d994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:29.553568 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260faa0f-cf34-43ab-8ec5-80c487d4d994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:29.554360 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260faa0f-cf34-43ab-8ec5-80c487d4d994 admin admin] PATH_INFO: `/v3/users/e2258033f56a40b1b3c601f97763879f` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:29.555600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260faa0f-cf34-43ab-8ec5-80c487d4d994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2258033f56a40b1b3c601f97763879f)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:29.559454 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260faa0f-cf34-43ab-8ec5-80c487d4d994 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:29.614384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-260faa0f-cf34-43ab-8ec5-80c487d4d994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2258033f56a40b1b3c601f97763879f'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:29.615142 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-260faa0f-cf34-43ab-8ec5-80c487d4d994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2258033f56a40b1b3c601f97763879f'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:29.624651 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-260faa0f-cf34-43ab-8ec5-80c487d4d994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2258033f56a40b1b3c601f97763879f'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:29.632405 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-260faa0f-cf34-43ab-8ec5-80c487d4d994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2258033f56a40b1b3c601f97763879f'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:29.645333 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-260faa0f-cf34-43ab-8ec5-80c487d4d994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2258033f56a40b1b3c601f97763879f'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:29.652567 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1187/2377] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:29 2022] DELETE /identity/v3/users/e2258033f56a40b1b3c601f97763879f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:29.658071 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b56587-b956-43c8-8923-68280530feca None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:29.658587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b56587-b956-43c8-8923-68280530feca None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:29.658587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b56587-b956-43c8-8923-68280530feca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:29.677131 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-30b56587-b956-43c8-8923-68280530feca None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:29.678349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-30b56587-b956-43c8-8923-68280530feca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:29.743826 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1191/2378] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:01:29 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:29.755010 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260faa0f-cf34-43ab-8ec5-80c487d4d994 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:29.756521 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-260faa0f-cf34-43ab-8ec5-80c487d4d994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:29.835548 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260faa0f-cf34-43ab-8ec5-80c487d4d994 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:29.840791 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab1852-10fb-47da-8bf4-159e044a9bbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:29.841468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab1852-10fb-47da-8bf4-159e044a9bbc service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:29.841750 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab1852-10fb-47da-8bf4-159e044a9bbc service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:29.842026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab1852-10fb-47da-8bf4-159e044a9bbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:29.852169 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab1852-10fb-47da-8bf4-159e044a9bbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:29.853661 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab1852-10fb-47da-8bf4-159e044a9bbc service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:29.864118 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1188/2379] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:29 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:30.132627 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b56587-b956-43c8-8923-68280530feca None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:30.134404 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-30b56587-b956-43c8-8923-68280530feca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:30.147301 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b56587-b956-43c8-8923-68280530feca None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:30.152817 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f7262-3582-44da-9f32-b75d7be1ba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:30.153733 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f7262-3582-44da-9f32-b75d7be1ba96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:30.154272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f7262-3582-44da-9f32-b75d7be1ba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:30.154572 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f7262-3582-44da-9f32-b75d7be1ba96 admin admin] PATH_INFO: `/v3/projects/4c7d8ca1f6824017a8e983dc834de134` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:30.155746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f7262-3582-44da-9f32-b75d7be1ba96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c7d8ca1f6824017a8e983dc834de134)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:30.157689 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f7262-3582-44da-9f32-b75d7be1ba96 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:30.207658 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c18f7262-3582-44da-9f32-b75d7be1ba96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c7d8ca1f6824017a8e983dc834de134', 'request_id': 'req-c18f7262-3582-44da-9f32-b75d7be1ba96'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:30.213848 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c18f7262-3582-44da-9f32-b75d7be1ba96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c7d8ca1f6824017a8e983dc834de134', 'request_id': 'req-c18f7262-3582-44da-9f32-b75d7be1ba96'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:30.219131 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c18f7262-3582-44da-9f32-b75d7be1ba96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c7d8ca1f6824017a8e983dc834de134', 'request_id': 'req-c18f7262-3582-44da-9f32-b75d7be1ba96'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:30.232330 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c18f7262-3582-44da-9f32-b75d7be1ba96 admin admin] The token cache is being invalidate because project 4c7d8ca1f6824017a8e983dc834de134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:30.232636 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c18f7262-3582-44da-9f32-b75d7be1ba96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:30.233254 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c18f7262-3582-44da-9f32-b75d7be1ba96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:30.234799 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1192/2380] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:30 2022] DELETE /identity/v3/projects/4c7d8ca1f6824017a8e983dc834de134 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:30.238761 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab1852-10fb-47da-8bf4-159e044a9bbc service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:30.249532 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab1852-10fb-47da-8bf4-159e044a9bbc service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:30.305015 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ef731-b247-4f23-add8-f0af58f2baaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:30.305886 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ef731-b247-4f23-add8-f0af58f2baaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:30.306168 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ef731-b247-4f23-add8-f0af58f2baaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:30.306444 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ef731-b247-4f23-add8-f0af58f2baaf admin admin] PATH_INFO: `/v3/users/0d158c15ab2642489a3a0cc022c1ee28` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:30.307843 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ef731-b247-4f23-add8-f0af58f2baaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d158c15ab2642489a3a0cc022c1ee28)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:30.309781 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ef731-b247-4f23-add8-f0af58f2baaf admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:30.354271 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-576ef731-b247-4f23-add8-f0af58f2baaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d158c15ab2642489a3a0cc022c1ee28'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:30.354941 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-576ef731-b247-4f23-add8-f0af58f2baaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d158c15ab2642489a3a0cc022c1ee28'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:30.361918 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-576ef731-b247-4f23-add8-f0af58f2baaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d158c15ab2642489a3a0cc022c1ee28'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:30.373432 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-576ef731-b247-4f23-add8-f0af58f2baaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d158c15ab2642489a3a0cc022c1ee28'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:30.385159 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-576ef731-b247-4f23-add8-f0af58f2baaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d158c15ab2642489a3a0cc022c1ee28'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:30.392120 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1189/2381] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:30 2022] DELETE /identity/v3/users/0d158c15ab2642489a3a0cc022c1ee28 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:30.689775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f7262-3582-44da-9f32-b75d7be1ba96 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:30.691355 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c18f7262-3582-44da-9f32-b75d7be1ba96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:30.707024 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f7262-3582-44da-9f32-b75d7be1ba96 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:30.770423 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895b47b-e207-48b0-b840-bcabff190699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:30.771195 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895b47b-e207-48b0-b840-bcabff190699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:30.771465 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895b47b-e207-48b0-b840-bcabff190699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:30.771733 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895b47b-e207-48b0-b840-bcabff190699 admin admin] PATH_INFO: `/v3/projects/632ca1788cd1468f906e1ebb1e422c0f` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:30.772982 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895b47b-e207-48b0-b840-bcabff190699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=632ca1788cd1468f906e1ebb1e422c0f)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:30.774900 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895b47b-e207-48b0-b840-bcabff190699 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:30.826272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-8895b47b-e207-48b0-b840-bcabff190699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '632ca1788cd1468f906e1ebb1e422c0f', 'request_id': 'req-8895b47b-e207-48b0-b840-bcabff190699'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:30.832564 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-8895b47b-e207-48b0-b840-bcabff190699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '632ca1788cd1468f906e1ebb1e422c0f', 'request_id': 'req-8895b47b-e207-48b0-b840-bcabff190699'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:30.837974 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-8895b47b-e207-48b0-b840-bcabff190699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '632ca1788cd1468f906e1ebb1e422c0f', 'request_id': 'req-8895b47b-e207-48b0-b840-bcabff190699'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:30.850462 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-8895b47b-e207-48b0-b840-bcabff190699 admin admin] The token cache is being invalidate because project 632ca1788cd1468f906e1ebb1e422c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:30.850745 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-8895b47b-e207-48b0-b840-bcabff190699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:30.851436 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-8895b47b-e207-48b0-b840-bcabff190699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:30.853013 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1193/2382] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:30 2022] DELETE /identity/v3/projects/632ca1788cd1468f906e1ebb1e422c0f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:01:30.858941 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde761f7-e612-4fe2-ba6a-2a04a328b428 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:30.859624 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde761f7-e612-4fe2-ba6a-2a04a328b428 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:30.859624 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde761f7-e612-4fe2-ba6a-2a04a328b428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:30.880082 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-dde761f7-e612-4fe2-ba6a-2a04a328b428 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:30.881590 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-dde761f7-e612-4fe2-ba6a-2a04a328b428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:30.946113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1190/2383] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:01:30 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:01:30.954865 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf2450-2b86-41ba-928a-42306ab0c761 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:30.955237 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf2450-2b86-41ba-928a-42306ab0c761 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:30.955595 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf2450-2b86-41ba-928a-42306ab0c761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:30.975328 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-52cf2450-2b86-41ba-928a-42306ab0c761 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:30.977071 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-52cf2450-2b86-41ba-928a-42306ab0c761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:30.991533 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1194/2384] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:01:30 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:01:30.996453 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde761f7-e612-4fe2-ba6a-2a04a328b428 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:31.007473 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde761f7-e612-4fe2-ba6a-2a04a328b428 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:31.012920 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a603a95-85ee-4384-8cc4-db7dc3f9751c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:31.013848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a603a95-85ee-4384-8cc4-db7dc3f9751c admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:31.014126 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a603a95-85ee-4384-8cc4-db7dc3f9751c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:31.014504 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a603a95-85ee-4384-8cc4-db7dc3f9751c admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:31.015225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a603a95-85ee-4384-8cc4-db7dc3f9751c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:01:31.015526 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a603a95-85ee-4384-8cc4-db7dc3f9751c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:31.017176 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a603a95-85ee-4384-8cc4-db7dc3f9751c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:31.031539 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1191/2385] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:01:31.036029 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf2450-2b86-41ba-928a-42306ab0c761 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:31.046177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf2450-2b86-41ba-928a-42306ab0c761 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:31.052026 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d700f88-94ee-45d2-9dcf-e25117fb19c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:31.052721 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d700f88-94ee-45d2-9dcf-e25117fb19c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:31.053237 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d700f88-94ee-45d2-9dcf-e25117fb19c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:31.053502 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d700f88-94ee-45d2-9dcf-e25117fb19c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:31.054238 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d700f88-94ee-45d2-9dcf-e25117fb19c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:31.056229 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d700f88-94ee-45d2-9dcf-e25117fb19c1 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:31.082965 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1195/2386] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:31 2022] POST /identity/v3/projects => generated 357 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:01:31.087454 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a603a95-85ee-4384-8cc4-db7dc3f9751c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:31.097931 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a603a95-85ee-4384-8cc4-db7dc3f9751c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:31.156956 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b96c48-35ac-44cc-8010-78969d8ff7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:31.157624 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b96c48-35ac-44cc-8010-78969d8ff7df admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:31.157905 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b96c48-35ac-44cc-8010-78969d8ff7df admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:31.158201 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b96c48-35ac-44cc-8010-78969d8ff7df admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:31.158852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b96c48-35ac-44cc-8010-78969d8ff7df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:31.160748 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b96c48-35ac-44cc-8010-78969d8ff7df admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:31.183365 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1192/2387] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:31 2022] POST /identity/v3/users => generated 279 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:31.187452 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d700f88-94ee-45d2-9dcf-e25117fb19c1 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:31.197658 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d700f88-94ee-45d2-9dcf-e25117fb19c1 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:31.203213 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8819a-7e34-4c03-823b-1c07c5b396ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:31.203874 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8819a-7e34-4c03-823b-1c07c5b396ab admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:31.204147 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8819a-7e34-4c03-823b-1c07c5b396ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:31.204413 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8819a-7e34-4c03-823b-1c07c5b396ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:31.205407 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8819a-7e34-4c03-823b-1c07c5b396ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:31.206993 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8819a-7e34-4c03-823b-1c07c5b396ab admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:31.219746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1196/2388] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:31.224487 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b96c48-35ac-44cc-8010-78969d8ff7df admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:31.237994 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b96c48-35ac-44cc-8010-78969d8ff7df admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:31.243556 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72752c46-f14e-4dfa-aa48-11d9dc7bec62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:31.244407 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72752c46-f14e-4dfa-aa48-11d9dc7bec62 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:31.244889 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72752c46-f14e-4dfa-aa48-11d9dc7bec62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:31.245407 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72752c46-f14e-4dfa-aa48-11d9dc7bec62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:31.246557 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72752c46-f14e-4dfa-aa48-11d9dc7bec62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:31.248418 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72752c46-f14e-4dfa-aa48-11d9dc7bec62 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:31.259319 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1193/2389] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:31.264434 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8819a-7e34-4c03-823b-1c07c5b396ab admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:31.274545 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8819a-7e34-4c03-823b-1c07c5b396ab admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:31.280553 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf36508-45fb-41c5-89d6-3f6d3a4cde1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:31.281680 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf36508-45fb-41c5-89d6-3f6d3a4cde1d admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:31.281826 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf36508-45fb-41c5-89d6-3f6d3a4cde1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:31.282039 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf36508-45fb-41c5-89d6-3f6d3a4cde1d admin admin] PATH_INFO: `/v3/projects/f3ba7b4aca7b42029750959200df2e67/users/053f5b81332b481c8442d89cd64627ad/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:31.297040 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf36508-45fb-41c5-89d6-3f6d3a4cde1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ba7b4aca7b42029750959200df2e67, user_id=053f5b81332b481c8442d89cd64627ad, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:31.299797 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf36508-45fb-41c5-89d6-3f6d3a4cde1d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:31.314664 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1197/2390] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:31 2022] PUT /identity/v3/projects/f3ba7b4aca7b42029750959200df2e67/users/053f5b81332b481c8442d89cd64627ad/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:31.326480 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51712b-2b1a-426a-9098-280e030cf498 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:31.326771 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51712b-2b1a-426a-9098-280e030cf498 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:31.327050 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51712b-2b1a-426a-9098-280e030cf498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:31.353913 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-9f51712b-2b1a-426a-9098-280e030cf498 None None] MFA Rules not processed for user `053f5b81332b481c8442d89cd64627ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:31.355786 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-9f51712b-2b1a-426a-9098-280e030cf498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:31.423251 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1194/2391] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:01:31 2022] POST /identity/v3/auth/tokens => generated 3377 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:31.427881 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf36508-45fb-41c5-89d6-3f6d3a4cde1d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:31.488414 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf36508-45fb-41c5-89d6-3f6d3a4cde1d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:31.493224 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84588dd8-05a3-4481-8c15-56c9e4fb57fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:31.493877 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84588dd8-05a3-4481-8c15-56c9e4fb57fd admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:31.494159 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84588dd8-05a3-4481-8c15-56c9e4fb57fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:31.494434 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84588dd8-05a3-4481-8c15-56c9e4fb57fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:31.495617 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84588dd8-05a3-4481-8c15-56c9e4fb57fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:31.497544 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84588dd8-05a3-4481-8c15-56c9e4fb57fd admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:31.525097 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1198/2392] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:31 2022] POST /identity/v3/projects => generated 355 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:31.528596 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51712b-2b1a-426a-9098-280e030cf498 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:31.539595 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51712b-2b1a-426a-9098-280e030cf498 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:31.596043 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cd7a9-6bc4-4276-ad9e-7a3410382cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:31.596709 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cd7a9-6bc4-4276-ad9e-7a3410382cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:31.597014 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cd7a9-6bc4-4276-ad9e-7a3410382cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:31.597301 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cd7a9-6bc4-4276-ad9e-7a3410382cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:31.598269 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cd7a9-6bc4-4276-ad9e-7a3410382cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:31.601615 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cd7a9-6bc4-4276-ad9e-7a3410382cb8 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:31.621343 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1195/2393] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:31 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:31.625860 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84588dd8-05a3-4481-8c15-56c9e4fb57fd admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:31.636945 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84588dd8-05a3-4481-8c15-56c9e4fb57fd admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:31.641642 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa12c7f-73ad-47fb-a2a6-99ad34515608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:31.642306 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa12c7f-73ad-47fb-a2a6-99ad34515608 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:31.642583 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa12c7f-73ad-47fb-a2a6-99ad34515608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:31.642850 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa12c7f-73ad-47fb-a2a6-99ad34515608 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:31.643562 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa12c7f-73ad-47fb-a2a6-99ad34515608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:31.645178 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa12c7f-73ad-47fb-a2a6-99ad34515608 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:31.657993 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1199/2394] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:31.662170 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cd7a9-6bc4-4276-ad9e-7a3410382cb8 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:31.672671 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cd7a9-6bc4-4276-ad9e-7a3410382cb8 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:31.677437 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86f33c-3479-48e1-a412-3c7cd126b903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:31.678322 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86f33c-3479-48e1-a412-3c7cd126b903 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:31.678714 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86f33c-3479-48e1-a412-3c7cd126b903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:31.678877 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86f33c-3479-48e1-a412-3c7cd126b903 admin admin] PATH_INFO: `/v3/projects/40bc4f97b43749e89e32f9f23fe17860/users/7cbeba470d50460689df1d90f51d70a7/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:31.695319 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86f33c-3479-48e1-a412-3c7cd126b903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40bc4f97b43749e89e32f9f23fe17860, user_id=7cbeba470d50460689df1d90f51d70a7, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:31.699170 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86f33c-3479-48e1-a412-3c7cd126b903 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:31.713147 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1196/2395] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:31 2022] PUT /identity/v3/projects/40bc4f97b43749e89e32f9f23fe17860/users/7cbeba470d50460689df1d90f51d70a7/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:31.717436 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa12c7f-73ad-47fb-a2a6-99ad34515608 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:31.727435 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa12c7f-73ad-47fb-a2a6-99ad34515608 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:31.788600 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9346c-ff7e-4d62-af51-3f901413486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:31.789461 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9346c-ff7e-4d62-af51-3f901413486d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:31.789890 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9346c-ff7e-4d62-af51-3f901413486d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:31.790276 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9346c-ff7e-4d62-af51-3f901413486d admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:31.791196 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9346c-ff7e-4d62-af51-3f901413486d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:31.793642 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9346c-ff7e-4d62-af51-3f901413486d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:31.804182 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1200/2396] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:31.808762 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86f33c-3479-48e1-a412-3c7cd126b903 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:31.818713 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86f33c-3479-48e1-a412-3c7cd126b903 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:31.823451 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdddf2-0ef4-4f02-8fab-9e0be0f02012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:31.824413 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdddf2-0ef4-4f02-8fab-9e0be0f02012 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:31.824776 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdddf2-0ef4-4f02-8fab-9e0be0f02012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:31.825145 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdddf2-0ef4-4f02-8fab-9e0be0f02012 admin admin] PATH_INFO: `/v3/projects/40bc4f97b43749e89e32f9f23fe17860/users/7cbeba470d50460689df1d90f51d70a7/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:31.827171 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fdddf2-0ef4-4f02-8fab-9e0be0f02012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40bc4f97b43749e89e32f9f23fe17860, user_id=7cbeba470d50460689df1d90f51d70a7, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:31.829863 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fdddf2-0ef4-4f02-8fab-9e0be0f02012 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:31.840614 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1197/2397] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:31 2022] PUT /identity/v3/projects/40bc4f97b43749e89e32f9f23fe17860/users/7cbeba470d50460689df1d90f51d70a7/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:31.850429 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a0293-5ceb-4794-8a66-30784a8e4566 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:31.850716 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a0293-5ceb-4794-8a66-30784a8e4566 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:31.850986 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a0293-5ceb-4794-8a66-30784a8e4566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:31.881293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-141a0293-5ceb-4794-8a66-30784a8e4566 None None] MFA Rules not processed for user `7cbeba470d50460689df1d90f51d70a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:31.882989 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-141a0293-5ceb-4794-8a66-30784a8e4566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:31.998669 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1201/2398] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:01:31 2022] POST /identity/v3/auth/tokens => generated 3442 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:32.015929 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdddf2-0ef4-4f02-8fab-9e0be0f02012 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:32.019108 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-d1fdddf2-0ef4-4f02-8fab-9e0be0f02012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:32.119728 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fdddf2-0ef4-4f02-8fab-9e0be0f02012 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:32.126154 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dd496-b39f-49cf-b42a-415f81e106a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:32.127277 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dd496-b39f-49cf-b42a-415f81e106a8 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:32.127765 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dd496-b39f-49cf-b42a-415f81e106a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:32.128264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dd496-b39f-49cf-b42a-415f81e106a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:32.144908 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8dd496-b39f-49cf-b42a-415f81e106a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:32.147711 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8dd496-b39f-49cf-b42a-415f81e106a8 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:32.166091 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1198/2399] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:32 2022] GET /identity/v3/auth/tokens => generated 3442 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:01:32.248951 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a0293-5ceb-4794-8a66-30784a8e4566 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:32.258978 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a0293-5ceb-4794-8a66-30784a8e4566 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:32.263701 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc1c92-bc95-4c32-aa7a-48831a655311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:32.264346 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc1c92-bc95-4c32-aa7a-48831a655311 service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:32.264624 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc1c92-bc95-4c32-aa7a-48831a655311 service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:32.264930 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc1c92-bc95-4c32-aa7a-48831a655311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:32.325721 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc1c92-bc95-4c32-aa7a-48831a655311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:32.326897 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc1c92-bc95-4c32-aa7a-48831a655311 service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:32.336980 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1202/2400] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:32 2022] GET /identity/v3/auth/tokens => generated 3377 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:36.919664 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becae7a1-dd24-4491-a84b-d29dffced807 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:36.920583 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becae7a1-dd24-4491-a84b-d29dffced807 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:36.920997 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becae7a1-dd24-4491-a84b-d29dffced807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:36.940742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-becae7a1-dd24-4491-a84b-d29dffced807 None None] MFA Rules not processed for user `c34c05b7e55447f2a5ddf9c9b9299f44`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:36.941983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-becae7a1-dd24-4491-a84b-d29dffced807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:37.000854 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1199/2401] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:01:36 2022] POST /identity/v3/auth/tokens => generated 3409 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:47.865770 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc1c92-bc95-4c32-aa7a-48831a655311 service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:47.926750 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc1c92-bc95-4c32-aa7a-48831a655311 service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:47.931212 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9006b-e18c-4165-acc3-3961215e2141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:47.932550 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9006b-e18c-4165-acc3-3961215e2141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:47.932848 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9006b-e18c-4165-acc3-3961215e2141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:47.933143 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9006b-e18c-4165-acc3-3961215e2141 admin admin] PATH_INFO: `/v3/users/053f5b81332b481c8442d89cd64627ad` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:47.934272 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9006b-e18c-4165-acc3-3961215e2141 admin admin] RBAC: Authorizing `identity:delete_user(user_id=053f5b81332b481c8442d89cd64627ad)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:47.936151 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9006b-e18c-4165-acc3-3961215e2141 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:47.982166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-77b9006b-e18c-4165-acc3-3961215e2141 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '053f5b81332b481c8442d89cd64627ad'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:47.982803 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-77b9006b-e18c-4165-acc3-3961215e2141 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '053f5b81332b481c8442d89cd64627ad'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:47.983397 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-77b9006b-e18c-4165-acc3-3961215e2141 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '053f5b81332b481c8442d89cd64627ad'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:47.990493 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-77b9006b-e18c-4165-acc3-3961215e2141 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '053f5b81332b481c8442d89cd64627ad'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:47.998246 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-77b9006b-e18c-4165-acc3-3961215e2141 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '053f5b81332b481c8442d89cd64627ad'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:48.014919 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1203/2402] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:47 2022] DELETE /identity/v3/users/053f5b81332b481c8442d89cd64627ad => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:48.019414 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd3650-56ad-4b19-9d4c-6a662d064242 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:48.019896 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd3650-56ad-4b19-9d4c-6a662d064242 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:48.019987 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd3650-56ad-4b19-9d4c-6a662d064242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:48.037401 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-1fcd3650-56ad-4b19-9d4c-6a662d064242 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:48.038590 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1fcd3650-56ad-4b19-9d4c-6a662d064242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:48.096621 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1200/2403] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:01:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:48.106614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9006b-e18c-4165-acc3-3961215e2141 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:48.108042 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-77b9006b-e18c-4165-acc3-3961215e2141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:48.164507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9006b-e18c-4165-acc3-3961215e2141 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:48.168507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cd611-7374-4ffd-b908-d90d37deab73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:48.169188 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cd611-7374-4ffd-b908-d90d37deab73 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:48.169470 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cd611-7374-4ffd-b908-d90d37deab73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:48.169741 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cd611-7374-4ffd-b908-d90d37deab73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:48.179129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cd611-7374-4ffd-b908-d90d37deab73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:48.180570 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cd611-7374-4ffd-b908-d90d37deab73 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:48.191100 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1204/2404] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:48 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:48.457570 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd3650-56ad-4b19-9d4c-6a662d064242 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:48.459155 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1fcd3650-56ad-4b19-9d4c-6a662d064242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:48.474545 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd3650-56ad-4b19-9d4c-6a662d064242 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:48.480769 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cad6b-0f4d-4169-98ae-75a834d85e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:48.481677 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cad6b-0f4d-4169-98ae-75a834d85e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:48.482003 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cad6b-0f4d-4169-98ae-75a834d85e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:48.482231 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cad6b-0f4d-4169-98ae-75a834d85e42 admin admin] PATH_INFO: `/v3/projects/f3ba7b4aca7b42029750959200df2e67` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:48.483556 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cad6b-0f4d-4169-98ae-75a834d85e42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3ba7b4aca7b42029750959200df2e67)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:48.485578 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cad6b-0f4d-4169-98ae-75a834d85e42 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:48.536461 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1e3cad6b-0f4d-4169-98ae-75a834d85e42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3ba7b4aca7b42029750959200df2e67', 'request_id': 'req-1e3cad6b-0f4d-4169-98ae-75a834d85e42'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:48.543759 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1e3cad6b-0f4d-4169-98ae-75a834d85e42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3ba7b4aca7b42029750959200df2e67', 'request_id': 'req-1e3cad6b-0f4d-4169-98ae-75a834d85e42'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:48.550288 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1e3cad6b-0f4d-4169-98ae-75a834d85e42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3ba7b4aca7b42029750959200df2e67', 'request_id': 'req-1e3cad6b-0f4d-4169-98ae-75a834d85e42'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:48.565341 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1e3cad6b-0f4d-4169-98ae-75a834d85e42 admin admin] The token cache is being invalidate because project f3ba7b4aca7b42029750959200df2e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:48.565640 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1e3cad6b-0f4d-4169-98ae-75a834d85e42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:48.566298 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1e3cad6b-0f4d-4169-98ae-75a834d85e42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:48.567914 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1201/2405] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:48 2022] DELETE /identity/v3/projects/f3ba7b4aca7b42029750959200df2e67 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:48.571729 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cd611-7374-4ffd-b908-d90d37deab73 service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:48.587736 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cd611-7374-4ffd-b908-d90d37deab73 service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:48.646357 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2483725-d522-403b-ab49-9d71502bf53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:48.647373 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2483725-d522-403b-ab49-9d71502bf53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:48.647661 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2483725-d522-403b-ab49-9d71502bf53c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:48.647936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2483725-d522-403b-ab49-9d71502bf53c admin admin] PATH_INFO: `/v3/users/7cbeba470d50460689df1d90f51d70a7` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:48.649208 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2483725-d522-403b-ab49-9d71502bf53c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cbeba470d50460689df1d90f51d70a7)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:48.651766 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2483725-d522-403b-ab49-9d71502bf53c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:48.699029 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a2483725-d522-403b-ab49-9d71502bf53c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cbeba470d50460689df1d90f51d70a7'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:48.699678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a2483725-d522-403b-ab49-9d71502bf53c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cbeba470d50460689df1d90f51d70a7'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:48.700265 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a2483725-d522-403b-ab49-9d71502bf53c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cbeba470d50460689df1d90f51d70a7'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:48.707996 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a2483725-d522-403b-ab49-9d71502bf53c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cbeba470d50460689df1d90f51d70a7'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:48.715621 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a2483725-d522-403b-ab49-9d71502bf53c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cbeba470d50460689df1d90f51d70a7'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:48.734205 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1205/2406] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:01:48 2022] DELETE /identity/v3/users/7cbeba470d50460689df1d90f51d70a7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:49.006215 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cad6b-0f4d-4169-98ae-75a834d85e42 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:49.007725 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1e3cad6b-0f4d-4169-98ae-75a834d85e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:49.022168 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cad6b-0f4d-4169-98ae-75a834d85e42 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:49.089599 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682da0b6-ab04-43fb-a47c-8f5f8ce6afc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:49.090644 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682da0b6-ab04-43fb-a47c-8f5f8ce6afc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:49.090933 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682da0b6-ab04-43fb-a47c-8f5f8ce6afc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:49.091205 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682da0b6-ab04-43fb-a47c-8f5f8ce6afc6 admin admin] PATH_INFO: `/v3/projects/40bc4f97b43749e89e32f9f23fe17860` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:49.092596 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682da0b6-ab04-43fb-a47c-8f5f8ce6afc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40bc4f97b43749e89e32f9f23fe17860)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:49.094593 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682da0b6-ab04-43fb-a47c-8f5f8ce6afc6 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:49.144873 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-682da0b6-ab04-43fb-a47c-8f5f8ce6afc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40bc4f97b43749e89e32f9f23fe17860', 'request_id': 'req-682da0b6-ab04-43fb-a47c-8f5f8ce6afc6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:49.152687 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-682da0b6-ab04-43fb-a47c-8f5f8ce6afc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40bc4f97b43749e89e32f9f23fe17860', 'request_id': 'req-682da0b6-ab04-43fb-a47c-8f5f8ce6afc6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:49.158772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-682da0b6-ab04-43fb-a47c-8f5f8ce6afc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40bc4f97b43749e89e32f9f23fe17860', 'request_id': 'req-682da0b6-ab04-43fb-a47c-8f5f8ce6afc6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:49.172178 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-682da0b6-ab04-43fb-a47c-8f5f8ce6afc6 admin admin] The token cache is being invalidate because project 40bc4f97b43749e89e32f9f23fe17860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:01:49.172505 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-682da0b6-ab04-43fb-a47c-8f5f8ce6afc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:49.173302 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-682da0b6-ab04-43fb-a47c-8f5f8ce6afc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:01:49.174907 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1202/2407] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:01:49 2022] DELETE /identity/v3/projects/40bc4f97b43749e89e32f9f23fe17860 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:49.181787 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388e975-0c52-4ba0-ab4d-f0b8ad798c96 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:49.182340 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388e975-0c52-4ba0-ab4d-f0b8ad798c96 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:49.182340 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388e975-0c52-4ba0-ab4d-f0b8ad798c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:49.201313 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-2388e975-0c52-4ba0-ab4d-f0b8ad798c96 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:49.202521 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-2388e975-0c52-4ba0-ab4d-f0b8ad798c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:49.261079 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1206/2408] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:01:49 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:49.270216 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cc226-920c-44e5-9f49-c4271573473c None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:49.270393 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cc226-920c-44e5-9f49-c4271573473c None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:49.270723 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cc226-920c-44e5-9f49-c4271573473c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:49.290868 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-319cc226-920c-44e5-9f49-c4271573473c None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:49.292262 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-319cc226-920c-44e5-9f49-c4271573473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:49.300703 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1203/2409] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:01:49 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:49.305535 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388e975-0c52-4ba0-ab4d-f0b8ad798c96 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:49.315809 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388e975-0c52-4ba0-ab4d-f0b8ad798c96 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:49.320725 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebdf0f-70fc-410b-bb7a-280d4a1e6bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:49.321450 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebdf0f-70fc-410b-bb7a-280d4a1e6bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:49.321694 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebdf0f-70fc-410b-bb7a-280d4a1e6bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:49.321965 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebdf0f-70fc-410b-bb7a-280d4a1e6bb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:49.323516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebdf0f-70fc-410b-bb7a-280d4a1e6bb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:01:49.323872 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebdf0f-70fc-410b-bb7a-280d4a1e6bb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:49.325496 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebdf0f-70fc-410b-bb7a-280d4a1e6bb5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:49.337863 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1207/2410] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:01:49.342794 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cc226-920c-44e5-9f49-c4271573473c None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:49.352447 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cc226-920c-44e5-9f49-c4271573473c None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:49.357773 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47637348-71bc-4634-ac22-6eade1f91c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:49.358434 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47637348-71bc-4634-ac22-6eade1f91c88 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:49.358714 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47637348-71bc-4634-ac22-6eade1f91c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:49.359411 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47637348-71bc-4634-ac22-6eade1f91c88 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:49.359674 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47637348-71bc-4634-ac22-6eade1f91c88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:49.361599 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47637348-71bc-4634-ac22-6eade1f91c88 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:49.390762 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1204/2411] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:49 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:49.395424 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebdf0f-70fc-410b-bb7a-280d4a1e6bb5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:49.405976 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebdf0f-70fc-410b-bb7a-280d4a1e6bb5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:49.468582 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6f115-6e52-4fe8-9a05-8cacc64d7069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:49.469295 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6f115-6e52-4fe8-9a05-8cacc64d7069 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:49.469581 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6f115-6e52-4fe8-9a05-8cacc64d7069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:49.469858 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6f115-6e52-4fe8-9a05-8cacc64d7069 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:49.470558 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6f115-6e52-4fe8-9a05-8cacc64d7069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:49.472896 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6f115-6e52-4fe8-9a05-8cacc64d7069 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:49.497579 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1208/2412] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:49 2022] POST /identity/v3/users => generated 282 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:01:49.503708 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47637348-71bc-4634-ac22-6eade1f91c88 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:49.523112 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47637348-71bc-4634-ac22-6eade1f91c88 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:49.531061 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49583c6e-abef-4576-9a62-ee4eef104b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:49.532226 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49583c6e-abef-4576-9a62-ee4eef104b76 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:49.532721 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49583c6e-abef-4576-9a62-ee4eef104b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:49.533246 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49583c6e-abef-4576-9a62-ee4eef104b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:49.534612 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49583c6e-abef-4576-9a62-ee4eef104b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:49.537812 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49583c6e-abef-4576-9a62-ee4eef104b76 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:49.556029 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1205/2413] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:49.560644 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6f115-6e52-4fe8-9a05-8cacc64d7069 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:49.570920 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6f115-6e52-4fe8-9a05-8cacc64d7069 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:49.576456 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28165ee-7e30-46aa-ae56-54ecea8b3762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:49.577254 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28165ee-7e30-46aa-ae56-54ecea8b3762 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:49.577532 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28165ee-7e30-46aa-ae56-54ecea8b3762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:49.577868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28165ee-7e30-46aa-ae56-54ecea8b3762 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:49.578740 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28165ee-7e30-46aa-ae56-54ecea8b3762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:49.580337 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28165ee-7e30-46aa-ae56-54ecea8b3762 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:49.593014 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1209/2414] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:49.597492 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49583c6e-abef-4576-9a62-ee4eef104b76 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:49.607999 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49583c6e-abef-4576-9a62-ee4eef104b76 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:49.612689 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa041ef2-571b-4d3b-add6-f60ce86d869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:49.613611 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa041ef2-571b-4d3b-add6-f60ce86d869a admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:49.613894 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa041ef2-571b-4d3b-add6-f60ce86d869a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:49.614296 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa041ef2-571b-4d3b-add6-f60ce86d869a admin admin] PATH_INFO: `/v3/projects/9cc83fc6325f4808abba194911e2f7bf/users/03dce23c02074ffb8b4d35b413657178/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:49.630377 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa041ef2-571b-4d3b-add6-f60ce86d869a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc83fc6325f4808abba194911e2f7bf, user_id=03dce23c02074ffb8b4d35b413657178, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:49.633029 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa041ef2-571b-4d3b-add6-f60ce86d869a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:49.647592 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1206/2415] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:49 2022] PUT /identity/v3/projects/9cc83fc6325f4808abba194911e2f7bf/users/03dce23c02074ffb8b4d35b413657178/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:49.658333 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f3039-fbcb-4557-a970-03339e24a835 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:49.658667 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f3039-fbcb-4557-a970-03339e24a835 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:49.658982 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f3039-fbcb-4557-a970-03339e24a835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:49.687864 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-008f3039-fbcb-4557-a970-03339e24a835 None None] MFA Rules not processed for user `03dce23c02074ffb8b4d35b413657178`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:49.689110 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-008f3039-fbcb-4557-a970-03339e24a835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:49.756884 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1210/2416] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:01:49 2022] POST /identity/v3/auth/tokens => generated 3383 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:49.761462 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa041ef2-571b-4d3b-add6-f60ce86d869a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:49.826915 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa041ef2-571b-4d3b-add6-f60ce86d869a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:49.833866 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41742df3-f84a-48df-bc74-9b6ab3868f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:49.834458 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41742df3-f84a-48df-bc74-9b6ab3868f65 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:49.834735 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41742df3-f84a-48df-bc74-9b6ab3868f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:49.835004 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41742df3-f84a-48df-bc74-9b6ab3868f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:49.835696 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41742df3-f84a-48df-bc74-9b6ab3868f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:49.837644 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41742df3-f84a-48df-bc74-9b6ab3868f65 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:49.863819 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1207/2417] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:01:49 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:49.867800 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f3039-fbcb-4557-a970-03339e24a835 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:49.880111 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f3039-fbcb-4557-a970-03339e24a835 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:49.938818 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292e9ca-7782-4b06-a664-95ae3c89772b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:49.939398 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292e9ca-7782-4b06-a664-95ae3c89772b admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:49.939676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292e9ca-7782-4b06-a664-95ae3c89772b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:49.939951 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292e9ca-7782-4b06-a664-95ae3c89772b admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:49.940621 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292e9ca-7782-4b06-a664-95ae3c89772b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:49.942570 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292e9ca-7782-4b06-a664-95ae3c89772b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:49.964100 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1211/2418] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:01:49 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:01:49.968149 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41742df3-f84a-48df-bc74-9b6ab3868f65 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:49.981282 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41742df3-f84a-48df-bc74-9b6ab3868f65 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:49.986829 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a25a5c-a4a0-457a-a0d7-6c368a344c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:49.987503 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a25a5c-a4a0-457a-a0d7-6c368a344c37 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:49.987784 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a25a5c-a4a0-457a-a0d7-6c368a344c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:49.988062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a25a5c-a4a0-457a-a0d7-6c368a344c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:49.988785 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a25a5c-a4a0-457a-a0d7-6c368a344c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:49.990400 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a25a5c-a4a0-457a-a0d7-6c368a344c37 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:50.002920 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1208/2419] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:01:50.007403 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292e9ca-7782-4b06-a664-95ae3c89772b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:50.020129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292e9ca-7782-4b06-a664-95ae3c89772b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:50.025003 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99defd33-e681-43dc-b6e1-a838bb433163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:50.025935 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99defd33-e681-43dc-b6e1-a838bb433163 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:50.026215 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99defd33-e681-43dc-b6e1-a838bb433163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:50.026629 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99defd33-e681-43dc-b6e1-a838bb433163 admin admin] PATH_INFO: `/v3/projects/9ac9fa40d2ab4c1297cef0f242fa5f2a/users/a9f1268ab64148c0a985dee872561adb/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:50.042607 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99defd33-e681-43dc-b6e1-a838bb433163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac9fa40d2ab4c1297cef0f242fa5f2a, user_id=a9f1268ab64148c0a985dee872561adb, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:50.045284 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99defd33-e681-43dc-b6e1-a838bb433163 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:50.061189 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1212/2420] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:50 2022] PUT /identity/v3/projects/9ac9fa40d2ab4c1297cef0f242fa5f2a/users/a9f1268ab64148c0a985dee872561adb/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:01:50.065112 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a25a5c-a4a0-457a-a0d7-6c368a344c37 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:50.075859 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a25a5c-a4a0-457a-a0d7-6c368a344c37 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:50.132327 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642ae48-ef70-4240-b1c2-2240622f8429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:50.133018 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642ae48-ef70-4240-b1c2-2240622f8429 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:50.133299 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642ae48-ef70-4240-b1c2-2240622f8429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:50.133567 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642ae48-ef70-4240-b1c2-2240622f8429 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:50.134273 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642ae48-ef70-4240-b1c2-2240622f8429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:50.136046 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642ae48-ef70-4240-b1c2-2240622f8429 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:50.146017 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1209/2421] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:01:50.151672 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99defd33-e681-43dc-b6e1-a838bb433163 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:50.162217 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99defd33-e681-43dc-b6e1-a838bb433163 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:50.167903 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab1211-4eae-4df4-a0ba-159d874a985f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:50.168701 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab1211-4eae-4df4-a0ba-159d874a985f admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:50.169020 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab1211-4eae-4df4-a0ba-159d874a985f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:50.169291 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab1211-4eae-4df4-a0ba-159d874a985f admin admin] PATH_INFO: `/v3/projects/9ac9fa40d2ab4c1297cef0f242fa5f2a/users/a9f1268ab64148c0a985dee872561adb/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:50.171416 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab1211-4eae-4df4-a0ba-159d874a985f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac9fa40d2ab4c1297cef0f242fa5f2a, user_id=a9f1268ab64148c0a985dee872561adb, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:50.174118 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab1211-4eae-4df4-a0ba-159d874a985f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:50.186000 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1213/2422] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:01:50 2022] PUT /identity/v3/projects/9ac9fa40d2ab4c1297cef0f242fa5f2a/users/a9f1268ab64148c0a985dee872561adb/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:01:50.197128 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195f539-4784-4131-97fd-ca33160f750e None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:50.197338 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195f539-4784-4131-97fd-ca33160f750e None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:50.197987 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195f539-4784-4131-97fd-ca33160f750e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:50.225502 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-2195f539-4784-4131-97fd-ca33160f750e None None] MFA Rules not processed for user `a9f1268ab64148c0a985dee872561adb`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:01:50.226709 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2195f539-4784-4131-97fd-ca33160f750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:50.300035 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1210/2423] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:01:50 2022] POST /identity/v3/auth/tokens => generated 3452 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:01:50.310678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab1211-4eae-4df4-a0ba-159d874a985f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:50.312647 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-d8ab1211-4eae-4df4-a0ba-159d874a985f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:50.372637 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab1211-4eae-4df4-a0ba-159d874a985f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:50.376665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43fff9-d1ad-4a2a-804a-95fa51de5a57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:50.377331 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43fff9-d1ad-4a2a-804a-95fa51de5a57 service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:50.377608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43fff9-d1ad-4a2a-804a-95fa51de5a57 service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:50.377877 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43fff9-d1ad-4a2a-804a-95fa51de5a57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:50.387633 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43fff9-d1ad-4a2a-804a-95fa51de5a57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:50.389117 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43fff9-d1ad-4a2a-804a-95fa51de5a57 service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:50.401661 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1214/2424] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:50 2022] GET /identity/v3/auth/tokens => generated 3452 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:50.482236 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195f539-4784-4131-97fd-ca33160f750e None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:50.500292 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195f539-4784-4131-97fd-ca33160f750e None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:50.502697 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d257c9c-0044-4477-aeff-41ecc01a4d95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:50.503456 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d257c9c-0044-4477-aeff-41ecc01a4d95 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:50.503807 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d257c9c-0044-4477-aeff-41ecc01a4d95 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:50.504158 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d257c9c-0044-4477-aeff-41ecc01a4d95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:50.565995 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d257c9c-0044-4477-aeff-41ecc01a4d95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:50.567442 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d257c9c-0044-4477-aeff-41ecc01a4d95 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:50.577092 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1211/2425] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:50 2022] GET /identity/v3/auth/tokens => generated 3383 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:50.892225 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43fff9-d1ad-4a2a-804a-95fa51de5a57 service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:50.893657 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-bd43fff9-d1ad-4a2a-804a-95fa51de5a57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:50.948786 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43fff9-d1ad-4a2a-804a-95fa51de5a57 service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:50.952504 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868242e0-f94e-4c06-87a4-d6855dc85043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:50.953170 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868242e0-f94e-4c06-87a4-d6855dc85043 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:50.953447 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868242e0-f94e-4c06-87a4-d6855dc85043 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:50.953718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868242e0-f94e-4c06-87a4-d6855dc85043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:50.955471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-868242e0-f94e-4c06-87a4-d6855dc85043 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:51.024153 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868242e0-f94e-4c06-87a4-d6855dc85043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:51.025638 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868242e0-f94e-4c06-87a4-d6855dc85043 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:51.037401 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1215/2426] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:50 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:01:52.094832 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d257c9c-0044-4477-aeff-41ecc01a4d95 service cinder] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:01:52.106675 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d257c9c-0044-4477-aeff-41ecc01a4d95 service cinder] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:01:52.110629 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca69ad-25fc-4de1-b04f-e0db863fba84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:01:52.111363 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca69ad-25fc-4de1-b04f-e0db863fba84 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:01:52.111710 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca69ad-25fc-4de1-b04f-e0db863fba84 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:01:52.112052 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca69ad-25fc-4de1-b04f-e0db863fba84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:01:52.114029 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-7fca69ad-25fc-4de1-b04f-e0db863fba84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:01:52.128785 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca69ad-25fc-4de1-b04f-e0db863fba84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:01:52.130227 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca69ad-25fc-4de1-b04f-e0db863fba84 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:01:52.142154 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1212/2427] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:01:52 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:00.465386 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7855e-4b58-4370-a9bf-79133785a2ea None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.465991 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7855e-4b58-4370-a9bf-79133785a2ea None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.465991 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7855e-4b58-4370-a9bf-79133785a2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.483897 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-57a7855e-4b58-4370-a9bf-79133785a2ea None None] MFA Rules not processed for user `cd9cb4ec35524e859b828892c95130e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:00.485224 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-57a7855e-4b58-4370-a9bf-79133785a2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:00.540114 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1216/2428] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:02:00 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:00.867426 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca69ad-25fc-4de1-b04f-e0db863fba84 service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:00.876659 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca69ad-25fc-4de1-b04f-e0db863fba84 service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:00.880334 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d4d94-a937-4614-bf4e-a0b7d0b3ebdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:00.881014 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d4d94-a937-4614-bf4e-a0b7d0b3ebdf service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:00.881291 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d4d94-a937-4614-bf4e-a0b7d0b3ebdf service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:00.881564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d4d94-a937-4614-bf4e-a0b7d0b3ebdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:00.883305 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c57d4d94-a937-4614-bf4e-a0b7d0b3ebdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:00.893448 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d4d94-a937-4614-bf4e-a0b7d0b3ebdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:00.894851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d4d94-a937-4614-bf4e-a0b7d0b3ebdf service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:00.903062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1213/2429] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:01.186827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7855e-4b58-4370-a9bf-79133785a2ea None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:01.259175 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7855e-4b58-4370-a9bf-79133785a2ea None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:01.264001 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d4d94-a937-4614-bf4e-a0b7d0b3ebdf service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:01.264853 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49034544-0958-43e2-a9e6-d61ded9f1670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:01.265392 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c57d4d94-a937-4614-bf4e-a0b7d0b3ebdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:01.265735 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49034544-0958-43e2-a9e6-d61ded9f1670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:01.266015 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49034544-0958-43e2-a9e6-d61ded9f1670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:01.266270 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49034544-0958-43e2-a9e6-d61ded9f1670 admin admin] PATH_INFO: `/v3/users/03dce23c02074ffb8b4d35b413657178` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.267514 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49034544-0958-43e2-a9e6-d61ded9f1670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03dce23c02074ffb8b4d35b413657178)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:01.269497 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49034544-0958-43e2-a9e6-d61ded9f1670 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:01.286174 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d4d94-a937-4614-bf4e-a0b7d0b3ebdf service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:01.294017 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ea626-648b-4691-8e45-e9825008c4b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:01.294819 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ea626-648b-4691-8e45-e9825008c4b7 service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:01.295870 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ea626-648b-4691-8e45-e9825008c4b7 service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:01.296252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ea626-648b-4691-8e45-e9825008c4b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.298945 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-d28ea626-648b-4691-8e45-e9825008c4b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:01.329522 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-49034544-0958-43e2-a9e6-d61ded9f1670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03dce23c02074ffb8b4d35b413657178'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:01.330661 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-49034544-0958-43e2-a9e6-d61ded9f1670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03dce23c02074ffb8b4d35b413657178'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:01.331258 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-49034544-0958-43e2-a9e6-d61ded9f1670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03dce23c02074ffb8b4d35b413657178'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:01.343890 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-49034544-0958-43e2-a9e6-d61ded9f1670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03dce23c02074ffb8b4d35b413657178'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:01.357138 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-49034544-0958-43e2-a9e6-d61ded9f1670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03dce23c02074ffb8b4d35b413657178'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:01.381230 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ea626-648b-4691-8e45-e9825008c4b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:01.385066 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1217/2430] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:01 2022] DELETE /identity/v3/users/03dce23c02074ffb8b4d35b413657178 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:01.385244 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ea626-648b-4691-8e45-e9825008c4b7 service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:01.387589 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dc2fc-895e-4721-bd78-b4c534dec3fb None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:01.387975 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dc2fc-895e-4721-bd78-b4c534dec3fb None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:01.389004 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dc2fc-895e-4721-bd78-b4c534dec3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.401151 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1214/2431] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:01 2022] GET /identity/v3/auth/tokens => generated 3409 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:01.415859 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-dc1dc2fc-895e-4721-bd78-b4c534dec3fb None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:01.417159 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-dc1dc2fc-895e-4721-bd78-b4c534dec3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:01.498903 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1218/2432] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:02:01 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:02:01.509133 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ea626-648b-4691-8e45-e9825008c4b7 service nova] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:01.512060 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-d28ea626-648b-4691-8e45-e9825008c4b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:01.543225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ea626-648b-4691-8e45-e9825008c4b7 service nova] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:01.623938 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1d8dd-a8cb-4e3c-8493-99f74b7b52e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:01.624698 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1d8dd-a8cb-4e3c-8493-99f74b7b52e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:01.625107 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1d8dd-a8cb-4e3c-8493-99f74b7b52e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:01.625471 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1d8dd-a8cb-4e3c-8493-99f74b7b52e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.630288 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dc2fc-895e-4721-bd78-b4c534dec3fb None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:01.634413 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-dc1dc2fc-895e-4721-bd78-b4c534dec3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:01.641764 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1d8dd-a8cb-4e3c-8493-99f74b7b52e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:01.643252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1d8dd-a8cb-4e3c-8493-99f74b7b52e3 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:01.656933 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1215/2433] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:01 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:01.754948 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dc2fc-895e-4721-bd78-b4c534dec3fb None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:01.762088 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf418-737d-4bf4-ab6a-d9872fdd1a5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a16f0ecf3448428e969359be57dda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:01.762622 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf418-737d-4bf4-ab6a-d9872fdd1a5b service placement] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:01.762929 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf418-737d-4bf4-ab6a-d9872fdd1a5b service placement] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:01.763215 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf418-737d-4bf4-ab6a-d9872fdd1a5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:01.765350 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-3f5bf418-737d-4bf4-ab6a-d9872fdd1a5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:01.777739 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bf418-737d-4bf4-ab6a-d9872fdd1a5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:01.779331 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bf418-737d-4bf4-ab6a-d9872fdd1a5b service placement] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:01.790437 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1219/2434] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:01 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:02:01.989976 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1d8dd-a8cb-4e3c-8493-99f74b7b52e3 service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:01.991508 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2aa1d8dd-a8cb-4e3c-8493-99f74b7b52e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:02.006643 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1d8dd-a8cb-4e3c-8493-99f74b7b52e3 service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:02.012520 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b7af7-0040-48a0-9029-74c31de0a8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:02.013750 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b7af7-0040-48a0-9029-74c31de0a8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.014273 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b7af7-0040-48a0-9029-74c31de0a8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.014881 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b7af7-0040-48a0-9029-74c31de0a8a1 admin admin] PATH_INFO: `/v3/projects/9cc83fc6325f4808abba194911e2f7bf` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.017588 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b7af7-0040-48a0-9029-74c31de0a8a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc83fc6325f4808abba194911e2f7bf)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:02.020635 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b7af7-0040-48a0-9029-74c31de0a8a1 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:02.068766 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-133b7af7-0040-48a0-9029-74c31de0a8a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc83fc6325f4808abba194911e2f7bf', 'request_id': 'req-133b7af7-0040-48a0-9029-74c31de0a8a1'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.074992 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-133b7af7-0040-48a0-9029-74c31de0a8a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc83fc6325f4808abba194911e2f7bf', 'request_id': 'req-133b7af7-0040-48a0-9029-74c31de0a8a1'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.080439 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-133b7af7-0040-48a0-9029-74c31de0a8a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc83fc6325f4808abba194911e2f7bf', 'request_id': 'req-133b7af7-0040-48a0-9029-74c31de0a8a1'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.097903 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-133b7af7-0040-48a0-9029-74c31de0a8a1 admin admin] The token cache is being invalidate because project 9cc83fc6325f4808abba194911e2f7bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:02.098204 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-133b7af7-0040-48a0-9029-74c31de0a8a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.098942 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-133b7af7-0040-48a0-9029-74c31de0a8a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.100602 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1216/2435] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:01 2022] DELETE /identity/v3/projects/9cc83fc6325f4808abba194911e2f7bf => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:02.106585 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf418-737d-4bf4-ab6a-d9872fdd1a5b service placement] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:02.117446 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf418-737d-4bf4-ab6a-d9872fdd1a5b service placement] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:02.176446 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0854160-43ee-4a3a-8b4d-da5e1e9078b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:02.177344 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0854160-43ee-4a3a-8b4d-da5e1e9078b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.177619 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0854160-43ee-4a3a-8b4d-da5e1e9078b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.177885 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0854160-43ee-4a3a-8b4d-da5e1e9078b9 admin admin] PATH_INFO: `/v3/users/a9f1268ab64148c0a985dee872561adb` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.179083 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0854160-43ee-4a3a-8b4d-da5e1e9078b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f1268ab64148c0a985dee872561adb)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:02.181016 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0854160-43ee-4a3a-8b4d-da5e1e9078b9 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:02.235585 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d0854160-43ee-4a3a-8b4d-da5e1e9078b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f1268ab64148c0a985dee872561adb'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.236460 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d0854160-43ee-4a3a-8b4d-da5e1e9078b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f1268ab64148c0a985dee872561adb'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.237870 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d0854160-43ee-4a3a-8b4d-da5e1e9078b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f1268ab64148c0a985dee872561adb'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.248474 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d0854160-43ee-4a3a-8b4d-da5e1e9078b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f1268ab64148c0a985dee872561adb'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.257745 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-d0854160-43ee-4a3a-8b4d-da5e1e9078b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f1268ab64148c0a985dee872561adb'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.277777 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1220/2436] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:02 2022] DELETE /identity/v3/users/a9f1268ab64148c0a985dee872561adb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:02:02.599110 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b7af7-0040-48a0-9029-74c31de0a8a1 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:02.600736 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-133b7af7-0040-48a0-9029-74c31de0a8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:02.614309 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b7af7-0040-48a0-9029-74c31de0a8a1 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:02.680709 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30704e6-1fb7-40da-8a6c-b55babb5c522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:02.681600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30704e6-1fb7-40da-8a6c-b55babb5c522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.681881 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30704e6-1fb7-40da-8a6c-b55babb5c522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.682283 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30704e6-1fb7-40da-8a6c-b55babb5c522 admin admin] PATH_INFO: `/v3/projects/9ac9fa40d2ab4c1297cef0f242fa5f2a` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.683750 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30704e6-1fb7-40da-8a6c-b55babb5c522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac9fa40d2ab4c1297cef0f242fa5f2a)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:02.685663 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30704e6-1fb7-40da-8a6c-b55babb5c522 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:02.736156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-d30704e6-1fb7-40da-8a6c-b55babb5c522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac9fa40d2ab4c1297cef0f242fa5f2a', 'request_id': 'req-d30704e6-1fb7-40da-8a6c-b55babb5c522'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.742686 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-d30704e6-1fb7-40da-8a6c-b55babb5c522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac9fa40d2ab4c1297cef0f242fa5f2a', 'request_id': 'req-d30704e6-1fb7-40da-8a6c-b55babb5c522'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.748647 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-d30704e6-1fb7-40da-8a6c-b55babb5c522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac9fa40d2ab4c1297cef0f242fa5f2a', 'request_id': 'req-d30704e6-1fb7-40da-8a6c-b55babb5c522'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.762776 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-d30704e6-1fb7-40da-8a6c-b55babb5c522 admin admin] The token cache is being invalidate because project 9ac9fa40d2ab4c1297cef0f242fa5f2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:02.763110 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-d30704e6-1fb7-40da-8a6c-b55babb5c522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.763817 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-d30704e6-1fb7-40da-8a6c-b55babb5c522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:02.768242 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1217/2437] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:02 2022] DELETE /identity/v3/projects/9ac9fa40d2ab4c1297cef0f242fa5f2a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:02:02.770976 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65110786-48b1-4260-a7be-e4f47e798daa None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.771430 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65110786-48b1-4260-a7be-e4f47e798daa None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.771646 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65110786-48b1-4260-a7be-e4f47e798daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.800238 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-65110786-48b1-4260-a7be-e4f47e798daa None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:02.801504 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-65110786-48b1-4260-a7be-e4f47e798daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:02.865468 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1221/2438] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:02:02 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:02.874921 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0a390-ea70-4086-874d-51115c0d2b4c None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.875382 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0a390-ea70-4086-874d-51115c0d2b4c None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.875813 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0a390-ea70-4086-874d-51115c0d2b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.897460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-79c0a390-ea70-4086-874d-51115c0d2b4c None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:02.898668 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-79c0a390-ea70-4086-874d-51115c0d2b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:02.912059 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1218/2439] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:02:02 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:02.916472 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65110786-48b1-4260-a7be-e4f47e798daa None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:02.926125 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65110786-48b1-4260-a7be-e4f47e798daa None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:02.930722 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fa9fa-d7fe-427a-afbd-88582d40da63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:02.931362 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fa9fa-d7fe-427a-afbd-88582d40da63 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.931638 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fa9fa-d7fe-427a-afbd-88582d40da63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.932400 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fa9fa-d7fe-427a-afbd-88582d40da63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.933161 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fa9fa-d7fe-427a-afbd-88582d40da63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:02:02.933457 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fa9fa-d7fe-427a-afbd-88582d40da63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:02.935047 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fa9fa-d7fe-427a-afbd-88582d40da63 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:02.950526 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1222/2440] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:02:02.955266 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0a390-ea70-4086-874d-51115c0d2b4c None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:02.965322 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0a390-ea70-4086-874d-51115c0d2b4c None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:02.971828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa14f4-7666-4505-8ac1-1a30e5753a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:02.972500 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa14f4-7666-4505-8ac1-1a30e5753a30 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:02.972776 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa14f4-7666-4505-8ac1-1a30e5753a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:02.973079 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa14f4-7666-4505-8ac1-1a30e5753a30 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:02.973775 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa14f4-7666-4505-8ac1-1a30e5753a30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:02.975711 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa14f4-7666-4505-8ac1-1a30e5753a30 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.004626 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1219/2441] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:02 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:03.008913 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fa9fa-d7fe-427a-afbd-88582d40da63 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.020619 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fa9fa-d7fe-427a-afbd-88582d40da63 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.082293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75069e-d4e2-422f-afa9-ebee83f76c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.082969 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75069e-d4e2-422f-afa9-ebee83f76c1f admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.083252 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75069e-d4e2-422f-afa9-ebee83f76c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.083526 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75069e-d4e2-422f-afa9-ebee83f76c1f admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.084220 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75069e-d4e2-422f-afa9-ebee83f76c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.086200 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75069e-d4e2-422f-afa9-ebee83f76c1f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.109022 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1223/2442] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:03 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:03.113395 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa14f4-7666-4505-8ac1-1a30e5753a30 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.125101 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa14f4-7666-4505-8ac1-1a30e5753a30 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.130429 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd3ebd-6d6d-4454-a83b-3b493491507e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.131232 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd3ebd-6d6d-4454-a83b-3b493491507e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.131365 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd3ebd-6d6d-4454-a83b-3b493491507e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.131638 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd3ebd-6d6d-4454-a83b-3b493491507e admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.132354 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd3ebd-6d6d-4454-a83b-3b493491507e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.134144 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd3ebd-6d6d-4454-a83b-3b493491507e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.145990 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1220/2443] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:03.150135 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75069e-d4e2-422f-afa9-ebee83f76c1f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.164152 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75069e-d4e2-422f-afa9-ebee83f76c1f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.169617 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7adce-7393-484d-8505-d3de047db6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.170423 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7adce-7393-484d-8505-d3de047db6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.170800 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7adce-7393-484d-8505-d3de047db6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.171169 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7adce-7393-484d-8505-d3de047db6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.172292 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7adce-7393-484d-8505-d3de047db6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.173800 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7adce-7393-484d-8505-d3de047db6a7 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.186598 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1224/2444] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:03.191136 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd3ebd-6d6d-4454-a83b-3b493491507e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.202203 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd3ebd-6d6d-4454-a83b-3b493491507e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.207334 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54173eae-f7f7-4222-bbcc-7163b19997f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.208228 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54173eae-f7f7-4222-bbcc-7163b19997f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.208505 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54173eae-f7f7-4222-bbcc-7163b19997f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.208774 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54173eae-f7f7-4222-bbcc-7163b19997f2 admin admin] PATH_INFO: `/v3/projects/8d8ecb2efdc24b54b030a2c775348dd1/users/473ab7e8aaee4788a2b962c796a4d997/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.223804 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54173eae-f7f7-4222-bbcc-7163b19997f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d8ecb2efdc24b54b030a2c775348dd1, user_id=473ab7e8aaee4788a2b962c796a4d997, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.226471 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54173eae-f7f7-4222-bbcc-7163b19997f2 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.245513 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1221/2445] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:03 2022] PUT /identity/v3/projects/8d8ecb2efdc24b54b030a2c775348dd1/users/473ab7e8aaee4788a2b962c796a4d997/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:03.255774 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6e8a9-90e6-4c15-b931-6f22adfc493e None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.256278 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6e8a9-90e6-4c15-b931-6f22adfc493e None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.256563 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6e8a9-90e6-4c15-b931-6f22adfc493e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.285557 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-a7d6e8a9-90e6-4c15-b931-6f22adfc493e None None] MFA Rules not processed for user `473ab7e8aaee4788a2b962c796a4d997`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:03.286809 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a7d6e8a9-90e6-4c15-b931-6f22adfc493e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:03.352359 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1225/2446] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:02:03 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:03.356939 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54173eae-f7f7-4222-bbcc-7163b19997f2 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.424696 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54173eae-f7f7-4222-bbcc-7163b19997f2 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.434950 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64758a95-6c13-4725-b882-078a48eb516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.435752 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64758a95-6c13-4725-b882-078a48eb516f admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.436158 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64758a95-6c13-4725-b882-078a48eb516f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.436563 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64758a95-6c13-4725-b882-078a48eb516f admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.437497 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64758a95-6c13-4725-b882-078a48eb516f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.440357 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64758a95-6c13-4725-b882-078a48eb516f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.468709 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1222/2447] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:03 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:03.474044 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6e8a9-90e6-4c15-b931-6f22adfc493e None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.486647 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6e8a9-90e6-4c15-b931-6f22adfc493e None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.556723 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335922d-cfbf-4c3f-9a7d-114a12211b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.560558 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335922d-cfbf-4c3f-9a7d-114a12211b5b admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.560929 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335922d-cfbf-4c3f-9a7d-114a12211b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.561205 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335922d-cfbf-4c3f-9a7d-114a12211b5b admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.561898 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335922d-cfbf-4c3f-9a7d-114a12211b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.563816 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335922d-cfbf-4c3f-9a7d-114a12211b5b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.594395 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1226/2448] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:03 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:03.596021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64758a95-6c13-4725-b882-078a48eb516f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.612055 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64758a95-6c13-4725-b882-078a48eb516f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.618766 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfc0fc-5b7a-4ada-8909-ec320edef554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.619443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfc0fc-5b7a-4ada-8909-ec320edef554 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.619722 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfc0fc-5b7a-4ada-8909-ec320edef554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.620364 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfc0fc-5b7a-4ada-8909-ec320edef554 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.621602 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfc0fc-5b7a-4ada-8909-ec320edef554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.622889 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfc0fc-5b7a-4ada-8909-ec320edef554 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.646410 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1223/2449] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:03.647882 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335922d-cfbf-4c3f-9a7d-114a12211b5b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.664506 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335922d-cfbf-4c3f-9a7d-114a12211b5b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.672721 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e7d23-3d07-45ad-965b-3523c7cf3ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.673597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e7d23-3d07-45ad-965b-3523c7cf3ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.673975 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e7d23-3d07-45ad-965b-3523c7cf3ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.674471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e7d23-3d07-45ad-965b-3523c7cf3ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.696480 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e7d23-3d07-45ad-965b-3523c7cf3ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.704674 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e7d23-3d07-45ad-965b-3523c7cf3ba1 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.726172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfc0fc-5b7a-4ada-8909-ec320edef554 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:03.740380 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1227/2450] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:03.745520 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfc0fc-5b7a-4ada-8909-ec320edef554 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:03.750973 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e1378-21c2-487f-bca0-d737deec01b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:03.752121 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e1378-21c2-487f-bca0-d737deec01b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.752579 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e1378-21c2-487f-bca0-d737deec01b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.753073 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e1378-21c2-487f-bca0-d737deec01b3 admin admin] PATH_INFO: `/v3/projects/e6f69ddf987a4a04a00e4867b2591ebb/users/f6f4c3e8715d4f24ae2a8a07428469bb/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.813706 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e1378-21c2-487f-bca0-d737deec01b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f69ddf987a4a04a00e4867b2591ebb, user_id=f6f4c3e8715d4f24ae2a8a07428469bb, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:03.819828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e1378-21c2-487f-bca0-d737deec01b3 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:03.860941 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1224/2451] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:03 2022] PUT /identity/v3/projects/e6f69ddf987a4a04a00e4867b2591ebb/users/f6f4c3e8715d4f24ae2a8a07428469bb/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:03.870358 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb4305-1682-42f6-82d2-55c5ae2d8352 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:03.870894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb4305-1682-42f6-82d2-55c5ae2d8352 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:03.870894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb4305-1682-42f6-82d2-55c5ae2d8352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:03.900207 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-7ddb4305-1682-42f6-82d2-55c5ae2d8352 None None] MFA Rules not processed for user `f6f4c3e8715d4f24ae2a8a07428469bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:03.901854 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-7ddb4305-1682-42f6-82d2-55c5ae2d8352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:03.998598 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1228/2452] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:02:03 2022] POST /identity/v3/auth/tokens => generated 3407 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:04.002785 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e1378-21c2-487f-bca0-d737deec01b3 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:04.067372 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e1378-21c2-487f-bca0-d737deec01b3 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:04.073446 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54321c-5eba-42de-a9cd-0f9e96e20277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:04.074309 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54321c-5eba-42de-a9cd-0f9e96e20277 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:04.074662 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54321c-5eba-42de-a9cd-0f9e96e20277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:04.075006 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54321c-5eba-42de-a9cd-0f9e96e20277 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:04.075815 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54321c-5eba-42de-a9cd-0f9e96e20277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:04.077815 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54321c-5eba-42de-a9cd-0f9e96e20277 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:04.107470 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1225/2453] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:04 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:04.111723 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb4305-1682-42f6-82d2-55c5ae2d8352 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:04.122948 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb4305-1682-42f6-82d2-55c5ae2d8352 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:04.179981 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21969dbc-0e2e-45eb-8864-981b46d6c33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:04.180568 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21969dbc-0e2e-45eb-8864-981b46d6c33e admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:04.180953 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21969dbc-0e2e-45eb-8864-981b46d6c33e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:04.181138 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21969dbc-0e2e-45eb-8864-981b46d6c33e admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:04.182603 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21969dbc-0e2e-45eb-8864-981b46d6c33e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:04.184495 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21969dbc-0e2e-45eb-8864-981b46d6c33e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:04.214636 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1229/2454] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:04 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:02:04.216114 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54321c-5eba-42de-a9cd-0f9e96e20277 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:04.226827 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54321c-5eba-42de-a9cd-0f9e96e20277 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:04.233294 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f78d3-b28b-4f38-8e5e-9b558191c62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:04.233963 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f78d3-b28b-4f38-8e5e-9b558191c62a admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:04.234244 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f78d3-b28b-4f38-8e5e-9b558191c62a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:04.234520 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f78d3-b28b-4f38-8e5e-9b558191c62a admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:04.235234 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f78d3-b28b-4f38-8e5e-9b558191c62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:04.236829 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f78d3-b28b-4f38-8e5e-9b558191c62a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:04.248462 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1226/2455] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:04.252729 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21969dbc-0e2e-45eb-8864-981b46d6c33e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:04.264086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21969dbc-0e2e-45eb-8864-981b46d6c33e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:04.268753 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba61206-e4a7-4bd2-8c68-4b2e38faeb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:04.269647 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba61206-e4a7-4bd2-8c68-4b2e38faeb62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:04.270277 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba61206-e4a7-4bd2-8c68-4b2e38faeb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:04.270277 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba61206-e4a7-4bd2-8c68-4b2e38faeb62 admin admin] PATH_INFO: `/v3/projects/fd80ff8e6ab64d60bd15103a1c0e368f/users/51003bde81d14a1d8dc1aeea45f2a78f/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:04.285708 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba61206-e4a7-4bd2-8c68-4b2e38faeb62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd80ff8e6ab64d60bd15103a1c0e368f, user_id=51003bde81d14a1d8dc1aeea45f2a78f, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:04.288330 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba61206-e4a7-4bd2-8c68-4b2e38faeb62 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:04.303080 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1230/2456] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:04 2022] PUT /identity/v3/projects/fd80ff8e6ab64d60bd15103a1c0e368f/users/51003bde81d14a1d8dc1aeea45f2a78f/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:04.307788 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f78d3-b28b-4f38-8e5e-9b558191c62a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:04.317616 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f78d3-b28b-4f38-8e5e-9b558191c62a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:04.378165 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c8ee1-9966-4aee-957c-c11e06f827b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:04.378843 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c8ee1-9966-4aee-957c-c11e06f827b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:04.379120 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c8ee1-9966-4aee-957c-c11e06f827b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:04.379388 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c8ee1-9966-4aee-957c-c11e06f827b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:04.380100 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c8ee1-9966-4aee-957c-c11e06f827b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:04.381734 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c8ee1-9966-4aee-957c-c11e06f827b1 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:04.393465 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1227/2457] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:04.398214 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba61206-e4a7-4bd2-8c68-4b2e38faeb62 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:04.409951 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba61206-e4a7-4bd2-8c68-4b2e38faeb62 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:04.414966 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655987d-f700-4471-9589-ca723d54897a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:04.415967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655987d-f700-4471-9589-ca723d54897a admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:04.416317 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655987d-f700-4471-9589-ca723d54897a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:04.416632 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655987d-f700-4471-9589-ca723d54897a admin admin] PATH_INFO: `/v3/projects/fd80ff8e6ab64d60bd15103a1c0e368f/users/51003bde81d14a1d8dc1aeea45f2a78f/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:04.418935 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655987d-f700-4471-9589-ca723d54897a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd80ff8e6ab64d60bd15103a1c0e368f, user_id=51003bde81d14a1d8dc1aeea45f2a78f, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:04.421733 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655987d-f700-4471-9589-ca723d54897a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:04.433641 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1231/2458] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:04 2022] PUT /identity/v3/projects/fd80ff8e6ab64d60bd15103a1c0e368f/users/51003bde81d14a1d8dc1aeea45f2a78f/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:02:04.443864 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b6546-9fe7-4641-853c-37c8dabff966 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:04.444152 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b6546-9fe7-4641-853c-37c8dabff966 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:04.444423 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b6546-9fe7-4641-853c-37c8dabff966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:04.474234 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-635b6546-9fe7-4641-853c-37c8dabff966 None None] MFA Rules not processed for user `51003bde81d14a1d8dc1aeea45f2a78f`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:04.475451 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-635b6546-9fe7-4641-853c-37c8dabff966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:04.568307 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1228/2459] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:02:04 2022] POST /identity/v3/auth/tokens => generated 3474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:04.579138 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655987d-f700-4471-9589-ca723d54897a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:04.581111 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-7655987d-f700-4471-9589-ca723d54897a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:04.642683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655987d-f700-4471-9589-ca723d54897a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:04.646794 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7b832-55e9-487b-b092-5de517922e77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:04.647538 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7b832-55e9-487b-b092-5de517922e77 service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:04.647728 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7b832-55e9-487b-b092-5de517922e77 service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:04.648004 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7b832-55e9-487b-b092-5de517922e77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:04.660500 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7b832-55e9-487b-b092-5de517922e77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:04.662006 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7b832-55e9-487b-b092-5de517922e77 service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:04.674759 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1232/2460] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:04 2022] GET /identity/v3/auth/tokens => generated 3474 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:05.284047 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b6546-9fe7-4641-853c-37c8dabff966 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:05.295583 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b6546-9fe7-4641-853c-37c8dabff966 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:05.300228 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f8c5d-3d88-4e67-98a6-4e96cb85839b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:05.301010 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f8c5d-3d88-4e67-98a6-4e96cb85839b service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:05.301289 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f8c5d-3d88-4e67-98a6-4e96cb85839b service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:05.301559 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f8c5d-3d88-4e67-98a6-4e96cb85839b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:05.358683 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f8c5d-3d88-4e67-98a6-4e96cb85839b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:05.360137 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f8c5d-3d88-4e67-98a6-4e96cb85839b service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:05.369633 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1229/2461] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:05 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:11.490834 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7b832-55e9-487b-b092-5de517922e77 service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:11.492437 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-21c7b832-55e9-487b-b092-5de517922e77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:11.504390 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7b832-55e9-487b-b092-5de517922e77 service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:11.508207 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b4e0e-b83b-4101-8153-1cfa31d78c1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:11.508913 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b4e0e-b83b-4101-8153-1cfa31d78c1e service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:11.509195 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b4e0e-b83b-4101-8153-1cfa31d78c1e service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:11.509470 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b4e0e-b83b-4101-8153-1cfa31d78c1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:11.568556 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b4e0e-b83b-4101-8153-1cfa31d78c1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:11.570030 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b4e0e-b83b-4101-8153-1cfa31d78c1e service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:11.579211 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1233/2462] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:11 2022] GET /identity/v3/auth/tokens => generated 3407 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:02:13.641291 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f8c5d-3d88-4e67-98a6-4e96cb85839b service cinder] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:13.707177 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f8c5d-3d88-4e67-98a6-4e96cb85839b service cinder] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:13.713120 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd51da1-84d8-4c91-a854-bdc43581358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:13.714378 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd51da1-84d8-4c91-a854-bdc43581358b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:13.714773 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd51da1-84d8-4c91-a854-bdc43581358b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:13.715149 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd51da1-84d8-4c91-a854-bdc43581358b admin admin] PATH_INFO: `/v3/users/473ab7e8aaee4788a2b962c796a4d997` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:13.716785 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd51da1-84d8-4c91-a854-bdc43581358b admin admin] RBAC: Authorizing `identity:delete_user(user_id=473ab7e8aaee4788a2b962c796a4d997)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:13.719113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd51da1-84d8-4c91-a854-bdc43581358b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:13.771132 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-4fd51da1-84d8-4c91-a854-bdc43581358b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '473ab7e8aaee4788a2b962c796a4d997'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:13.771777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-4fd51da1-84d8-4c91-a854-bdc43581358b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '473ab7e8aaee4788a2b962c796a4d997'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:13.778839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-4fd51da1-84d8-4c91-a854-bdc43581358b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '473ab7e8aaee4788a2b962c796a4d997'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:13.787721 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-4fd51da1-84d8-4c91-a854-bdc43581358b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '473ab7e8aaee4788a2b962c796a4d997'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:13.801635 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-4fd51da1-84d8-4c91-a854-bdc43581358b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '473ab7e8aaee4788a2b962c796a4d997'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:13.808414 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1230/2463] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:13 2022] DELETE /identity/v3/users/473ab7e8aaee4788a2b962c796a4d997 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:13.813373 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38434f8-dbe5-476a-8ec4-f6fcc22d8c45 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:13.813873 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38434f8-dbe5-476a-8ec4-f6fcc22d8c45 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:13.813873 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38434f8-dbe5-476a-8ec4-f6fcc22d8c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:13.832125 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-a38434f8-dbe5-476a-8ec4-f6fcc22d8c45 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:13.833117 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a38434f8-dbe5-476a-8ec4-f6fcc22d8c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:13.894629 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1234/2464] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:02:13 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:13.904612 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd51da1-84d8-4c91-a854-bdc43581358b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:13.906307 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-4fd51da1-84d8-4c91-a854-bdc43581358b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:13.974008 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd51da1-84d8-4c91-a854-bdc43581358b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:13.977603 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0794bc6-fb33-49aa-a880-731ccfdd7d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:13.978248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0794bc6-fb33-49aa-a880-731ccfdd7d88 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:13.979022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0794bc6-fb33-49aa-a880-731ccfdd7d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:13.979341 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0794bc6-fb33-49aa-a880-731ccfdd7d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:13.988574 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0794bc6-fb33-49aa-a880-731ccfdd7d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:13.990024 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0794bc6-fb33-49aa-a880-731ccfdd7d88 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:14.000542 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1231/2465] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:13 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:14.270556 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38434f8-dbe5-476a-8ec4-f6fcc22d8c45 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:14.272041 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a38434f8-dbe5-476a-8ec4-f6fcc22d8c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:14.286864 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38434f8-dbe5-476a-8ec4-f6fcc22d8c45 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:14.291544 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60bb59-0ae3-48ca-b90b-d50039b54967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:14.292526 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60bb59-0ae3-48ca-b90b-d50039b54967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:14.292695 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60bb59-0ae3-48ca-b90b-d50039b54967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:14.293004 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60bb59-0ae3-48ca-b90b-d50039b54967 admin admin] PATH_INFO: `/v3/projects/8d8ecb2efdc24b54b030a2c775348dd1` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:14.294217 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60bb59-0ae3-48ca-b90b-d50039b54967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d8ecb2efdc24b54b030a2c775348dd1)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:14.296950 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60bb59-0ae3-48ca-b90b-d50039b54967 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:14.351422 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-db60bb59-0ae3-48ca-b90b-d50039b54967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d8ecb2efdc24b54b030a2c775348dd1', 'request_id': 'req-db60bb59-0ae3-48ca-b90b-d50039b54967'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.357712 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-db60bb59-0ae3-48ca-b90b-d50039b54967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d8ecb2efdc24b54b030a2c775348dd1', 'request_id': 'req-db60bb59-0ae3-48ca-b90b-d50039b54967'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.363175 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-db60bb59-0ae3-48ca-b90b-d50039b54967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d8ecb2efdc24b54b030a2c775348dd1', 'request_id': 'req-db60bb59-0ae3-48ca-b90b-d50039b54967'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.376419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-db60bb59-0ae3-48ca-b90b-d50039b54967 admin admin] The token cache is being invalidate because project 8d8ecb2efdc24b54b030a2c775348dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:14.376718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-db60bb59-0ae3-48ca-b90b-d50039b54967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.377377 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-db60bb59-0ae3-48ca-b90b-d50039b54967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.378907 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1235/2466] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:14 2022] DELETE /identity/v3/projects/8d8ecb2efdc24b54b030a2c775348dd1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:14.382882 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0794bc6-fb33-49aa-a880-731ccfdd7d88 service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:14.393248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0794bc6-fb33-49aa-a880-731ccfdd7d88 service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:14.450135 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9f241-f61e-4c72-985f-c200f85fffff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:14.451164 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9f241-f61e-4c72-985f-c200f85fffff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:14.451446 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9f241-f61e-4c72-985f-c200f85fffff admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:14.451747 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9f241-f61e-4c72-985f-c200f85fffff admin admin] PATH_INFO: `/v3/users/f6f4c3e8715d4f24ae2a8a07428469bb` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:14.453146 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9f241-f61e-4c72-985f-c200f85fffff admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f4c3e8715d4f24ae2a8a07428469bb)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:14.455052 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9f241-f61e-4c72-985f-c200f85fffff admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:14.500614 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-12d9f241-f61e-4c72-985f-c200f85fffff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f4c3e8715d4f24ae2a8a07428469bb'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.501284 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-12d9f241-f61e-4c72-985f-c200f85fffff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f4c3e8715d4f24ae2a8a07428469bb'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.507814 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-12d9f241-f61e-4c72-985f-c200f85fffff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f4c3e8715d4f24ae2a8a07428469bb'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.514687 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-12d9f241-f61e-4c72-985f-c200f85fffff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f4c3e8715d4f24ae2a8a07428469bb'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.525860 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-12d9f241-f61e-4c72-985f-c200f85fffff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f4c3e8715d4f24ae2a8a07428469bb'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.533001 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1232/2467] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:14 2022] DELETE /identity/v3/users/f6f4c3e8715d4f24ae2a8a07428469bb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:14.810936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60bb59-0ae3-48ca-b90b-d50039b54967 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:14.813196 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-db60bb59-0ae3-48ca-b90b-d50039b54967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:14.826917 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60bb59-0ae3-48ca-b90b-d50039b54967 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:14.884302 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6a036-1052-41dd-9aa3-599b655d8f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:14.885455 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a036-1052-41dd-9aa3-599b655d8f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:14.885682 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a036-1052-41dd-9aa3-599b655d8f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:14.885951 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a036-1052-41dd-9aa3-599b655d8f0a admin admin] PATH_INFO: `/v3/projects/e6f69ddf987a4a04a00e4867b2591ebb` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:14.887133 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6a036-1052-41dd-9aa3-599b655d8f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6f69ddf987a4a04a00e4867b2591ebb)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:14.889042 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6a036-1052-41dd-9aa3-599b655d8f0a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:14.936151 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3ee6a036-1052-41dd-9aa3-599b655d8f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6f69ddf987a4a04a00e4867b2591ebb', 'request_id': 'req-3ee6a036-1052-41dd-9aa3-599b655d8f0a'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.942120 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3ee6a036-1052-41dd-9aa3-599b655d8f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6f69ddf987a4a04a00e4867b2591ebb', 'request_id': 'req-3ee6a036-1052-41dd-9aa3-599b655d8f0a'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.947567 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3ee6a036-1052-41dd-9aa3-599b655d8f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6f69ddf987a4a04a00e4867b2591ebb', 'request_id': 'req-3ee6a036-1052-41dd-9aa3-599b655d8f0a'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.960137 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3ee6a036-1052-41dd-9aa3-599b655d8f0a admin admin] The token cache is being invalidate because project e6f69ddf987a4a04a00e4867b2591ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:14.960419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3ee6a036-1052-41dd-9aa3-599b655d8f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.961055 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3ee6a036-1052-41dd-9aa3-599b655d8f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:14.963397 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1236/2468] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:14 2022] DELETE /identity/v3/projects/e6f69ddf987a4a04a00e4867b2591ebb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:14.967376 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9f241-f61e-4c72-985f-c200f85fffff admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:14.968831 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-12d9f241-f61e-4c72-985f-c200f85fffff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:14.982166 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9f241-f61e-4c72-985f-c200f85fffff admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:15.037097 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971f635-cd86-434b-a571-861ef45b44c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:15.037966 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971f635-cd86-434b-a571-861ef45b44c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:15.038256 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971f635-cd86-434b-a571-861ef45b44c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:15.038534 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971f635-cd86-434b-a571-861ef45b44c0 admin admin] PATH_INFO: `/v3/users/51003bde81d14a1d8dc1aeea45f2a78f` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:15.039716 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971f635-cd86-434b-a571-861ef45b44c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51003bde81d14a1d8dc1aeea45f2a78f)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:15.042262 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971f635-cd86-434b-a571-861ef45b44c0 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:15.090293 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-2971f635-cd86-434b-a571-861ef45b44c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51003bde81d14a1d8dc1aeea45f2a78f'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.090884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-2971f635-cd86-434b-a571-861ef45b44c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51003bde81d14a1d8dc1aeea45f2a78f'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.097755 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-2971f635-cd86-434b-a571-861ef45b44c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51003bde81d14a1d8dc1aeea45f2a78f'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.106158 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-2971f635-cd86-434b-a571-861ef45b44c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51003bde81d14a1d8dc1aeea45f2a78f'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.117898 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-2971f635-cd86-434b-a571-861ef45b44c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51003bde81d14a1d8dc1aeea45f2a78f'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.123995 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1233/2469] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:14 2022] DELETE /identity/v3/users/51003bde81d14a1d8dc1aeea45f2a78f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:15.410515 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6a036-1052-41dd-9aa3-599b655d8f0a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:15.412213 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-3ee6a036-1052-41dd-9aa3-599b655d8f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:15.429583 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6a036-1052-41dd-9aa3-599b655d8f0a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:15.493609 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a84f5-931f-4be7-a41b-6a1f7d454340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:15.495094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a84f5-931f-4be7-a41b-6a1f7d454340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:15.495390 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a84f5-931f-4be7-a41b-6a1f7d454340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:15.495666 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a84f5-931f-4be7-a41b-6a1f7d454340 admin admin] PATH_INFO: `/v3/projects/fd80ff8e6ab64d60bd15103a1c0e368f` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:15.496909 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a84f5-931f-4be7-a41b-6a1f7d454340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd80ff8e6ab64d60bd15103a1c0e368f)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:15.498811 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a84f5-931f-4be7-a41b-6a1f7d454340 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:15.545900 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-1c8a84f5-931f-4be7-a41b-6a1f7d454340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd80ff8e6ab64d60bd15103a1c0e368f', 'request_id': 'req-1c8a84f5-931f-4be7-a41b-6a1f7d454340'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.552324 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-1c8a84f5-931f-4be7-a41b-6a1f7d454340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd80ff8e6ab64d60bd15103a1c0e368f', 'request_id': 'req-1c8a84f5-931f-4be7-a41b-6a1f7d454340'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.558887 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-1c8a84f5-931f-4be7-a41b-6a1f7d454340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd80ff8e6ab64d60bd15103a1c0e368f', 'request_id': 'req-1c8a84f5-931f-4be7-a41b-6a1f7d454340'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.571669 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-1c8a84f5-931f-4be7-a41b-6a1f7d454340 admin admin] The token cache is being invalidate because project fd80ff8e6ab64d60bd15103a1c0e368f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:15.571962 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-1c8a84f5-931f-4be7-a41b-6a1f7d454340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.574249 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-1c8a84f5-931f-4be7-a41b-6a1f7d454340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:15.575791 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1237/2470] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:15 2022] DELETE /identity/v3/projects/fd80ff8e6ab64d60bd15103a1c0e368f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:02:15.582694 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3701c-b754-470b-a6e5-51f66113f3a9 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:15.582976 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3701c-b754-470b-a6e5-51f66113f3a9 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:15.583247 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3701c-b754-470b-a6e5-51f66113f3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:15.602021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-07c3701c-b754-470b-a6e5-51f66113f3a9 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:15.603126 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-07c3701c-b754-470b-a6e5-51f66113f3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:15.662554 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1234/2471] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:02:15 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:15.671643 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0b664-71de-447b-a19f-767acacf0f11 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:15.671931 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0b664-71de-447b-a19f-767acacf0f11 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:15.672205 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0b664-71de-447b-a19f-767acacf0f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:15.696478 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-3cc0b664-71de-447b-a19f-767acacf0f11 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:15.698599 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-3cc0b664-71de-447b-a19f-767acacf0f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:15.706625 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1238/2472] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:02:15 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:15.710915 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3701c-b754-470b-a6e5-51f66113f3a9 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:15.722875 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3701c-b754-470b-a6e5-51f66113f3a9 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:15.727948 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895025b-11b4-4732-a9bd-54b1b99a3e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:15.728732 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895025b-11b4-4732-a9bd-54b1b99a3e71 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:15.729181 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895025b-11b4-4732-a9bd-54b1b99a3e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:15.729453 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895025b-11b4-4732-a9bd-54b1b99a3e71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:15.730196 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895025b-11b4-4732-a9bd-54b1b99a3e71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:02:15.730556 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895025b-11b4-4732-a9bd-54b1b99a3e71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:15.732142 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895025b-11b4-4732-a9bd-54b1b99a3e71 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:15.745677 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1235/2473] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:02:15.750062 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0b664-71de-447b-a19f-767acacf0f11 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:15.759535 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0b664-71de-447b-a19f-767acacf0f11 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:15.765171 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c704607-6df8-4d41-96a1-8ddd577b5af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:15.765822 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c704607-6df8-4d41-96a1-8ddd577b5af8 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:15.766097 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c704607-6df8-4d41-96a1-8ddd577b5af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:15.766371 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c704607-6df8-4d41-96a1-8ddd577b5af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:15.767061 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c704607-6df8-4d41-96a1-8ddd577b5af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:15.769000 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c704607-6df8-4d41-96a1-8ddd577b5af8 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:15.798389 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1239/2474] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:15 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:15.802539 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895025b-11b4-4732-a9bd-54b1b99a3e71 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:15.813764 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895025b-11b4-4732-a9bd-54b1b99a3e71 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:15.871277 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d2ed5-7421-4d3e-89c8-a678f4b1b2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:15.871862 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d2ed5-7421-4d3e-89c8-a678f4b1b2ef admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:15.872142 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d2ed5-7421-4d3e-89c8-a678f4b1b2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:15.872418 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d2ed5-7421-4d3e-89c8-a678f4b1b2ef admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:15.873146 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d2ed5-7421-4d3e-89c8-a678f4b1b2ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:15.875088 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d2ed5-7421-4d3e-89c8-a678f4b1b2ef admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:15.896734 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1236/2475] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:15 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:15.901185 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c704607-6df8-4d41-96a1-8ddd577b5af8 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:15.912203 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c704607-6df8-4d41-96a1-8ddd577b5af8 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:15.918614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec0ee1-886e-4b99-b493-026584699e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:15.919771 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec0ee1-886e-4b99-b493-026584699e5b admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:15.920437 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec0ee1-886e-4b99-b493-026584699e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:15.921016 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec0ee1-886e-4b99-b493-026584699e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:15.922155 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec0ee1-886e-4b99-b493-026584699e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:15.924930 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec0ee1-886e-4b99-b493-026584699e5b admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:15.943543 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1240/2476] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:15.949027 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d2ed5-7421-4d3e-89c8-a678f4b1b2ef admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:15.962218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d2ed5-7421-4d3e-89c8-a678f4b1b2ef admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:15.967125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a3af6-8f40-4d14-861f-b12d738fc7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:15.967797 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a3af6-8f40-4d14-861f-b12d738fc7fb admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:15.968343 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a3af6-8f40-4d14-861f-b12d738fc7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:15.968343 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a3af6-8f40-4d14-861f-b12d738fc7fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:15.969089 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a3af6-8f40-4d14-861f-b12d738fc7fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:15.970677 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a3af6-8f40-4d14-861f-b12d738fc7fb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:15.981925 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1237/2477] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:02:15.986385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec0ee1-886e-4b99-b493-026584699e5b admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:15.996972 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec0ee1-886e-4b99-b493-026584699e5b admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:16.001661 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca3306-f5b8-4074-b663-25650f15ad72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:16.002628 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca3306-f5b8-4074-b663-25650f15ad72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:16.002926 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca3306-f5b8-4074-b663-25650f15ad72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:16.003275 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca3306-f5b8-4074-b663-25650f15ad72 admin admin] PATH_INFO: `/v3/projects/b8a50f8f8ee4469a9314f34a5b30e53f/users/63df08c6076844ab853626d2cf658dd9/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:16.021038 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca3306-f5b8-4074-b663-25650f15ad72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a50f8f8ee4469a9314f34a5b30e53f, user_id=63df08c6076844ab853626d2cf658dd9, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:16.023836 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca3306-f5b8-4074-b663-25650f15ad72 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:16.040123 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1241/2478] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:15 2022] PUT /identity/v3/projects/b8a50f8f8ee4469a9314f34a5b30e53f/users/63df08c6076844ab853626d2cf658dd9/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:16.046914 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebac7f6-8062-4b7e-b1a0-6bea75652f69 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:16.047203 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebac7f6-8062-4b7e-b1a0-6bea75652f69 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:16.047485 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebac7f6-8062-4b7e-b1a0-6bea75652f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:16.065842 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-bebac7f6-8062-4b7e-b1a0-6bea75652f69 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:16.067033 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-bebac7f6-8062-4b7e-b1a0-6bea75652f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:16.127989 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1238/2479] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:02:16 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:16.140167 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca3306-f5b8-4074-b663-25650f15ad72 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:16.141957 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-e9ca3306-f5b8-4074-b663-25650f15ad72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:16.200001 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca3306-f5b8-4074-b663-25650f15ad72 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:16.203675 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdba1ff-c959-4d1c-97f1-1d47f8a0f0ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:16.204311 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdba1ff-c959-4d1c-97f1-1d47f8a0f0ed service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:16.204590 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdba1ff-c959-4d1c-97f1-1d47f8a0f0ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:16.204897 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdba1ff-c959-4d1c-97f1-1d47f8a0f0ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:16.213746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdba1ff-c959-4d1c-97f1-1d47f8a0f0ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:16.215178 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdba1ff-c959-4d1c-97f1-1d47f8a0f0ed service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:16.224514 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1242/2480] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:16 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:02:16.975449 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac5416-f425-4b5e-b469-ae4b266765f1 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:16.976396 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac5416-f425-4b5e-b469-ae4b266765f1 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:16.976396 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac5416-f425-4b5e-b469-ae4b266765f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:17.007577 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-5dac5416-f425-4b5e-b469-ae4b266765f1 None None] MFA Rules not processed for user `63df08c6076844ab853626d2cf658dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:17.008920 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-5dac5416-f425-4b5e-b469-ae4b266765f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:17.078471 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1239/2481] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:02:16 2022] POST /identity/v3/auth/tokens => generated 3389 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:17.089086 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdba1ff-c959-4d1c-97f1-1d47f8a0f0ed service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:17.090690 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-5fdba1ff-c959-4d1c-97f1-1d47f8a0f0ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:17.151409 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdba1ff-c959-4d1c-97f1-1d47f8a0f0ed service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:17.156317 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920881cf-126a-474e-b754-48afaf0e3146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:17.156586 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920881cf-126a-474e-b754-48afaf0e3146 service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:17.157027 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920881cf-126a-474e-b754-48afaf0e3146 service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:17.157310 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920881cf-126a-474e-b754-48afaf0e3146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:17.167097 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920881cf-126a-474e-b754-48afaf0e3146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:17.168665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920881cf-126a-474e-b754-48afaf0e3146 service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:17.179051 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1243/2482] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:17 2022] GET /identity/v3/auth/tokens => generated 3389 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:18.560322 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72526025-7d56-4812-932d-88c1160c56ad None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:18.560852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72526025-7d56-4812-932d-88c1160c56ad None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:18.560959 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72526025-7d56-4812-932d-88c1160c56ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:18.579975 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-72526025-7d56-4812-932d-88c1160c56ad None None] MFA Rules not processed for user `63df08c6076844ab853626d2cf658dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:18.581225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-72526025-7d56-4812-932d-88c1160c56ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:18.588399 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1240/2483] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:02:18 2022] POST /identity/v3/auth/tokens => generated 3389 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:18.862428 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920881cf-126a-474e-b754-48afaf0e3146 service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:18.876651 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920881cf-126a-474e-b754-48afaf0e3146 service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:18.888051 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72258ed3-5a41-40c4-9e5f-8d2c583c5b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:18.888051 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72258ed3-5a41-40c4-9e5f-8d2c583c5b25 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:18.888051 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72258ed3-5a41-40c4-9e5f-8d2c583c5b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:18.888051 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72258ed3-5a41-40c4-9e5f-8d2c583c5b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:18.888420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-72258ed3-5a41-40c4-9e5f-8d2c583c5b25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:18.898005 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72258ed3-5a41-40c4-9e5f-8d2c583c5b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:18.898919 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72258ed3-5a41-40c4-9e5f-8d2c583c5b25 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:18.909684 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1244/2484] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:21.102909 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72526025-7d56-4812-932d-88c1160c56ad None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:21.113947 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72526025-7d56-4812-932d-88c1160c56ad None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:21.118344 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5bf71-1097-41e4-a534-3a8191648e3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:21.118985 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5bf71-1097-41e4-a534-3a8191648e3f service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:21.119317 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5bf71-1097-41e4-a534-3a8191648e3f service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:21.119815 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5bf71-1097-41e4-a534-3a8191648e3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:21.121839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-52f5bf71-1097-41e4-a534-3a8191648e3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:21.132487 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5bf71-1097-41e4-a534-3a8191648e3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:21.133956 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5bf71-1097-41e4-a534-3a8191648e3f service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:21.152927 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72258ed3-5a41-40c4-9e5f-8d2c583c5b25 service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:21.153649 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1241/2485] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:21.167808 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72258ed3-5a41-40c4-9e5f-8d2c583c5b25 service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:21.180027 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2b6e3-1958-4192-8641-e89b10ed16c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:21.181239 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2b6e3-1958-4192-8641-e89b10ed16c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:21.181441 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2b6e3-1958-4192-8641-e89b10ed16c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:21.181887 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2b6e3-1958-4192-8641-e89b10ed16c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:21.190518 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2b6e3-1958-4192-8641-e89b10ed16c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:21.191942 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2b6e3-1958-4192-8641-e89b10ed16c2 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:21.205419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1245/2486] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:22.249075 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5bf71-1097-41e4-a534-3a8191648e3f service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:22.250600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-52f5bf71-1097-41e4-a534-3a8191648e3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:22.331293 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5bf71-1097-41e4-a534-3a8191648e3f service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:22.337658 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccc63a-3781-4f94-9021-751766866089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:22.338491 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccc63a-3781-4f94-9021-751766866089 service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:22.338777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccc63a-3781-4f94-9021-751766866089 service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:22.339330 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccc63a-3781-4f94-9021-751766866089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:22.341014 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ebccc63a-3781-4f94-9021-751766866089 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:22.353802 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccc63a-3781-4f94-9021-751766866089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:22.355368 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccc63a-3781-4f94-9021-751766866089 service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:22.366061 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1242/2487] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:22 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:26.308681 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2b6e3-1958-4192-8641-e89b10ed16c2 service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:26.310233 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-0ea2b6e3-1958-4192-8641-e89b10ed16c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:26.327112 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2b6e3-1958-4192-8641-e89b10ed16c2 service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:26.333400 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b10dd1-dd59-4355-aaa0-9aec245c0e25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:26.334049 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b10dd1-dd59-4355-aaa0-9aec245c0e25 service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:26.334326 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b10dd1-dd59-4355-aaa0-9aec245c0e25 service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:26.334595 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b10dd1-dd59-4355-aaa0-9aec245c0e25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:26.336394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-e0b10dd1-dd59-4355-aaa0-9aec245c0e25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:26.349575 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b10dd1-dd59-4355-aaa0-9aec245c0e25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:26.351204 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b10dd1-dd59-4355-aaa0-9aec245c0e25 service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:26.372152 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1246/2488] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:26 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:27.619144 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccc63a-3781-4f94-9021-751766866089 service nova] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:27.621145 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ebccc63a-3781-4f94-9021-751766866089 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:27.652346 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccc63a-3781-4f94-9021-751766866089 service nova] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:27.663419 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c0c48-5712-41d8-a53e-36d400dd8769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:27.665322 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c0c48-5712-41d8-a53e-36d400dd8769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:27.667087 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c0c48-5712-41d8-a53e-36d400dd8769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:27.667810 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c0c48-5712-41d8-a53e-36d400dd8769 admin admin] PATH_INFO: `/v3/users/4208d3afaa374826b47a3716a2e6d7cc` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:27.672141 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c0c48-5712-41d8-a53e-36d400dd8769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4208d3afaa374826b47a3716a2e6d7cc)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:27.676357 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c0c48-5712-41d8-a53e-36d400dd8769 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:27.741862 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-585c0c48-5712-41d8-a53e-36d400dd8769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4208d3afaa374826b47a3716a2e6d7cc'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:27.742517 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-585c0c48-5712-41d8-a53e-36d400dd8769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4208d3afaa374826b47a3716a2e6d7cc'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:27.751991 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-585c0c48-5712-41d8-a53e-36d400dd8769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4208d3afaa374826b47a3716a2e6d7cc'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:27.760600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-585c0c48-5712-41d8-a53e-36d400dd8769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4208d3afaa374826b47a3716a2e6d7cc'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:27.772987 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-585c0c48-5712-41d8-a53e-36d400dd8769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4208d3afaa374826b47a3716a2e6d7cc'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:27.780324 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1243/2489] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:27 2022] DELETE /identity/v3/users/4208d3afaa374826b47a3716a2e6d7cc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:27.962520 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b10dd1-dd59-4355-aaa0-9aec245c0e25 service nova] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:27.975430 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b10dd1-dd59-4355-aaa0-9aec245c0e25 service nova] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:28.035255 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514baab-2758-4d99-84fb-8292b5a375b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:28.036114 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514baab-2758-4d99-84fb-8292b5a375b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:28.036396 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514baab-2758-4d99-84fb-8292b5a375b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:28.036665 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514baab-2758-4d99-84fb-8292b5a375b5 admin admin] PATH_INFO: `/v3/projects/cf861e434da344c89d039fa373bd0742` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:28.037899 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514baab-2758-4d99-84fb-8292b5a375b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf861e434da344c89d039fa373bd0742)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:28.039989 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514baab-2758-4d99-84fb-8292b5a375b5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:28.092633 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-b514baab-2758-4d99-84fb-8292b5a375b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf861e434da344c89d039fa373bd0742', 'request_id': 'req-b514baab-2758-4d99-84fb-8292b5a375b5'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:28.099034 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-b514baab-2758-4d99-84fb-8292b5a375b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf861e434da344c89d039fa373bd0742', 'request_id': 'req-b514baab-2758-4d99-84fb-8292b5a375b5'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:28.104937 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-b514baab-2758-4d99-84fb-8292b5a375b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf861e434da344c89d039fa373bd0742', 'request_id': 'req-b514baab-2758-4d99-84fb-8292b5a375b5'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:28.118858 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-b514baab-2758-4d99-84fb-8292b5a375b5 admin admin] The token cache is being invalidate because project cf861e434da344c89d039fa373bd0742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:28.119344 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-b514baab-2758-4d99-84fb-8292b5a375b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:28.120380 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-b514baab-2758-4d99-84fb-8292b5a375b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:28.122021 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1247/2490] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:27 2022] DELETE /identity/v3/projects/cf861e434da344c89d039fa373bd0742 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:02:33.284224 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520cdb2-593a-4844-93ee-aac14061aebf None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:33.284748 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520cdb2-593a-4844-93ee-aac14061aebf None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:33.284748 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520cdb2-593a-4844-93ee-aac14061aebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:33.302313 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-0520cdb2-593a-4844-93ee-aac14061aebf None None] MFA Rules not processed for user `63df08c6076844ab853626d2cf658dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:33.303499 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-0520cdb2-593a-4844-93ee-aac14061aebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:33.355500 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1244/2491] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:02:33 2022] POST /identity/v3/auth/tokens => generated 3389 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:40.904828 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514baab-2758-4d99-84fb-8292b5a375b5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:40.906483 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b514baab-2758-4d99-84fb-8292b5a375b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:40.988639 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514baab-2758-4d99-84fb-8292b5a375b5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:40.994931 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98e6d2-5388-4472-88d0-abf43f71cf96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:40.995582 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98e6d2-5388-4472-88d0-abf43f71cf96 service nova] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:40.995852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98e6d2-5388-4472-88d0-abf43f71cf96 service nova] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:40.996114 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98e6d2-5388-4472-88d0-abf43f71cf96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:40.998154 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-da98e6d2-5388-4472-88d0-abf43f71cf96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:41.010904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98e6d2-5388-4472-88d0-abf43f71cf96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:41.012477 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98e6d2-5388-4472-88d0-abf43f71cf96 service nova] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:41.022984 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1248/2492] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:40 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:53.847630 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8b120-993a-4af4-baf6-3f91bebda7a9 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:53.848439 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8b120-993a-4af4-baf6-3f91bebda7a9 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:53.848439 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8b120-993a-4af4-baf6-3f91bebda7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:53.872138 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-5fd8b120-993a-4af4-baf6-3f91bebda7a9 None None] MFA Rules not processed for user `591d508a3867412fac76d00134e58864`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:53.873406 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-5fd8b120-993a-4af4-baf6-3f91bebda7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:53.929478 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1245/2493] 10.222.0.96 () {58 vars in 1009 bytes} [Fri Jan 28 02:02:53 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:02:53.977143 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98e6d2-5388-4472-88d0-abf43f71cf96 service nova] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:53.979176 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-da98e6d2-5388-4472-88d0-abf43f71cf96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:54.044766 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98e6d2-5388-4472-88d0-abf43f71cf96 service nova] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:54.049754 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06a80b-5b86-4cc8-8c76-f7303235eb12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a2c3b2815f46b0ac27944f004c4821', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:54.050385 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06a80b-5b86-4cc8-8c76-f7303235eb12 service swift] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:54.050660 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06a80b-5b86-4cc8-8c76-f7303235eb12 service swift] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:54.050926 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06a80b-5b86-4cc8-8c76-f7303235eb12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:54.059375 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06a80b-5b86-4cc8-8c76-f7303235eb12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:54.060939 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06a80b-5b86-4cc8-8c76-f7303235eb12 service swift] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:54.069067 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1249/2494] 10.222.0.96 () {60 vars in 1384 bytes} [Fri Jan 28 02:02:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:03:02.638758 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db079eca-f3fd-4ca4-9b2c-0a2d86818588 None None] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:02.639636 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db079eca-f3fd-4ca4-9b2c-0a2d86818588 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:02.640128 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db079eca-f3fd-4ca4-9b2c-0a2d86818588 None None] PATH_INFO: `/` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:02.642143 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1246/2495] 10.222.0.96 () {54 vars in 921 bytes} [Fri Jan 28 02:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:03:02.648790 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139cc79-0d23-4bee-a6ba-5e6776a3e4ad None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:02.650587 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139cc79-0d23-4bee-a6ba-5e6776a3e4ad None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:02.651266 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139cc79-0d23-4bee-a6ba-5e6776a3e4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:02.671672 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-5139cc79-0d23-4bee-a6ba-5e6776a3e4ad None None] MFA Rules not processed for user `4acc32735f0a418ba5620f6225500402`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:02.674179 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-5139cc79-0d23-4bee-a6ba-5e6776a3e4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:02.807783 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1250/2496] 10.222.0.96 () {58 vars in 1018 bytes} [Fri Jan 28 02:03:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:03:02.821164 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db079eca-f3fd-4ca4-9b2c-0a2d86818588 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:02.825465 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-db079eca-f3fd-4ca4-9b2c-0a2d86818588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:02.845091 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db079eca-f3fd-4ca4-9b2c-0a2d86818588 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:02.849345 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d66ae-9c3e-43f5-98f0-4a4df1c4ce8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:02.850188 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d66ae-9c3e-43f5-98f0-4a4df1c4ce8d service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:02.850765 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d66ae-9c3e-43f5-98f0-4a4df1c4ce8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:02.851215 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d66ae-9c3e-43f5-98f0-4a4df1c4ce8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:02.864974 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d66ae-9c3e-43f5-98f0-4a4df1c4ce8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:02.867784 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d66ae-9c3e-43f5-98f0-4a4df1c4ce8d service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:02.887647 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1247/2497] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:03:02.998604 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0bca6-1083-4378-b4ed-a50eb4647aaf None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:02.999162 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0bca6-1083-4378-b4ed-a50eb4647aaf None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:02.999607 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0bca6-1083-4378-b4ed-a50eb4647aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:03.039516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-2ab0bca6-1083-4378-b4ed-a50eb4647aaf None None] MFA Rules not processed for user `591d508a3867412fac76d00134e58864`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:03.040319 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-2ab0bca6-1083-4378-b4ed-a50eb4647aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:03.058238 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1251/2498] 10.222.0.96 () {58 vars in 1009 bytes} [Fri Jan 28 02:03:02 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:03.079761 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d66ae-9c3e-43f5-98f0-4a4df1c4ce8d service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:03.099549 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d66ae-9c3e-43f5-98f0-4a4df1c4ce8d service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:03.111971 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34da9f-0b48-4f37-8af7-6763d685bcbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a2c3b2815f46b0ac27944f004c4821', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:03.113839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34da9f-0b48-4f37-8af7-6763d685bcbb service swift] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:03.114127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34da9f-0b48-4f37-8af7-6763d685bcbb service swift] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:03.114509 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34da9f-0b48-4f37-8af7-6763d685bcbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:03.146801 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34da9f-0b48-4f37-8af7-6763d685bcbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:03.148923 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34da9f-0b48-4f37-8af7-6763d685bcbb service swift] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:03.162811 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1248/2499] 10.222.0.96 () {60 vars in 1384 bytes} [Fri Jan 28 02:03:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 02:03:11.868686 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108b8ab-c9c0-4c64-a7bc-916eede2c698 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:11.869362 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108b8ab-c9c0-4c64-a7bc-916eede2c698 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:11.869633 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108b8ab-c9c0-4c64-a7bc-916eede2c698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:11.899026 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-a108b8ab-c9c0-4c64-a7bc-916eede2c698 None None] MFA Rules not processed for user `591d508a3867412fac76d00134e58864`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:11.901703 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a108b8ab-c9c0-4c64-a7bc-916eede2c698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:11.914408 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1252/2500] 10.222.0.96 () {58 vars in 967 bytes} [Fri Jan 28 02:03:11 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:03:11.934014 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34da9f-0b48-4f37-8af7-6763d685bcbb service swift] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:11.950590 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34da9f-0b48-4f37-8af7-6763d685bcbb service swift] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:11.955803 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a818f-dc22-4f01-989e-8a1046a8ba98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a2c3b2815f46b0ac27944f004c4821', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:11.966961 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a818f-dc22-4f01-989e-8a1046a8ba98 service swift] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:11.966961 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a818f-dc22-4f01-989e-8a1046a8ba98 service swift] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:11.966961 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a818f-dc22-4f01-989e-8a1046a8ba98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:11.976438 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a818f-dc22-4f01-989e-8a1046a8ba98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:11.978452 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a818f-dc22-4f01-989e-8a1046a8ba98 service swift] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:11.992215 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1249/2501] 10.222.0.96 () {60 vars in 1384 bytes} [Fri Jan 28 02:03:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 02:03:14.312088 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108b8ab-c9c0-4c64-a7bc-916eede2c698 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:14.313550 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a108b8ab-c9c0-4c64-a7bc-916eede2c698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:14.387675 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108b8ab-c9c0-4c64-a7bc-916eede2c698 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:14.392586 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad62272-8f4a-4240-aa6d-53f3b8436d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:14.393895 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad62272-8f4a-4240-aa6d-53f3b8436d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:14.394035 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad62272-8f4a-4240-aa6d-53f3b8436d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:14.394270 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad62272-8f4a-4240-aa6d-53f3b8436d5d admin admin] PATH_INFO: `/v3/users/63df08c6076844ab853626d2cf658dd9` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:14.395598 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad62272-8f4a-4240-aa6d-53f3b8436d5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=63df08c6076844ab853626d2cf658dd9)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:14.397628 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad62272-8f4a-4240-aa6d-53f3b8436d5d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:14.454186 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-aad62272-8f4a-4240-aa6d-53f3b8436d5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63df08c6076844ab853626d2cf658dd9'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:14.454871 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-aad62272-8f4a-4240-aa6d-53f3b8436d5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63df08c6076844ab853626d2cf658dd9'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:14.455496 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-aad62272-8f4a-4240-aa6d-53f3b8436d5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63df08c6076844ab853626d2cf658dd9'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:14.465028 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-aad62272-8f4a-4240-aa6d-53f3b8436d5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63df08c6076844ab853626d2cf658dd9'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:14.473892 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-aad62272-8f4a-4240-aa6d-53f3b8436d5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63df08c6076844ab853626d2cf658dd9'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:14.495324 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1253/2502] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:03:14 2022] DELETE /identity/v3/users/63df08c6076844ab853626d2cf658dd9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:14.682266 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a818f-dc22-4f01-989e-8a1046a8ba98 service swift] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:14.696192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a818f-dc22-4f01-989e-8a1046a8ba98 service swift] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:14.755089 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa7305-ca83-40fd-99a7-83e123da9f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:14.755941 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa7305-ca83-40fd-99a7-83e123da9f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:14.756218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa7305-ca83-40fd-99a7-83e123da9f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:14.756485 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa7305-ca83-40fd-99a7-83e123da9f5c admin admin] PATH_INFO: `/v3/projects/b8a50f8f8ee4469a9314f34a5b30e53f` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:14.757698 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa7305-ca83-40fd-99a7-83e123da9f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a50f8f8ee4469a9314f34a5b30e53f)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:14.760308 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa7305-ca83-40fd-99a7-83e123da9f5c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:14.806941 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-8aaa7305-ca83-40fd-99a7-83e123da9f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'request_id': 'req-8aaa7305-ca83-40fd-99a7-83e123da9f5c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:14.813376 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-8aaa7305-ca83-40fd-99a7-83e123da9f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'request_id': 'req-8aaa7305-ca83-40fd-99a7-83e123da9f5c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:14.818628 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-8aaa7305-ca83-40fd-99a7-83e123da9f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a50f8f8ee4469a9314f34a5b30e53f', 'request_id': 'req-8aaa7305-ca83-40fd-99a7-83e123da9f5c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:14.833506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-8aaa7305-ca83-40fd-99a7-83e123da9f5c admin admin] The token cache is being invalidate because project b8a50f8f8ee4469a9314f34a5b30e53f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:03:14.833790 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-8aaa7305-ca83-40fd-99a7-83e123da9f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:14.834414 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-8aaa7305-ca83-40fd-99a7-83e123da9f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:03:14.835945 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1250/2503] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:03:14 2022] DELETE /identity/v3/projects/b8a50f8f8ee4469a9314f34a5b30e53f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:14.842307 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329c37f-4636-4f76-8bde-94d093e94333 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:14.842591 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329c37f-4636-4f76-8bde-94d093e94333 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:14.842870 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329c37f-4636-4f76-8bde-94d093e94333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:14.860873 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-a329c37f-4636-4f76-8bde-94d093e94333 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:14.861998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a329c37f-4636-4f76-8bde-94d093e94333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:14.921084 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1254/2504] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:03:14 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:14.929036 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f215bbd-c743-4f23-b64b-0d8dfd2beffb None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:14.929329 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f215bbd-c743-4f23-b64b-0d8dfd2beffb None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:14.929613 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f215bbd-c743-4f23-b64b-0d8dfd2beffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:14.949620 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-4f215bbd-c743-4f23-b64b-0d8dfd2beffb None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:14.950852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-4f215bbd-c743-4f23-b64b-0d8dfd2beffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:14.958809 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1251/2505] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:03:14 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:14.963644 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329c37f-4636-4f76-8bde-94d093e94333 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:14.973316 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329c37f-4636-4f76-8bde-94d093e94333 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:14.978023 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e338b-60b1-4b6b-925a-b47e58fcd167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:14.979105 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e338b-60b1-4b6b-925a-b47e58fcd167 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:14.979395 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e338b-60b1-4b6b-925a-b47e58fcd167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:14.979667 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e338b-60b1-4b6b-925a-b47e58fcd167 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:14.980569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e338b-60b1-4b6b-925a-b47e58fcd167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:03:14.980784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e338b-60b1-4b6b-925a-b47e58fcd167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:14.982379 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e338b-60b1-4b6b-925a-b47e58fcd167 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:14.998950 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1255/2506] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:03:15.000297 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f215bbd-c743-4f23-b64b-0d8dfd2beffb None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:15.009980 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f215bbd-c743-4f23-b64b-0d8dfd2beffb None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:15.015491 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e3e08-9105-4215-a6a9-747f21675293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:15.016154 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e3e08-9105-4215-a6a9-747f21675293 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:15.016432 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e3e08-9105-4215-a6a9-747f21675293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:15.016708 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e3e08-9105-4215-a6a9-747f21675293 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:15.017426 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e3e08-9105-4215-a6a9-747f21675293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:15.019316 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e3e08-9105-4215-a6a9-747f21675293 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:15.057026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1252/2507] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:03:14 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:15.061073 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e338b-60b1-4b6b-925a-b47e58fcd167 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:15.070917 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e338b-60b1-4b6b-925a-b47e58fcd167 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:15.130054 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c62b1e-fbd0-4d3a-9dcf-a9b1d3003340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:15.130784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c62b1e-fbd0-4d3a-9dcf-a9b1d3003340 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:15.131170 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c62b1e-fbd0-4d3a-9dcf-a9b1d3003340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:15.131582 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c62b1e-fbd0-4d3a-9dcf-a9b1d3003340 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:15.132268 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c62b1e-fbd0-4d3a-9dcf-a9b1d3003340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:15.134260 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c62b1e-fbd0-4d3a-9dcf-a9b1d3003340 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:15.164324 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1256/2508] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:03:15 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:15.165634 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e3e08-9105-4215-a6a9-747f21675293 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:15.177614 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e3e08-9105-4215-a6a9-747f21675293 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:15.182464 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae9805-8e63-4d41-94ad-601b7cd8434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:15.183118 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae9805-8e63-4d41-94ad-601b7cd8434a admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:15.183394 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae9805-8e63-4d41-94ad-601b7cd8434a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:15.183670 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae9805-8e63-4d41-94ad-601b7cd8434a admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:15.184373 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae9805-8e63-4d41-94ad-601b7cd8434a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:15.185972 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae9805-8e63-4d41-94ad-601b7cd8434a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:15.195910 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1253/2509] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:15.200758 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c62b1e-fbd0-4d3a-9dcf-a9b1d3003340 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:15.214253 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c62b1e-fbd0-4d3a-9dcf-a9b1d3003340 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:15.217309 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a796c-7c30-4838-a592-3a0997db0028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:15.218013 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a796c-7c30-4838-a592-3a0997db0028 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:15.218295 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a796c-7c30-4838-a592-3a0997db0028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:15.218573 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a796c-7c30-4838-a592-3a0997db0028 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:15.219295 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a796c-7c30-4838-a592-3a0997db0028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:15.220954 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a796c-7c30-4838-a592-3a0997db0028 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:15.232138 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1257/2510] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:15.237217 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae9805-8e63-4d41-94ad-601b7cd8434a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:15.247656 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae9805-8e63-4d41-94ad-601b7cd8434a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:15.252501 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb67b16-635f-4465-a85f-deecf376646f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:15.253446 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb67b16-635f-4465-a85f-deecf376646f admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:15.253727 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb67b16-635f-4465-a85f-deecf376646f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:15.254002 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb67b16-635f-4465-a85f-deecf376646f admin admin] PATH_INFO: `/v3/projects/4f88b3ae05934fd8836d7e90cad61a53/users/2668984632674ed6b3d343244d92c623/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:15.270514 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb67b16-635f-4465-a85f-deecf376646f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f88b3ae05934fd8836d7e90cad61a53, user_id=2668984632674ed6b3d343244d92c623, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:15.273189 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb67b16-635f-4465-a85f-deecf376646f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:15.287923 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1254/2511] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:03:15 2022] PUT /identity/v3/projects/4f88b3ae05934fd8836d7e90cad61a53/users/2668984632674ed6b3d343244d92c623/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:15.293319 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08754c3-151f-4944-881f-059e79a30ad6 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:15.293604 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08754c3-151f-4944-881f-059e79a30ad6 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:15.293884 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08754c3-151f-4944-881f-059e79a30ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:15.312084 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-b08754c3-151f-4944-881f-059e79a30ad6 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:15.313365 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b08754c3-151f-4944-881f-059e79a30ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:15.370364 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1258/2512] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:03:15 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:15.380258 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb67b16-635f-4465-a85f-deecf376646f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:15.382194 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-aeb67b16-635f-4465-a85f-deecf376646f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:15.440663 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb67b16-635f-4465-a85f-deecf376646f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:15.444337 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025545db-61dc-4b3d-86af-0d835a2d5ba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:15.445013 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025545db-61dc-4b3d-86af-0d835a2d5ba7 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:15.445291 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025545db-61dc-4b3d-86af-0d835a2d5ba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:15.445558 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025545db-61dc-4b3d-86af-0d835a2d5ba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:15.454862 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025545db-61dc-4b3d-86af-0d835a2d5ba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:15.456298 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025545db-61dc-4b3d-86af-0d835a2d5ba7 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:15.466742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1255/2513] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:15 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:03:20.432590 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c6778-fec2-4de8-85f2-3d2dda47322f None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:20.433499 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c6778-fec2-4de8-85f2-3d2dda47322f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:20.434027 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c6778-fec2-4de8-85f2-3d2dda47322f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:20.464389 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-051c6778-fec2-4de8-85f2-3d2dda47322f None None] MFA Rules not processed for user `2668984632674ed6b3d343244d92c623`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:20.466084 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-051c6778-fec2-4de8-85f2-3d2dda47322f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:20.542319 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1259/2514] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:03:20 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:20.546855 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025545db-61dc-4b3d-86af-0d835a2d5ba7 service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:20.558366 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025545db-61dc-4b3d-86af-0d835a2d5ba7 service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:20.563094 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52364df-265c-4750-8645-bdb08cf96bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:20.563770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52364df-265c-4750-8645-bdb08cf96bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:20.564024 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52364df-265c-4750-8645-bdb08cf96bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:20.564295 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52364df-265c-4750-8645-bdb08cf96bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:20.565021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52364df-265c-4750-8645-bdb08cf96bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:20.566918 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52364df-265c-4750-8645-bdb08cf96bd7 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:20.595651 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1256/2515] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:03:20 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:03:20.598687 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c6778-fec2-4de8-85f2-3d2dda47322f None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:20.610184 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c6778-fec2-4de8-85f2-3d2dda47322f None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:20.667768 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8a403-05c6-4038-8971-de2269b6f786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:20.668434 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8a403-05c6-4038-8971-de2269b6f786 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:20.668849 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8a403-05c6-4038-8971-de2269b6f786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:20.669258 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8a403-05c6-4038-8971-de2269b6f786 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:20.669843 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8a403-05c6-4038-8971-de2269b6f786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:20.671766 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8a403-05c6-4038-8971-de2269b6f786 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:20.704730 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1260/2516] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:03:20 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:03:20.708948 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52364df-265c-4750-8645-bdb08cf96bd7 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:20.726984 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52364df-265c-4750-8645-bdb08cf96bd7 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:20.733886 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56525f36-6c7b-4c25-9ef5-80291c191209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:20.734650 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56525f36-6c7b-4c25-9ef5-80291c191209 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:20.735001 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56525f36-6c7b-4c25-9ef5-80291c191209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:20.735343 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56525f36-6c7b-4c25-9ef5-80291c191209 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:20.736143 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56525f36-6c7b-4c25-9ef5-80291c191209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:20.737875 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56525f36-6c7b-4c25-9ef5-80291c191209 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:20.751317 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1257/2517] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:20.756837 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8a403-05c6-4038-8971-de2269b6f786 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:20.774785 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8a403-05c6-4038-8971-de2269b6f786 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:20.783975 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874b4cd-6509-4ae8-a6fe-eec8aae1ca8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:20.784741 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874b4cd-6509-4ae8-a6fe-eec8aae1ca8e admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:20.785055 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874b4cd-6509-4ae8-a6fe-eec8aae1ca8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:20.785331 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874b4cd-6509-4ae8-a6fe-eec8aae1ca8e admin admin] PATH_INFO: `/v3/projects/7ab185b47eee4409b1765fa2f175c958/users/145a684e393e42a198ae9d75b3002d97/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:20.803180 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874b4cd-6509-4ae8-a6fe-eec8aae1ca8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab185b47eee4409b1765fa2f175c958, user_id=145a684e393e42a198ae9d75b3002d97, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:20.806674 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49315c-2ca9-48a8-b642-32307b36d6a4 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:20.807181 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49315c-2ca9-48a8-b642-32307b36d6a4 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:20.807293 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874b4cd-6509-4ae8-a6fe-eec8aae1ca8e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:20.807615 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49315c-2ca9-48a8-b642-32307b36d6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:20.827218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-1d49315c-2ca9-48a8-b642-32307b36d6a4 None None] MFA Rules not processed for user `591d508a3867412fac76d00134e58864`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:20.828621 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1d49315c-2ca9-48a8-b642-32307b36d6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:20.830360 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1261/2518] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:03:20 2022] PUT /identity/v3/projects/7ab185b47eee4409b1765fa2f175c958/users/145a684e393e42a198ae9d75b3002d97/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:03:20.831214 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874b4cd-6509-4ae8-a6fe-eec8aae1ca8e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:20.891146 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1258/2519] 10.222.0.96 () {58 vars in 1009 bytes} [Fri Jan 28 02:03:20 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:20.905059 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49315c-2ca9-48a8-b642-32307b36d6a4 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:20.905223 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874b4cd-6509-4ae8-a6fe-eec8aae1ca8e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:20.906868 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1d49315c-2ca9-48a8-b642-32307b36d6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:20.910399 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af159fe8-c85e-4274-8316-8aac20cd70cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:20.911077 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af159fe8-c85e-4274-8316-8aac20cd70cb admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:20.911353 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af159fe8-c85e-4274-8316-8aac20cd70cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:20.911626 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af159fe8-c85e-4274-8316-8aac20cd70cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:20.912350 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af159fe8-c85e-4274-8316-8aac20cd70cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:20.913993 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af159fe8-c85e-4274-8316-8aac20cd70cb admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:20.928283 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1262/2520] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:03:20.932572 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af159fe8-c85e-4274-8316-8aac20cd70cb admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:20.942777 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af159fe8-c85e-4274-8316-8aac20cd70cb admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:20.948601 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae54e38-bcb3-4e38-9e5c-aa8e6766292e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:20.949552 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae54e38-bcb3-4e38-9e5c-aa8e6766292e admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:20.949834 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae54e38-bcb3-4e38-9e5c-aa8e6766292e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:20.950114 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae54e38-bcb3-4e38-9e5c-aa8e6766292e admin admin] PATH_INFO: `/v3/projects/7ab185b47eee4409b1765fa2f175c958/users/145a684e393e42a198ae9d75b3002d97/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:20.952137 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae54e38-bcb3-4e38-9e5c-aa8e6766292e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab185b47eee4409b1765fa2f175c958, user_id=145a684e393e42a198ae9d75b3002d97, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:20.954893 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae54e38-bcb3-4e38-9e5c-aa8e6766292e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:20.975735 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1263/2521] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:03:20 2022] PUT /identity/v3/projects/7ab185b47eee4409b1765fa2f175c958/users/145a684e393e42a198ae9d75b3002d97/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:03:20.987284 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49315c-2ca9-48a8-b642-32307b36d6a4 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:21.059851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a1a42-a547-4ac8-abf9-3b38a915d28e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a2c3b2815f46b0ac27944f004c4821', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:21.060600 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a1a42-a547-4ac8-abf9-3b38a915d28e service swift] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:21.060983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a1a42-a547-4ac8-abf9-3b38a915d28e service swift] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:21.061326 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a1a42-a547-4ac8-abf9-3b38a915d28e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:21.141983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a1a42-a547-4ac8-abf9-3b38a915d28e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:21.143565 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a1a42-a547-4ac8-abf9-3b38a915d28e service swift] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:21.162505 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1259/2522] 10.222.0.96 () {60 vars in 1384 bytes} [Fri Jan 28 02:03:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 02:03:27.528114 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165104d0-734a-4532-b30b-72cc7f81e0d8 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:27.529132 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165104d0-734a-4532-b30b-72cc7f81e0d8 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:27.529574 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165104d0-734a-4532-b30b-72cc7f81e0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:27.568133 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-165104d0-734a-4532-b30b-72cc7f81e0d8 None None] MFA Rules not processed for user `145a684e393e42a198ae9d75b3002d97`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:27.569535 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-165104d0-734a-4532-b30b-72cc7f81e0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:27.658322 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1264/2523] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:03:27 2022] POST /identity/v3/auth/tokens => generated 3470 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:03:27.671770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a1a42-a547-4ac8-abf9-3b38a915d28e service swift] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:27.673443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c12a1a42-a547-4ac8-abf9-3b38a915d28e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:27.738618 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a1a42-a547-4ac8-abf9-3b38a915d28e service swift] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:27.741851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c93b31-5c7c-48bd-9ae5-7b7754486b15 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07298acc960e4154be7c79f2368a1952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:27.742613 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c93b31-5c7c-48bd-9ae5-7b7754486b15 service glance] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:27.742972 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c93b31-5c7c-48bd-9ae5-7b7754486b15 service glance] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:27.743272 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c93b31-5c7c-48bd-9ae5-7b7754486b15 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:27.832372 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c93b31-5c7c-48bd-9ae5-7b7754486b15 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:27.833938 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c93b31-5c7c-48bd-9ae5-7b7754486b15 service glance] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:27.875040 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1260/2524] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:27 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:03:28.105983 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b84be-fada-4b21-9569-a0df4c3d20f4 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:28.106299 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b84be-fada-4b21-9569-a0df4c3d20f4 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:28.106583 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b84be-fada-4b21-9569-a0df4c3d20f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:28.134399 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-113b84be-fada-4b21-9569-a0df4c3d20f4 None None] MFA Rules not processed for user `591d508a3867412fac76d00134e58864`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:28.147940 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-113b84be-fada-4b21-9569-a0df4c3d20f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:28.160463 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1265/2525] 10.222.0.96 () {58 vars in 1009 bytes} [Fri Jan 28 02:03:28 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:03:28.182855 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c93b31-5c7c-48bd-9ae5-7b7754486b15 service glance] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:28.199385 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c93b31-5c7c-48bd-9ae5-7b7754486b15 service glance] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:28.226391 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc4209-4c4d-4345-a2cc-e5796efc927b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a2c3b2815f46b0ac27944f004c4821', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:28.227073 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc4209-4c4d-4345-a2cc-e5796efc927b service swift] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:28.227359 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc4209-4c4d-4345-a2cc-e5796efc927b service swift] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:28.227634 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc4209-4c4d-4345-a2cc-e5796efc927b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:28.251921 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc4209-4c4d-4345-a2cc-e5796efc927b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:28.253843 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc4209-4c4d-4345-a2cc-e5796efc927b service swift] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:28.266988 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1261/2526] 10.222.0.96 () {60 vars in 1384 bytes} [Fri Jan 28 02:03:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:03:37.043759 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5210de2-1a87-4594-909d-5e1834313ae4 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:37.044325 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5210de2-1a87-4594-909d-5e1834313ae4 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:37.044325 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5210de2-1a87-4594-909d-5e1834313ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:37.062497 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-d5210de2-1a87-4594-909d-5e1834313ae4 None None] MFA Rules not processed for user `591d508a3867412fac76d00134e58864`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:37.063708 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-d5210de2-1a87-4594-909d-5e1834313ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:37.076748 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1266/2527] 10.222.0.96 () {58 vars in 967 bytes} [Fri Jan 28 02:03:37 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:03:37.089482 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc4209-4c4d-4345-a2cc-e5796efc927b service swift] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:37.100686 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc4209-4c4d-4345-a2cc-e5796efc927b service swift] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:37.108069 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdf4f5-3d56-43d7-adc5-81d11bad333b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a2c3b2815f46b0ac27944f004c4821', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:37.108760 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdf4f5-3d56-43d7-adc5-81d11bad333b service swift] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:37.109140 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdf4f5-3d56-43d7-adc5-81d11bad333b service swift] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:37.109426 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdf4f5-3d56-43d7-adc5-81d11bad333b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:37.119046 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdf4f5-3d56-43d7-adc5-81d11bad333b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:37.120836 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdf4f5-3d56-43d7-adc5-81d11bad333b service swift] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:37.129644 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1262/2528] 10.222.0.96 () {60 vars in 1384 bytes} [Fri Jan 28 02:03:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 02:03:38.731370 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99f4bb-4ff6-4491-92b3-256e7e8b3671 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:38.731899 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99f4bb-4ff6-4491-92b3-256e7e8b3671 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:38.731899 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99f4bb-4ff6-4491-92b3-256e7e8b3671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:38.749258 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-df99f4bb-4ff6-4491-92b3-256e7e8b3671 None None] MFA Rules not processed for user `2668984632674ed6b3d343244d92c623`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:38.750536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-df99f4bb-4ff6-4491-92b3-256e7e8b3671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:38.757364 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1267/2529] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:03:38 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:40.601622 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae294cb-7e9f-40c6-bb6e-5f483d3d5809 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:40.602453 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae294cb-7e9f-40c6-bb6e-5f483d3d5809 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:40.602817 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae294cb-7e9f-40c6-bb6e-5f483d3d5809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:40.625161 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-0ae294cb-7e9f-40c6-bb6e-5f483d3d5809 None None] MFA Rules not processed for user `591d508a3867412fac76d00134e58864`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:40.626311 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-0ae294cb-7e9f-40c6-bb6e-5f483d3d5809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:40.633712 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1263/2530] 10.222.0.96 () {58 vars in 1009 bytes} [Fri Jan 28 02:03:40 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:40.647752 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99f4bb-4ff6-4491-92b3-256e7e8b3671 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:40.660333 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99f4bb-4ff6-4491-92b3-256e7e8b3671 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:40.665492 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30552809-a228-4343-a412-ff909c019cae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a2c3b2815f46b0ac27944f004c4821', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:40.666131 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30552809-a228-4343-a412-ff909c019cae service swift] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:40.666414 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30552809-a228-4343-a412-ff909c019cae service swift] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:40.666689 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30552809-a228-4343-a412-ff909c019cae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:40.675196 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30552809-a228-4343-a412-ff909c019cae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:40.676893 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30552809-a228-4343-a412-ff909c019cae service swift] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:40.685683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1268/2531] 10.222.0.96 () {60 vars in 1384 bytes} [Fri Jan 28 02:03:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:04:07.268857 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae294cb-7e9f-40c6-bb6e-5f483d3d5809 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:07.270241 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-0ae294cb-7e9f-40c6-bb6e-5f483d3d5809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:07.324546 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae294cb-7e9f-40c6-bb6e-5f483d3d5809 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:07.329447 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c489dd-fd7b-4a94-8085-67ae974ca4e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:07.330091 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c489dd-fd7b-4a94-8085-67ae974ca4e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:07.330371 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c489dd-fd7b-4a94-8085-67ae974ca4e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:07.330646 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c489dd-fd7b-4a94-8085-67ae974ca4e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:07.339733 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c489dd-fd7b-4a94-8085-67ae974ca4e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:07.341730 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c489dd-fd7b-4a94-8085-67ae974ca4e0 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:07.350855 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1264/2532] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:07 2022] GET /identity/v3/auth/tokens => generated 3470 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:16.240224 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30552809-a228-4343-a412-ff909c019cae service swift] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:16.241729 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-30552809-a228-4343-a412-ff909c019cae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:16.296204 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30552809-a228-4343-a412-ff909c019cae service swift] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:16.299823 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307bd5d-9d99-4338-9dc6-70f13c6fa63c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:16.300486 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307bd5d-9d99-4338-9dc6-70f13c6fa63c service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:16.300759 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307bd5d-9d99-4338-9dc6-70f13c6fa63c service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:16.301058 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307bd5d-9d99-4338-9dc6-70f13c6fa63c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:16.302771 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c307bd5d-9d99-4338-9dc6-70f13c6fa63c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:16.369829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307bd5d-9d99-4338-9dc6-70f13c6fa63c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:16.371296 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307bd5d-9d99-4338-9dc6-70f13c6fa63c service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:16.381126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1269/2533] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:16 2022] GET /identity/v3/auth/tokens => generated 3399 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:24.230022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e6d4c-ecb9-4db7-911b-0e8a27d73e46 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:24.230542 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e6d4c-ecb9-4db7-911b-0e8a27d73e46 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:24.230646 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e6d4c-ecb9-4db7-911b-0e8a27d73e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:24.249625 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-ad6e6d4c-ecb9-4db7-911b-0e8a27d73e46 None None] MFA Rules not processed for user `cd9cb4ec35524e859b828892c95130e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:24.250816 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ad6e6d4c-ecb9-4db7-911b-0e8a27d73e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:24.257722 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1265/2534] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:24 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:26.470277 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307bd5d-9d99-4338-9dc6-70f13c6fa63c service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:26.479964 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307bd5d-9d99-4338-9dc6-70f13c6fa63c service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:26.484975 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcfa1c-1474-4714-a07a-d48ac23335dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:26.485698 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcfa1c-1474-4714-a07a-d48ac23335dc service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:26.485981 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcfa1c-1474-4714-a07a-d48ac23335dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:26.486252 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcfa1c-1474-4714-a07a-d48ac23335dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:26.488470 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-97dcfa1c-1474-4714-a07a-d48ac23335dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:26.561498 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dcfa1c-1474-4714-a07a-d48ac23335dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:26.562953 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dcfa1c-1474-4714-a07a-d48ac23335dc service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:26.572874 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1270/2535] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:26 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:30.527161 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e6d4c-ecb9-4db7-911b-0e8a27d73e46 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:30.529577 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ad6e6d4c-ecb9-4db7-911b-0e8a27d73e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:30.543233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e6d4c-ecb9-4db7-911b-0e8a27d73e46 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:30.548664 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73d525-9aeb-4539-9ac7-3abc39394beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:30.549565 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73d525-9aeb-4539-9ac7-3abc39394beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:30.549847 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73d525-9aeb-4539-9ac7-3abc39394beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:30.550116 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73d525-9aeb-4539-9ac7-3abc39394beb admin admin] PATH_INFO: `/v3/users/c34c05b7e55447f2a5ddf9c9b9299f44` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:30.551284 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73d525-9aeb-4539-9ac7-3abc39394beb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34c05b7e55447f2a5ddf9c9b9299f44)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:30.553224 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73d525-9aeb-4539-9ac7-3abc39394beb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:30.599958 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-7d73d525-9aeb-4539-9ac7-3abc39394beb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34c05b7e55447f2a5ddf9c9b9299f44'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:30.600599 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-7d73d525-9aeb-4539-9ac7-3abc39394beb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34c05b7e55447f2a5ddf9c9b9299f44'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:30.608852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-7d73d525-9aeb-4539-9ac7-3abc39394beb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34c05b7e55447f2a5ddf9c9b9299f44'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:30.615997 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-7d73d525-9aeb-4539-9ac7-3abc39394beb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34c05b7e55447f2a5ddf9c9b9299f44'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:30.627542 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-7d73d525-9aeb-4539-9ac7-3abc39394beb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34c05b7e55447f2a5ddf9c9b9299f44'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:30.633290 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1266/2536] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:30 2022] DELETE /identity/v3/users/c34c05b7e55447f2a5ddf9c9b9299f44 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:30.817935 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcfa1c-1474-4714-a07a-d48ac23335dc service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:30.829432 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcfa1c-1474-4714-a07a-d48ac23335dc service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:30.884767 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0403bb-6294-4d7d-b0db-63825c5568a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:30.885663 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0403bb-6294-4d7d-b0db-63825c5568a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:30.885940 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0403bb-6294-4d7d-b0db-63825c5568a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:30.886210 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0403bb-6294-4d7d-b0db-63825c5568a3 admin admin] PATH_INFO: `/v3/projects/c744efbffa214f18ab24d619620343c6` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:30.887901 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0403bb-6294-4d7d-b0db-63825c5568a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c744efbffa214f18ab24d619620343c6)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:30.889894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0403bb-6294-4d7d-b0db-63825c5568a3 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:30.933802 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-fa0403bb-6294-4d7d-b0db-63825c5568a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c744efbffa214f18ab24d619620343c6', 'request_id': 'req-fa0403bb-6294-4d7d-b0db-63825c5568a3'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:30.940298 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-fa0403bb-6294-4d7d-b0db-63825c5568a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c744efbffa214f18ab24d619620343c6', 'request_id': 'req-fa0403bb-6294-4d7d-b0db-63825c5568a3'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:30.945474 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-fa0403bb-6294-4d7d-b0db-63825c5568a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c744efbffa214f18ab24d619620343c6', 'request_id': 'req-fa0403bb-6294-4d7d-b0db-63825c5568a3'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:30.957846 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-fa0403bb-6294-4d7d-b0db-63825c5568a3 admin admin] The token cache is being invalidate because project c744efbffa214f18ab24d619620343c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:30.958112 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-fa0403bb-6294-4d7d-b0db-63825c5568a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:30.958735 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-fa0403bb-6294-4d7d-b0db-63825c5568a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:30.960251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1271/2537] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:30 2022] DELETE /identity/v3/projects/c744efbffa214f18ab24d619620343c6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:30.967125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae0dbe-2370-4199-9948-710743a82fb4 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:30.967416 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae0dbe-2370-4199-9948-710743a82fb4 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:30.967694 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae0dbe-2370-4199-9948-710743a82fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:30.985297 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-c5ae0dbe-2370-4199-9948-710743a82fb4 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:30.986492 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c5ae0dbe-2370-4199-9948-710743a82fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:31.047423 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1267/2538] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:30 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:31.055371 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5c588-5264-45d1-aca8-cbcc46ada1c9 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:31.055656 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5c588-5264-45d1-aca8-cbcc46ada1c9 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:31.055929 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5c588-5264-45d1-aca8-cbcc46ada1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:31.077870 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-8bd5c588-5264-45d1-aca8-cbcc46ada1c9 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:31.079108 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-8bd5c588-5264-45d1-aca8-cbcc46ada1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:31.087449 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1272/2539] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:31 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:31.091823 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae0dbe-2370-4199-9948-710743a82fb4 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:31.101876 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae0dbe-2370-4199-9948-710743a82fb4 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:31.106997 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270aa41a-119f-4367-9c42-62788610935e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:31.107306 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270aa41a-119f-4367-9c42-62788610935e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:31.107564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270aa41a-119f-4367-9c42-62788610935e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:31.107835 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270aa41a-119f-4367-9c42-62788610935e admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:31.108640 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270aa41a-119f-4367-9c42-62788610935e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:04:31.108971 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270aa41a-119f-4367-9c42-62788610935e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:31.110548 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270aa41a-119f-4367-9c42-62788610935e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:31.124929 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1268/2540] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:04:31.129057 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5c588-5264-45d1-aca8-cbcc46ada1c9 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:31.138988 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5c588-5264-45d1-aca8-cbcc46ada1c9 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:31.143823 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad38d2-3fa9-4db6-9ff6-158677a3cdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:31.144477 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad38d2-3fa9-4db6-9ff6-158677a3cdee admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:31.144755 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad38d2-3fa9-4db6-9ff6-158677a3cdee admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:31.145060 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad38d2-3fa9-4db6-9ff6-158677a3cdee admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:31.145800 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad38d2-3fa9-4db6-9ff6-158677a3cdee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:31.147713 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad38d2-3fa9-4db6-9ff6-158677a3cdee admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:31.175130 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1273/2541] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:31 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:31.179226 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270aa41a-119f-4367-9c42-62788610935e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:31.189913 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270aa41a-119f-4367-9c42-62788610935e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:31.245021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d33f6a-342d-4ded-ac7e-e0fda463ff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:31.245693 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d33f6a-342d-4ded-ac7e-e0fda463ff80 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:31.245975 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d33f6a-342d-4ded-ac7e-e0fda463ff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:31.246254 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d33f6a-342d-4ded-ac7e-e0fda463ff80 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:31.247588 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d33f6a-342d-4ded-ac7e-e0fda463ff80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:31.250299 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d33f6a-342d-4ded-ac7e-e0fda463ff80 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:31.273744 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1269/2542] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:31 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:04:31.277892 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad38d2-3fa9-4db6-9ff6-158677a3cdee admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:31.288999 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad38d2-3fa9-4db6-9ff6-158677a3cdee admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:31.294108 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8059e08-9e4b-4940-96f4-71e688e83e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:31.294785 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8059e08-9e4b-4940-96f4-71e688e83e99 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:31.295065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8059e08-9e4b-4940-96f4-71e688e83e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:31.295335 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8059e08-9e4b-4940-96f4-71e688e83e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:31.296041 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8059e08-9e4b-4940-96f4-71e688e83e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:31.297678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8059e08-9e4b-4940-96f4-71e688e83e99 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:31.310835 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1274/2543] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:31.315353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d33f6a-342d-4ded-ac7e-e0fda463ff80 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:31.327195 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d33f6a-342d-4ded-ac7e-e0fda463ff80 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:31.332392 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dd65c-bd23-4460-8cca-c7760aa2ba94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:31.333095 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dd65c-bd23-4460-8cca-c7760aa2ba94 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:31.333373 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dd65c-bd23-4460-8cca-c7760aa2ba94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:31.333646 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dd65c-bd23-4460-8cca-c7760aa2ba94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:31.334358 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dd65c-bd23-4460-8cca-c7760aa2ba94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:31.335940 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dd65c-bd23-4460-8cca-c7760aa2ba94 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:31.346300 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1270/2544] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:31.350563 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8059e08-9e4b-4940-96f4-71e688e83e99 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:31.361630 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8059e08-9e4b-4940-96f4-71e688e83e99 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:31.366400 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd91b7-8b23-4279-ba18-f35ed2b6bed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:31.367278 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd91b7-8b23-4279-ba18-f35ed2b6bed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:31.367581 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd91b7-8b23-4279-ba18-f35ed2b6bed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:31.367857 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd91b7-8b23-4279-ba18-f35ed2b6bed1 admin admin] PATH_INFO: `/v3/projects/a5160320a512485397bd6f8ae7a7746a/users/2bb18ce71acb4e33b87274c25d5eb0ed/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:31.387319 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd91b7-8b23-4279-ba18-f35ed2b6bed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5160320a512485397bd6f8ae7a7746a, user_id=2bb18ce71acb4e33b87274c25d5eb0ed, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:31.390307 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd91b7-8b23-4279-ba18-f35ed2b6bed1 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:31.403965 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1275/2545] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:31 2022] PUT /identity/v3/projects/a5160320a512485397bd6f8ae7a7746a/users/2bb18ce71acb4e33b87274c25d5eb0ed/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:31.415662 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76867e5c-ad67-4e8a-a0e1-eb61c10a5aca None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:31.415953 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76867e5c-ad67-4e8a-a0e1-eb61c10a5aca None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:31.416226 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76867e5c-ad67-4e8a-a0e1-eb61c10a5aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:31.445575 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-76867e5c-ad67-4e8a-a0e1-eb61c10a5aca None None] MFA Rules not processed for user `2bb18ce71acb4e33b87274c25d5eb0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:31.446780 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-76867e5c-ad67-4e8a-a0e1-eb61c10a5aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:31.509699 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1271/2546] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:31 2022] POST /identity/v3/auth/tokens => generated 3383 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:04:31.514483 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd91b7-8b23-4279-ba18-f35ed2b6bed1 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:31.578109 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd91b7-8b23-4279-ba18-f35ed2b6bed1 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:31.582784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14590f-1812-4cd1-a3b8-af9f6c6c2a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:31.583428 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14590f-1812-4cd1-a3b8-af9f6c6c2a24 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:31.583711 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14590f-1812-4cd1-a3b8-af9f6c6c2a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:31.583983 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14590f-1812-4cd1-a3b8-af9f6c6c2a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:31.584656 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14590f-1812-4cd1-a3b8-af9f6c6c2a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:31.586865 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14590f-1812-4cd1-a3b8-af9f6c6c2a24 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:31.613319 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1276/2547] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:31 2022] POST /identity/v3/projects => generated 361 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:31.617416 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76867e5c-ad67-4e8a-a0e1-eb61c10a5aca None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:31.628395 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76867e5c-ad67-4e8a-a0e1-eb61c10a5aca None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:31.681442 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21ec8e-3fa5-4c97-b2b4-0d278345eb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:31.682096 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21ec8e-3fa5-4c97-b2b4-0d278345eb4a admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:31.682376 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21ec8e-3fa5-4c97-b2b4-0d278345eb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:31.682650 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21ec8e-3fa5-4c97-b2b4-0d278345eb4a admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:31.683348 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21ec8e-3fa5-4c97-b2b4-0d278345eb4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:31.685318 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21ec8e-3fa5-4c97-b2b4-0d278345eb4a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:31.705194 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1272/2548] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:31 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:04:31.709115 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14590f-1812-4cd1-a3b8-af9f6c6c2a24 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:31.718987 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14590f-1812-4cd1-a3b8-af9f6c6c2a24 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:31.723604 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba9dca-5526-4b91-b792-e403ac41e298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:31.724240 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba9dca-5526-4b91-b792-e403ac41e298 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:31.724520 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba9dca-5526-4b91-b792-e403ac41e298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:31.724789 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba9dca-5526-4b91-b792-e403ac41e298 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:31.725514 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba9dca-5526-4b91-b792-e403ac41e298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:31.727118 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba9dca-5526-4b91-b792-e403ac41e298 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:31.738085 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1277/2549] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:31.742115 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21ec8e-3fa5-4c97-b2b4-0d278345eb4a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:31.752647 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21ec8e-3fa5-4c97-b2b4-0d278345eb4a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:31.757318 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3baa82-2e80-43fd-8fac-acfb957c3b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:31.758183 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3baa82-2e80-43fd-8fac-acfb957c3b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:31.758462 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3baa82-2e80-43fd-8fac-acfb957c3b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:31.758740 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3baa82-2e80-43fd-8fac-acfb957c3b98 admin admin] PATH_INFO: `/v3/projects/79dbaaa3277b419ca6f869100c9b6f64/users/30e55fc686cc4c73af746ece87263c77/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:31.773271 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3baa82-2e80-43fd-8fac-acfb957c3b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79dbaaa3277b419ca6f869100c9b6f64, user_id=30e55fc686cc4c73af746ece87263c77, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:31.775802 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3baa82-2e80-43fd-8fac-acfb957c3b98 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:31.797230 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1273/2550] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:31 2022] PUT /identity/v3/projects/79dbaaa3277b419ca6f869100c9b6f64/users/30e55fc686cc4c73af746ece87263c77/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:31.801173 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba9dca-5526-4b91-b792-e403ac41e298 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:31.811463 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba9dca-5526-4b91-b792-e403ac41e298 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:31.865605 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883961b-630a-462f-801f-ee06d586972e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:31.866301 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883961b-630a-462f-801f-ee06d586972e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:31.866517 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883961b-630a-462f-801f-ee06d586972e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:31.866784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883961b-630a-462f-801f-ee06d586972e admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:31.867487 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883961b-630a-462f-801f-ee06d586972e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:31.869079 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883961b-630a-462f-801f-ee06d586972e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:31.878563 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1278/2551] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:04:31.882723 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3baa82-2e80-43fd-8fac-acfb957c3b98 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:31.892777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3baa82-2e80-43fd-8fac-acfb957c3b98 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:31.897514 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a89de-4ff6-44f8-9af4-bc4d44565728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:31.898385 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a89de-4ff6-44f8-9af4-bc4d44565728 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:31.898666 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a89de-4ff6-44f8-9af4-bc4d44565728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:31.898936 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a89de-4ff6-44f8-9af4-bc4d44565728 admin admin] PATH_INFO: `/v3/projects/79dbaaa3277b419ca6f869100c9b6f64/users/30e55fc686cc4c73af746ece87263c77/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:31.900946 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a89de-4ff6-44f8-9af4-bc4d44565728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79dbaaa3277b419ca6f869100c9b6f64, user_id=30e55fc686cc4c73af746ece87263c77, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:31.904056 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a89de-4ff6-44f8-9af4-bc4d44565728 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:31.915433 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1274/2552] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:31 2022] PUT /identity/v3/projects/79dbaaa3277b419ca6f869100c9b6f64/users/30e55fc686cc4c73af746ece87263c77/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:31.926368 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39addf-811f-40ec-b17a-b7863e100998 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:31.926652 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39addf-811f-40ec-b17a-b7863e100998 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:31.926922 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39addf-811f-40ec-b17a-b7863e100998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:31.955442 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-fc39addf-811f-40ec-b17a-b7863e100998 None None] MFA Rules not processed for user `30e55fc686cc4c73af746ece87263c77`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:31.956676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-fc39addf-811f-40ec-b17a-b7863e100998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:32.022150 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1279/2553] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:31 2022] POST /identity/v3/auth/tokens => generated 3448 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:32.033531 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a89de-4ff6-44f8-9af4-bc4d44565728 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:32.035178 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-a16a89de-4ff6-44f8-9af4-bc4d44565728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:32.090242 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a89de-4ff6-44f8-9af4-bc4d44565728 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:32.094593 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5270f-c55c-4f44-bb17-1e21ed93443c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:32.095236 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5270f-c55c-4f44-bb17-1e21ed93443c service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:32.095517 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5270f-c55c-4f44-bb17-1e21ed93443c service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:32.095788 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5270f-c55c-4f44-bb17-1e21ed93443c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:32.105192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5270f-c55c-4f44-bb17-1e21ed93443c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:32.107264 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5270f-c55c-4f44-bb17-1e21ed93443c service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:32.116618 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1275/2554] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:32 2022] GET /identity/v3/auth/tokens => generated 3448 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:32.279946 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39addf-811f-40ec-b17a-b7863e100998 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:32.343797 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39addf-811f-40ec-b17a-b7863e100998 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:32.348299 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a1cde-b507-4c92-b2bc-f6eed2192172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:32.349180 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a1cde-b507-4c92-b2bc-f6eed2192172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:32.349461 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a1cde-b507-4c92-b2bc-f6eed2192172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:32.349733 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a1cde-b507-4c92-b2bc-f6eed2192172 admin admin] PATH_INFO: `/v3/users/2bb18ce71acb4e33b87274c25d5eb0ed` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:32.350899 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a1cde-b507-4c92-b2bc-f6eed2192172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb18ce71acb4e33b87274c25d5eb0ed)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:32.352849 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a1cde-b507-4c92-b2bc-f6eed2192172 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:32.404974 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c02a1cde-b507-4c92-b2bc-f6eed2192172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb18ce71acb4e33b87274c25d5eb0ed'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:32.405611 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c02a1cde-b507-4c92-b2bc-f6eed2192172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb18ce71acb4e33b87274c25d5eb0ed'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:32.406239 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c02a1cde-b507-4c92-b2bc-f6eed2192172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb18ce71acb4e33b87274c25d5eb0ed'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:32.421202 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c02a1cde-b507-4c92-b2bc-f6eed2192172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb18ce71acb4e33b87274c25d5eb0ed'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:32.428134 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c02a1cde-b507-4c92-b2bc-f6eed2192172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb18ce71acb4e33b87274c25d5eb0ed'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:32.444948 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1280/2555] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:32 2022] DELETE /identity/v3/users/2bb18ce71acb4e33b87274c25d5eb0ed => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:32.449467 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5934b-6407-4cd5-b71b-22b0ab843a3c None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:32.449754 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5934b-6407-4cd5-b71b-22b0ab843a3c None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:32.451054 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5934b-6407-4cd5-b71b-22b0ab843a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:32.469531 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-27e5934b-6407-4cd5-b71b-22b0ab843a3c None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:32.470723 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-27e5934b-6407-4cd5-b71b-22b0ab843a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:32.536088 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1276/2556] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:32.546205 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a1cde-b507-4c92-b2bc-f6eed2192172 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:32.547614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c02a1cde-b507-4c92-b2bc-f6eed2192172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:32.604557 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a1cde-b507-4c92-b2bc-f6eed2192172 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:32.609177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8903ec7-9a95-437d-bcc9-3ed69dc69be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:32.609943 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8903ec7-9a95-437d-bcc9-3ed69dc69be4 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:32.610224 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8903ec7-9a95-437d-bcc9-3ed69dc69be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:32.610496 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8903ec7-9a95-437d-bcc9-3ed69dc69be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:32.620873 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8903ec7-9a95-437d-bcc9-3ed69dc69be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:32.623038 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8903ec7-9a95-437d-bcc9-3ed69dc69be4 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:32.633663 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1281/2557] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:32 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:32.906679 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5934b-6407-4cd5-b71b-22b0ab843a3c None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:32.908554 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-27e5934b-6407-4cd5-b71b-22b0ab843a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:32.921210 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5934b-6407-4cd5-b71b-22b0ab843a3c None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:32.926411 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb324356-ca9b-46e9-b43a-99114d6d78a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:32.927275 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb324356-ca9b-46e9-b43a-99114d6d78a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:32.927549 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb324356-ca9b-46e9-b43a-99114d6d78a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:32.927815 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb324356-ca9b-46e9-b43a-99114d6d78a5 admin admin] PATH_INFO: `/v3/projects/a5160320a512485397bd6f8ae7a7746a` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:32.929007 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb324356-ca9b-46e9-b43a-99114d6d78a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5160320a512485397bd6f8ae7a7746a)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:32.938025 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb324356-ca9b-46e9-b43a-99114d6d78a5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:32.984047 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fb324356-ca9b-46e9-b43a-99114d6d78a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5160320a512485397bd6f8ae7a7746a', 'request_id': 'req-fb324356-ca9b-46e9-b43a-99114d6d78a5'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:32.990037 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fb324356-ca9b-46e9-b43a-99114d6d78a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5160320a512485397bd6f8ae7a7746a', 'request_id': 'req-fb324356-ca9b-46e9-b43a-99114d6d78a5'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:32.995361 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fb324356-ca9b-46e9-b43a-99114d6d78a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5160320a512485397bd6f8ae7a7746a', 'request_id': 'req-fb324356-ca9b-46e9-b43a-99114d6d78a5'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:33.008330 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fb324356-ca9b-46e9-b43a-99114d6d78a5 admin admin] The token cache is being invalidate because project a5160320a512485397bd6f8ae7a7746a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:33.008614 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fb324356-ca9b-46e9-b43a-99114d6d78a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:33.009256 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-fb324356-ca9b-46e9-b43a-99114d6d78a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:33.010769 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1277/2558] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:32 2022] DELETE /identity/v3/projects/a5160320a512485397bd6f8ae7a7746a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:33.015166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8903ec7-9a95-437d-bcc9-3ed69dc69be4 service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:33.024950 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8903ec7-9a95-437d-bcc9-3ed69dc69be4 service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:33.078226 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b961da-7145-45e4-96ca-3971a5a7c8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:33.079085 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b961da-7145-45e4-96ca-3971a5a7c8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:33.079366 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b961da-7145-45e4-96ca-3971a5a7c8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:33.079640 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b961da-7145-45e4-96ca-3971a5a7c8a0 admin admin] PATH_INFO: `/v3/users/30e55fc686cc4c73af746ece87263c77` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:33.080841 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b961da-7145-45e4-96ca-3971a5a7c8a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e55fc686cc4c73af746ece87263c77)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:33.082735 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b961da-7145-45e4-96ca-3971a5a7c8a0 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:33.130333 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-39b961da-7145-45e4-96ca-3971a5a7c8a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e55fc686cc4c73af746ece87263c77'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:33.130993 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-39b961da-7145-45e4-96ca-3971a5a7c8a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e55fc686cc4c73af746ece87263c77'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:33.131586 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-39b961da-7145-45e4-96ca-3971a5a7c8a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e55fc686cc4c73af746ece87263c77'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:33.138813 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-39b961da-7145-45e4-96ca-3971a5a7c8a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e55fc686cc4c73af746ece87263c77'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:33.146336 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-39b961da-7145-45e4-96ca-3971a5a7c8a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e55fc686cc4c73af746ece87263c77'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:33.164141 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1282/2559] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:33 2022] DELETE /identity/v3/users/30e55fc686cc4c73af746ece87263c77 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:33.434634 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb324356-ca9b-46e9-b43a-99114d6d78a5 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:33.436465 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-fb324356-ca9b-46e9-b43a-99114d6d78a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:33.449560 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb324356-ca9b-46e9-b43a-99114d6d78a5 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:33.517460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055010a2-bfbe-466f-8de2-0b20d740fec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:33.518330 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055010a2-bfbe-466f-8de2-0b20d740fec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:33.518609 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055010a2-bfbe-466f-8de2-0b20d740fec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:33.518883 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055010a2-bfbe-466f-8de2-0b20d740fec6 admin admin] PATH_INFO: `/v3/projects/79dbaaa3277b419ca6f869100c9b6f64` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:33.520050 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055010a2-bfbe-466f-8de2-0b20d740fec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79dbaaa3277b419ca6f869100c9b6f64)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:33.522228 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055010a2-bfbe-466f-8de2-0b20d740fec6 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:33.569916 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-055010a2-bfbe-466f-8de2-0b20d740fec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79dbaaa3277b419ca6f869100c9b6f64', 'request_id': 'req-055010a2-bfbe-466f-8de2-0b20d740fec6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:33.576285 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-055010a2-bfbe-466f-8de2-0b20d740fec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79dbaaa3277b419ca6f869100c9b6f64', 'request_id': 'req-055010a2-bfbe-466f-8de2-0b20d740fec6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:33.581552 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-055010a2-bfbe-466f-8de2-0b20d740fec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79dbaaa3277b419ca6f869100c9b6f64', 'request_id': 'req-055010a2-bfbe-466f-8de2-0b20d740fec6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:33.594172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-055010a2-bfbe-466f-8de2-0b20d740fec6 admin admin] The token cache is being invalidate because project 79dbaaa3277b419ca6f869100c9b6f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:33.594453 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-055010a2-bfbe-466f-8de2-0b20d740fec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:33.595059 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-055010a2-bfbe-466f-8de2-0b20d740fec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:33.596568 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1278/2560] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:33 2022] DELETE /identity/v3/projects/79dbaaa3277b419ca6f869100c9b6f64 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:33.602402 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b559451-179e-4036-910b-418afcd2aac7 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:33.602764 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b559451-179e-4036-910b-418afcd2aac7 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:33.603116 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b559451-179e-4036-910b-418afcd2aac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:33.621611 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-7b559451-179e-4036-910b-418afcd2aac7 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:33.622995 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-7b559451-179e-4036-910b-418afcd2aac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:33.678906 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1283/2561] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:33 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:33.686764 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72945b2f-9751-4464-a8b5-043a8c044700 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:33.687059 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72945b2f-9751-4464-a8b5-043a8c044700 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:33.687338 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72945b2f-9751-4464-a8b5-043a8c044700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:33.706003 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-72945b2f-9751-4464-a8b5-043a8c044700 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:33.707198 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-72945b2f-9751-4464-a8b5-043a8c044700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:33.715393 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1279/2562] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:33 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:33.720467 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b559451-179e-4036-910b-418afcd2aac7 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:33.730052 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b559451-179e-4036-910b-418afcd2aac7 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:33.734729 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ab398-af46-47a1-8ef3-be09a9356d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:33.735379 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ab398-af46-47a1-8ef3-be09a9356d88 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:33.735656 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ab398-af46-47a1-8ef3-be09a9356d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:33.735930 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ab398-af46-47a1-8ef3-be09a9356d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:33.736668 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ab398-af46-47a1-8ef3-be09a9356d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:04:33.737005 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ab398-af46-47a1-8ef3-be09a9356d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:33.738619 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ab398-af46-47a1-8ef3-be09a9356d88 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:33.749908 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1284/2563] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:04:33.754116 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72945b2f-9751-4464-a8b5-043a8c044700 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:33.763629 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72945b2f-9751-4464-a8b5-043a8c044700 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:33.768290 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35512a-3589-4c6b-97d3-587819353a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:33.768974 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35512a-3589-4c6b-97d3-587819353a8f admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:33.769254 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35512a-3589-4c6b-97d3-587819353a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:33.769525 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35512a-3589-4c6b-97d3-587819353a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:33.770204 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35512a-3589-4c6b-97d3-587819353a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:33.772079 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35512a-3589-4c6b-97d3-587819353a8f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:33.799395 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1280/2564] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:33 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:33.804226 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ab398-af46-47a1-8ef3-be09a9356d88 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:33.815235 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ab398-af46-47a1-8ef3-be09a9356d88 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:33.872511 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188db64-1521-4841-b6a0-ce4e59a13fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:33.873252 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188db64-1521-4841-b6a0-ce4e59a13fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:33.873551 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188db64-1521-4841-b6a0-ce4e59a13fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:33.873875 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188db64-1521-4841-b6a0-ce4e59a13fb7 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:33.874547 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188db64-1521-4841-b6a0-ce4e59a13fb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:33.876477 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188db64-1521-4841-b6a0-ce4e59a13fb7 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:33.896380 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1285/2565] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:33 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:33.900608 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35512a-3589-4c6b-97d3-587819353a8f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:33.912103 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35512a-3589-4c6b-97d3-587819353a8f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:33.916880 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35482a3-71d4-42cd-8966-1c07c6603615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:33.917533 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35482a3-71d4-42cd-8966-1c07c6603615 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:33.917808 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35482a3-71d4-42cd-8966-1c07c6603615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:33.918084 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35482a3-71d4-42cd-8966-1c07c6603615 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:33.918826 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35482a3-71d4-42cd-8966-1c07c6603615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:33.920393 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35482a3-71d4-42cd-8966-1c07c6603615 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:33.931233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1281/2566] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:04:33.935270 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188db64-1521-4841-b6a0-ce4e59a13fb7 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:33.945279 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188db64-1521-4841-b6a0-ce4e59a13fb7 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:33.950479 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5d1c5-89f0-4b1c-beee-1e4122967db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:33.951140 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5d1c5-89f0-4b1c-beee-1e4122967db2 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:33.951397 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5d1c5-89f0-4b1c-beee-1e4122967db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:33.951676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5d1c5-89f0-4b1c-beee-1e4122967db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:33.952393 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5d1c5-89f0-4b1c-beee-1e4122967db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:33.954049 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5d1c5-89f0-4b1c-beee-1e4122967db2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:33.964408 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1286/2567] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:33.969252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35482a3-71d4-42cd-8966-1c07c6603615 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:33.978925 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35482a3-71d4-42cd-8966-1c07c6603615 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:33.983733 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c48762-cf43-440e-8fb1-24f38a649e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:33.984594 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c48762-cf43-440e-8fb1-24f38a649e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:33.984902 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c48762-cf43-440e-8fb1-24f38a649e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:33.985175 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c48762-cf43-440e-8fb1-24f38a649e8f admin admin] PATH_INFO: `/v3/projects/19a9afb487e14a1f82a9e720792117a4/users/b5f2e68969c84b3ab13ed419fc161135/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:33.999474 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c48762-cf43-440e-8fb1-24f38a649e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a9afb487e14a1f82a9e720792117a4, user_id=b5f2e68969c84b3ab13ed419fc161135, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:34.002089 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c48762-cf43-440e-8fb1-24f38a649e8f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:34.016775 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1282/2568] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:33 2022] PUT /identity/v3/projects/19a9afb487e14a1f82a9e720792117a4/users/b5f2e68969c84b3ab13ed419fc161135/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:34.027826 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76acb05-1ea2-4bd7-94c8-685541586e81 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:34.028395 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76acb05-1ea2-4bd7-94c8-685541586e81 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:34.029048 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76acb05-1ea2-4bd7-94c8-685541586e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:34.055266 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-b76acb05-1ea2-4bd7-94c8-685541586e81 None None] MFA Rules not processed for user `b5f2e68969c84b3ab13ed419fc161135`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:34.056455 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b76acb05-1ea2-4bd7-94c8-685541586e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:34.120224 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1287/2569] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:34 2022] POST /identity/v3/auth/tokens => generated 3389 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:04:34.125191 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c48762-cf43-440e-8fb1-24f38a649e8f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:34.186603 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c48762-cf43-440e-8fb1-24f38a649e8f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:34.190592 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cc6a8-4ac2-4f01-bd04-b016f9e84299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:34.191244 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cc6a8-4ac2-4f01-bd04-b016f9e84299 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:34.191516 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cc6a8-4ac2-4f01-bd04-b016f9e84299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:34.191784 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cc6a8-4ac2-4f01-bd04-b016f9e84299 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:34.192471 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cc6a8-4ac2-4f01-bd04-b016f9e84299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:34.194390 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cc6a8-4ac2-4f01-bd04-b016f9e84299 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:34.220093 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1283/2570] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:34 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:34.224137 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76acb05-1ea2-4bd7-94c8-685541586e81 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:34.234809 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76acb05-1ea2-4bd7-94c8-685541586e81 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:34.297167 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3cc754-cbef-4a9a-ab55-5de5730326e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:34.297840 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3cc754-cbef-4a9a-ab55-5de5730326e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:34.298120 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3cc754-cbef-4a9a-ab55-5de5730326e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:34.298390 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3cc754-cbef-4a9a-ab55-5de5730326e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:34.299082 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3cc754-cbef-4a9a-ab55-5de5730326e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:34.301017 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3cc754-cbef-4a9a-ab55-5de5730326e1 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:34.322688 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1288/2571] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:34 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:34.327615 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cc6a8-4ac2-4f01-bd04-b016f9e84299 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:34.337953 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cc6a8-4ac2-4f01-bd04-b016f9e84299 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:34.342745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35f755-b4eb-4d2e-9f79-581f5756cb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:34.343693 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35f755-b4eb-4d2e-9f79-581f5756cb10 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:34.343983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35f755-b4eb-4d2e-9f79-581f5756cb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:34.344263 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35f755-b4eb-4d2e-9f79-581f5756cb10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:34.345018 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35f755-b4eb-4d2e-9f79-581f5756cb10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:34.346603 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35f755-b4eb-4d2e-9f79-581f5756cb10 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:34.358303 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1284/2572] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:34.362793 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3cc754-cbef-4a9a-ab55-5de5730326e1 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:34.373818 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3cc754-cbef-4a9a-ab55-5de5730326e1 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:34.378567 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85aadd-bb2d-4303-840d-4620cdc7bf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:34.379454 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85aadd-bb2d-4303-840d-4620cdc7bf56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:34.379733 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85aadd-bb2d-4303-840d-4620cdc7bf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:34.380005 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85aadd-bb2d-4303-840d-4620cdc7bf56 admin admin] PATH_INFO: `/v3/projects/3172e55b04824615b9fd1b11558c95db/users/4b7f62ac987b43278665fa1f1811cddc/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:34.395567 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85aadd-bb2d-4303-840d-4620cdc7bf56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3172e55b04824615b9fd1b11558c95db, user_id=4b7f62ac987b43278665fa1f1811cddc, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:34.398259 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85aadd-bb2d-4303-840d-4620cdc7bf56 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:34.412898 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1289/2573] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:34 2022] PUT /identity/v3/projects/3172e55b04824615b9fd1b11558c95db/users/4b7f62ac987b43278665fa1f1811cddc/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:04:34.417177 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35f755-b4eb-4d2e-9f79-581f5756cb10 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:34.427133 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35f755-b4eb-4d2e-9f79-581f5756cb10 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:34.482237 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edbc1d-993e-42f0-b3f0-df04a64612b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:34.482816 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edbc1d-993e-42f0-b3f0-df04a64612b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:34.483114 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edbc1d-993e-42f0-b3f0-df04a64612b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:34.483386 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edbc1d-993e-42f0-b3f0-df04a64612b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:34.484102 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47edbc1d-993e-42f0-b3f0-df04a64612b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:34.485778 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47edbc1d-993e-42f0-b3f0-df04a64612b8 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:34.496366 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1285/2574] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:34.500917 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85aadd-bb2d-4303-840d-4620cdc7bf56 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:34.520990 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85aadd-bb2d-4303-840d-4620cdc7bf56 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:34.525893 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e262c9b-590c-463a-a9ea-4b5eed901b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:34.526764 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e262c9b-590c-463a-a9ea-4b5eed901b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:34.527042 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e262c9b-590c-463a-a9ea-4b5eed901b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:34.527309 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e262c9b-590c-463a-a9ea-4b5eed901b3c admin admin] PATH_INFO: `/v3/projects/3172e55b04824615b9fd1b11558c95db/users/4b7f62ac987b43278665fa1f1811cddc/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:34.530318 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e262c9b-590c-463a-a9ea-4b5eed901b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3172e55b04824615b9fd1b11558c95db, user_id=4b7f62ac987b43278665fa1f1811cddc, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:34.533317 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e262c9b-590c-463a-a9ea-4b5eed901b3c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:34.544772 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1290/2575] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:34 2022] PUT /identity/v3/projects/3172e55b04824615b9fd1b11558c95db/users/4b7f62ac987b43278665fa1f1811cddc/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:34.555441 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f802e24-6e7c-4263-9baa-ddfdf17a2fae None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:34.555739 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f802e24-6e7c-4263-9baa-ddfdf17a2fae None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:34.555999 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f802e24-6e7c-4263-9baa-ddfdf17a2fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:34.585199 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-2f802e24-6e7c-4263-9baa-ddfdf17a2fae None None] MFA Rules not processed for user `4b7f62ac987b43278665fa1f1811cddc`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:34.586428 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2f802e24-6e7c-4263-9baa-ddfdf17a2fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:34.659021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1286/2576] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:34 2022] POST /identity/v3/auth/tokens => generated 3454 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:34.669570 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e262c9b-590c-463a-a9ea-4b5eed901b3c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:34.671282 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-4e262c9b-590c-463a-a9ea-4b5eed901b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:34.726774 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e262c9b-590c-463a-a9ea-4b5eed901b3c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:34.730397 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b47e3-8d48-469c-b8c9-43dc1b1469c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:34.731025 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b47e3-8d48-469c-b8c9-43dc1b1469c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:34.731359 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b47e3-8d48-469c-b8c9-43dc1b1469c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:34.731784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b47e3-8d48-469c-b8c9-43dc1b1469c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:34.740582 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b47e3-8d48-469c-b8c9-43dc1b1469c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:34.742037 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b47e3-8d48-469c-b8c9-43dc1b1469c1 service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:34.751753 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1291/2577] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:34 2022] GET /identity/v3/auth/tokens => generated 3454 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:34.795606 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f802e24-6e7c-4263-9baa-ddfdf17a2fae None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:34.797107 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2f802e24-6e7c-4263-9baa-ddfdf17a2fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:34.808922 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f802e24-6e7c-4263-9baa-ddfdf17a2fae None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:34.829743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d71cb3-eb7b-46c4-b22a-d1f85781bc91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:34.830394 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d71cb3-eb7b-46c4-b22a-d1f85781bc91 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:34.830674 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d71cb3-eb7b-46c4-b22a-d1f85781bc91 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:34.830946 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d71cb3-eb7b-46c4-b22a-d1f85781bc91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:34.892462 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d71cb3-eb7b-46c4-b22a-d1f85781bc91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:34.894075 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d71cb3-eb7b-46c4-b22a-d1f85781bc91 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:34.903130 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1287/2578] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:34 2022] GET /identity/v3/auth/tokens => generated 3389 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:38.253242 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b47e3-8d48-469c-b8c9-43dc1b1469c1 service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:38.316283 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b47e3-8d48-469c-b8c9-43dc1b1469c1 service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:38.321014 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235241b-2db8-4129-a4e2-d501a564fee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:38.321876 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235241b-2db8-4129-a4e2-d501a564fee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:38.322151 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235241b-2db8-4129-a4e2-d501a564fee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:38.322418 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235241b-2db8-4129-a4e2-d501a564fee4 admin admin] PATH_INFO: `/v3/users/b5f2e68969c84b3ab13ed419fc161135` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:38.323668 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235241b-2db8-4129-a4e2-d501a564fee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f2e68969c84b3ab13ed419fc161135)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:38.326151 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235241b-2db8-4129-a4e2-d501a564fee4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:38.379251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3235241b-2db8-4129-a4e2-d501a564fee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f2e68969c84b3ab13ed419fc161135'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:38.379934 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3235241b-2db8-4129-a4e2-d501a564fee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f2e68969c84b3ab13ed419fc161135'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:38.380533 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3235241b-2db8-4129-a4e2-d501a564fee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f2e68969c84b3ab13ed419fc161135'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:38.388654 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3235241b-2db8-4129-a4e2-d501a564fee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f2e68969c84b3ab13ed419fc161135'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:38.395368 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3235241b-2db8-4129-a4e2-d501a564fee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f2e68969c84b3ab13ed419fc161135'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:38.412998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1292/2579] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:38 2022] DELETE /identity/v3/users/b5f2e68969c84b3ab13ed419fc161135 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:38.417877 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af7e30-d27b-4eba-9849-08656e0b0d84 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:38.418562 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af7e30-d27b-4eba-9849-08656e0b0d84 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:38.418562 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af7e30-d27b-4eba-9849-08656e0b0d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:38.438911 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-e1af7e30-d27b-4eba-9849-08656e0b0d84 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:38.440247 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-e1af7e30-d27b-4eba-9849-08656e0b0d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:38.498426 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1288/2580] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:38 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:04:38.509026 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235241b-2db8-4129-a4e2-d501a564fee4 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:38.510419 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-3235241b-2db8-4129-a4e2-d501a564fee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:38.570575 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235241b-2db8-4129-a4e2-d501a564fee4 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:38.574580 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150907c0-1dc3-4ed2-8eea-57587e3224bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:38.575407 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150907c0-1dc3-4ed2-8eea-57587e3224bc service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:38.575933 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150907c0-1dc3-4ed2-8eea-57587e3224bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:38.576232 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150907c0-1dc3-4ed2-8eea-57587e3224bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:38.585985 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150907c0-1dc3-4ed2-8eea-57587e3224bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:38.587432 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150907c0-1dc3-4ed2-8eea-57587e3224bc service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:38.598184 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1293/2581] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:38 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:38.863282 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af7e30-d27b-4eba-9849-08656e0b0d84 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:38.865197 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-e1af7e30-d27b-4eba-9849-08656e0b0d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:38.876909 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af7e30-d27b-4eba-9849-08656e0b0d84 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:38.882546 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76c2ee-4fda-4502-89b4-8b6be7cbedb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:38.882546 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76c2ee-4fda-4502-89b4-8b6be7cbedb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:38.886197 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76c2ee-4fda-4502-89b4-8b6be7cbedb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:38.886197 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76c2ee-4fda-4502-89b4-8b6be7cbedb6 admin admin] PATH_INFO: `/v3/projects/19a9afb487e14a1f82a9e720792117a4` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:38.888302 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76c2ee-4fda-4502-89b4-8b6be7cbedb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19a9afb487e14a1f82a9e720792117a4)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:38.890244 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76c2ee-4fda-4502-89b4-8b6be7cbedb6 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:38.939972 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9f76c2ee-4fda-4502-89b4-8b6be7cbedb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19a9afb487e14a1f82a9e720792117a4', 'request_id': 'req-9f76c2ee-4fda-4502-89b4-8b6be7cbedb6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:38.946021 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9f76c2ee-4fda-4502-89b4-8b6be7cbedb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19a9afb487e14a1f82a9e720792117a4', 'request_id': 'req-9f76c2ee-4fda-4502-89b4-8b6be7cbedb6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:38.952175 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9f76c2ee-4fda-4502-89b4-8b6be7cbedb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19a9afb487e14a1f82a9e720792117a4', 'request_id': 'req-9f76c2ee-4fda-4502-89b4-8b6be7cbedb6'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:38.967023 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9f76c2ee-4fda-4502-89b4-8b6be7cbedb6 admin admin] The token cache is being invalidate because project 19a9afb487e14a1f82a9e720792117a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:38.967306 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9f76c2ee-4fda-4502-89b4-8b6be7cbedb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:38.967921 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9f76c2ee-4fda-4502-89b4-8b6be7cbedb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:38.969491 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1289/2582] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:38 2022] DELETE /identity/v3/projects/19a9afb487e14a1f82a9e720792117a4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:38.973445 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150907c0-1dc3-4ed2-8eea-57587e3224bc service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:38.983038 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150907c0-1dc3-4ed2-8eea-57587e3224bc service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:39.036197 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5b5f9-08c7-4794-ac39-0a43229a90de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:39.037089 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5b5f9-08c7-4794-ac39-0a43229a90de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:39.037361 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5b5f9-08c7-4794-ac39-0a43229a90de admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:39.037632 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5b5f9-08c7-4794-ac39-0a43229a90de admin admin] PATH_INFO: `/v3/users/4b7f62ac987b43278665fa1f1811cddc` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:39.038825 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5b5f9-08c7-4794-ac39-0a43229a90de admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b7f62ac987b43278665fa1f1811cddc)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:39.040702 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5b5f9-08c7-4794-ac39-0a43229a90de admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:39.085209 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-52e5b5f9-08c7-4794-ac39-0a43229a90de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b7f62ac987b43278665fa1f1811cddc'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:39.085835 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-52e5b5f9-08c7-4794-ac39-0a43229a90de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b7f62ac987b43278665fa1f1811cddc'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:39.086420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-52e5b5f9-08c7-4794-ac39-0a43229a90de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b7f62ac987b43278665fa1f1811cddc'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:39.095147 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-52e5b5f9-08c7-4794-ac39-0a43229a90de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b7f62ac987b43278665fa1f1811cddc'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:39.102243 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-52e5b5f9-08c7-4794-ac39-0a43229a90de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b7f62ac987b43278665fa1f1811cddc'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:39.119552 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1294/2583] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:38 2022] DELETE /identity/v3/users/4b7f62ac987b43278665fa1f1811cddc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:39.792632 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76c2ee-4fda-4502-89b4-8b6be7cbedb6 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:39.795022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-9f76c2ee-4fda-4502-89b4-8b6be7cbedb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:39.822425 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76c2ee-4fda-4502-89b4-8b6be7cbedb6 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:39.890547 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf10cf-d339-4a48-a458-35da3e8a47be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:39.891419 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf10cf-d339-4a48-a458-35da3e8a47be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:39.891697 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf10cf-d339-4a48-a458-35da3e8a47be admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:39.891980 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf10cf-d339-4a48-a458-35da3e8a47be admin admin] PATH_INFO: `/v3/projects/3172e55b04824615b9fd1b11558c95db` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:39.893215 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf10cf-d339-4a48-a458-35da3e8a47be admin admin] RBAC: Authorizing `identity:delete_project(project_id=3172e55b04824615b9fd1b11558c95db)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:39.895097 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf10cf-d339-4a48-a458-35da3e8a47be admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:39.942630 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-afbf10cf-d339-4a48-a458-35da3e8a47be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3172e55b04824615b9fd1b11558c95db', 'request_id': 'req-afbf10cf-d339-4a48-a458-35da3e8a47be'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:39.948679 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-afbf10cf-d339-4a48-a458-35da3e8a47be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3172e55b04824615b9fd1b11558c95db', 'request_id': 'req-afbf10cf-d339-4a48-a458-35da3e8a47be'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:39.954752 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-afbf10cf-d339-4a48-a458-35da3e8a47be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3172e55b04824615b9fd1b11558c95db', 'request_id': 'req-afbf10cf-d339-4a48-a458-35da3e8a47be'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:39.969277 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-afbf10cf-d339-4a48-a458-35da3e8a47be admin admin] The token cache is being invalidate because project 3172e55b04824615b9fd1b11558c95db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:39.969590 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-afbf10cf-d339-4a48-a458-35da3e8a47be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:39.970208 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-afbf10cf-d339-4a48-a458-35da3e8a47be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:39.971790 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1290/2584] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:39 2022] DELETE /identity/v3/projects/3172e55b04824615b9fd1b11558c95db => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:39.977512 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20e6e7-4209-4e89-bf5b-47c2408b4ece None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:39.978003 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20e6e7-4209-4e89-bf5b-47c2408b4ece None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:39.978107 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20e6e7-4209-4e89-bf5b-47c2408b4ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:39.996068 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-8f20e6e7-4209-4e89-bf5b-47c2408b4ece None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:39.998490 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-8f20e6e7-4209-4e89-bf5b-47c2408b4ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:40.058041 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1295/2585] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:39 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:04:40.066140 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ca4b4-d999-4580-8d02-2bd1dfc9acb6 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:40.066429 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ca4b4-d999-4580-8d02-2bd1dfc9acb6 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:40.066705 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ca4b4-d999-4580-8d02-2bd1dfc9acb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:40.085242 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-665ca4b4-d999-4580-8d02-2bd1dfc9acb6 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:40.086433 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-665ca4b4-d999-4580-8d02-2bd1dfc9acb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:40.098912 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1291/2586] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:40 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:40.103182 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20e6e7-4209-4e89-bf5b-47c2408b4ece None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:40.113770 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20e6e7-4209-4e89-bf5b-47c2408b4ece None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:40.118471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b084119-8d03-4a9b-a911-a27474e4e900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:40.119126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b084119-8d03-4a9b-a911-a27474e4e900 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:40.119409 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b084119-8d03-4a9b-a911-a27474e4e900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:40.119690 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b084119-8d03-4a9b-a911-a27474e4e900 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:40.120416 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b084119-8d03-4a9b-a911-a27474e4e900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:04:40.120723 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b084119-8d03-4a9b-a911-a27474e4e900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:40.123065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b084119-8d03-4a9b-a911-a27474e4e900 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:40.134934 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1296/2587] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:04:40.139332 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ca4b4-d999-4580-8d02-2bd1dfc9acb6 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:40.148418 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ca4b4-d999-4580-8d02-2bd1dfc9acb6 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:40.153547 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047cd12-bf53-400b-8c75-6451aafc320a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:40.154207 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047cd12-bf53-400b-8c75-6451aafc320a admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:40.154543 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047cd12-bf53-400b-8c75-6451aafc320a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:40.154818 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047cd12-bf53-400b-8c75-6451aafc320a admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:40.155495 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047cd12-bf53-400b-8c75-6451aafc320a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:40.157399 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047cd12-bf53-400b-8c75-6451aafc320a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:40.182811 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1292/2588] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:40 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:40.187112 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b084119-8d03-4a9b-a911-a27474e4e900 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:40.197655 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b084119-8d03-4a9b-a911-a27474e4e900 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:40.256716 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cd0bd-26ae-4aa1-b8ba-2335dbda059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:40.257432 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cd0bd-26ae-4aa1-b8ba-2335dbda059e admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:40.257709 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cd0bd-26ae-4aa1-b8ba-2335dbda059e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:40.257977 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cd0bd-26ae-4aa1-b8ba-2335dbda059e admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:40.258646 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cd0bd-26ae-4aa1-b8ba-2335dbda059e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:40.260576 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cd0bd-26ae-4aa1-b8ba-2335dbda059e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:40.281597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1297/2589] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:40 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:40.286030 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047cd12-bf53-400b-8c75-6451aafc320a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:40.297119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047cd12-bf53-400b-8c75-6451aafc320a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:40.302001 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bea0a-f26b-4afe-a925-5e8f21c5238f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:40.302655 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bea0a-f26b-4afe-a925-5e8f21c5238f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:40.303011 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bea0a-f26b-4afe-a925-5e8f21c5238f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:40.303289 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bea0a-f26b-4afe-a925-5e8f21c5238f admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:40.304016 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bea0a-f26b-4afe-a925-5e8f21c5238f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:40.305645 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bea0a-f26b-4afe-a925-5e8f21c5238f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:40.318134 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1293/2590] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:40.322717 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cd0bd-26ae-4aa1-b8ba-2335dbda059e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:40.333300 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cd0bd-26ae-4aa1-b8ba-2335dbda059e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:40.338109 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361a5e7-6f6b-453b-9e2d-c01ad632d669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:40.338789 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361a5e7-6f6b-453b-9e2d-c01ad632d669 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:40.339062 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361a5e7-6f6b-453b-9e2d-c01ad632d669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:40.339328 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361a5e7-6f6b-453b-9e2d-c01ad632d669 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:40.340059 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361a5e7-6f6b-453b-9e2d-c01ad632d669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:40.342624 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361a5e7-6f6b-453b-9e2d-c01ad632d669 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:40.352768 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1298/2591] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:40.357706 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bea0a-f26b-4afe-a925-5e8f21c5238f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:40.368187 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bea0a-f26b-4afe-a925-5e8f21c5238f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:40.372910 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41353c1f-afaa-42c2-94f0-6bc65ae3a043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:40.373814 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41353c1f-afaa-42c2-94f0-6bc65ae3a043 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:40.374098 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41353c1f-afaa-42c2-94f0-6bc65ae3a043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:40.374374 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41353c1f-afaa-42c2-94f0-6bc65ae3a043 admin admin] PATH_INFO: `/v3/projects/8240b20b5be74d69b73b8616a7cbf76e/users/e960153c5abc4b34a8b7fa04082061a9/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:40.389558 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41353c1f-afaa-42c2-94f0-6bc65ae3a043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8240b20b5be74d69b73b8616a7cbf76e, user_id=e960153c5abc4b34a8b7fa04082061a9, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:40.392197 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41353c1f-afaa-42c2-94f0-6bc65ae3a043 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:40.406066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1294/2592] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:40 2022] PUT /identity/v3/projects/8240b20b5be74d69b73b8616a7cbf76e/users/e960153c5abc4b34a8b7fa04082061a9/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:40.417909 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ff940-4702-4f06-b6d6-1004f6ba3f89 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:40.418199 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ff940-4702-4f06-b6d6-1004f6ba3f89 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:40.419430 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ff940-4702-4f06-b6d6-1004f6ba3f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:40.448339 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-564ff940-4702-4f06-b6d6-1004f6ba3f89 None None] MFA Rules not processed for user `e960153c5abc4b34a8b7fa04082061a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:40.449598 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-564ff940-4702-4f06-b6d6-1004f6ba3f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:40.523725 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1299/2593] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:40 2022] POST /identity/v3/auth/tokens => generated 3409 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:40.525113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41353c1f-afaa-42c2-94f0-6bc65ae3a043 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:40.611312 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41353c1f-afaa-42c2-94f0-6bc65ae3a043 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:40.624751 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b54b5d-5257-4fce-ba06-3623a41d98f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:40.625635 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b54b5d-5257-4fce-ba06-3623a41d98f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:40.625945 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b54b5d-5257-4fce-ba06-3623a41d98f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:40.626197 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b54b5d-5257-4fce-ba06-3623a41d98f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:40.626894 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b54b5d-5257-4fce-ba06-3623a41d98f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:40.628861 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b54b5d-5257-4fce-ba06-3623a41d98f2 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:40.660196 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1295/2594] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:40 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:40.664260 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ff940-4702-4f06-b6d6-1004f6ba3f89 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:40.676347 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ff940-4702-4f06-b6d6-1004f6ba3f89 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:40.735886 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2ff70-7df9-4991-956a-5da10c41163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:40.736559 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2ff70-7df9-4991-956a-5da10c41163f admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:40.736868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2ff70-7df9-4991-956a-5da10c41163f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:40.737174 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2ff70-7df9-4991-956a-5da10c41163f admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:40.737866 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2ff70-7df9-4991-956a-5da10c41163f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:40.739829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2ff70-7df9-4991-956a-5da10c41163f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:40.761767 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1300/2595] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:40 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:40.766300 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b54b5d-5257-4fce-ba06-3623a41d98f2 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:40.776679 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b54b5d-5257-4fce-ba06-3623a41d98f2 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:40.782435 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11fa18-d2a3-4cc3-a9b8-ba1bbbceb65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:40.783371 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11fa18-d2a3-4cc3-a9b8-ba1bbbceb65d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:40.783648 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11fa18-d2a3-4cc3-a9b8-ba1bbbceb65d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:40.783921 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11fa18-d2a3-4cc3-a9b8-ba1bbbceb65d admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:40.784694 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11fa18-d2a3-4cc3-a9b8-ba1bbbceb65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:40.786324 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11fa18-d2a3-4cc3-a9b8-ba1bbbceb65d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:40.799257 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1296/2596] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:04:40.803934 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2ff70-7df9-4991-956a-5da10c41163f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:40.814721 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2ff70-7df9-4991-956a-5da10c41163f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:40.820296 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ff69c-dd84-42f1-96e4-2ed0482c534d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:40.821250 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ff69c-dd84-42f1-96e4-2ed0482c534d admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:40.821579 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ff69c-dd84-42f1-96e4-2ed0482c534d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:40.821792 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ff69c-dd84-42f1-96e4-2ed0482c534d admin admin] PATH_INFO: `/v3/projects/2fb731fe215d4a4ba7c6f7b31b255760/users/94dd744e35d74359a31002fb0c7524ff/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:40.838694 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ff69c-dd84-42f1-96e4-2ed0482c534d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb731fe215d4a4ba7c6f7b31b255760, user_id=94dd744e35d74359a31002fb0c7524ff, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:40.842505 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ff69c-dd84-42f1-96e4-2ed0482c534d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:40.859316 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1301/2597] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:40 2022] PUT /identity/v3/projects/2fb731fe215d4a4ba7c6f7b31b255760/users/94dd744e35d74359a31002fb0c7524ff/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:40.863273 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11fa18-d2a3-4cc3-a9b8-ba1bbbceb65d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:40.873924 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11fa18-d2a3-4cc3-a9b8-ba1bbbceb65d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:40.949517 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c4c8b-aebd-412a-808c-a3688689960b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:40.950396 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c4c8b-aebd-412a-808c-a3688689960b admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:40.950806 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c4c8b-aebd-412a-808c-a3688689960b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:40.951606 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c4c8b-aebd-412a-808c-a3688689960b admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:40.952518 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c4c8b-aebd-412a-808c-a3688689960b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:40.955733 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c4c8b-aebd-412a-808c-a3688689960b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:40.976312 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1297/2598] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:04:40.979508 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ff69c-dd84-42f1-96e4-2ed0482c534d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:40.997619 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ff69c-dd84-42f1-96e4-2ed0482c534d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:41.009816 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de567315-b6a0-42ab-94db-641c9e56653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:41.012129 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de567315-b6a0-42ab-94db-641c9e56653c admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:41.012821 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de567315-b6a0-42ab-94db-641c9e56653c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:41.013404 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de567315-b6a0-42ab-94db-641c9e56653c admin admin] PATH_INFO: `/v3/projects/2fb731fe215d4a4ba7c6f7b31b255760/users/94dd744e35d74359a31002fb0c7524ff/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:41.018002 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de567315-b6a0-42ab-94db-641c9e56653c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb731fe215d4a4ba7c6f7b31b255760, user_id=94dd744e35d74359a31002fb0c7524ff, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:41.023928 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de567315-b6a0-42ab-94db-641c9e56653c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:41.038690 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1302/2599] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:40 2022] PUT /identity/v3/projects/2fb731fe215d4a4ba7c6f7b31b255760/users/94dd744e35d74359a31002fb0c7524ff/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:41.055765 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c4dec-ab45-474f-84f6-fdeeef031dc9 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:41.056113 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c4dec-ab45-474f-84f6-fdeeef031dc9 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:41.056447 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c4dec-ab45-474f-84f6-fdeeef031dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:41.083339 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-685c4dec-ab45-474f-84f6-fdeeef031dc9 None None] MFA Rules not processed for user `94dd744e35d74359a31002fb0c7524ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:41.086329 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-685c4dec-ab45-474f-84f6-fdeeef031dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:41.161884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1298/2600] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:41 2022] POST /identity/v3/auth/tokens => generated 3474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:04:41.171662 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de567315-b6a0-42ab-94db-641c9e56653c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:41.173457 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-de567315-b6a0-42ab-94db-641c9e56653c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:41.227513 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de567315-b6a0-42ab-94db-641c9e56653c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:41.231228 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990daa6-77d4-4c1a-b067-e13e287b4a73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:41.231868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990daa6-77d4-4c1a-b067-e13e287b4a73 service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:41.232142 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990daa6-77d4-4c1a-b067-e13e287b4a73 service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:41.232416 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990daa6-77d4-4c1a-b067-e13e287b4a73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:41.242257 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990daa6-77d4-4c1a-b067-e13e287b4a73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:41.243604 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990daa6-77d4-4c1a-b067-e13e287b4a73 service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:41.253825 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1303/2601] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:41 2022] GET /identity/v3/auth/tokens => generated 3474 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:41.381741 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c4dec-ab45-474f-84f6-fdeeef031dc9 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:41.445389 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c4dec-ab45-474f-84f6-fdeeef031dc9 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:41.450351 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d072fa-0c69-4603-a6ad-e9187660bd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:41.451216 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d072fa-0c69-4603-a6ad-e9187660bd5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:41.451490 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d072fa-0c69-4603-a6ad-e9187660bd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:41.451764 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d072fa-0c69-4603-a6ad-e9187660bd5f admin admin] PATH_INFO: `/v3/users/e960153c5abc4b34a8b7fa04082061a9` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:41.453003 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d072fa-0c69-4603-a6ad-e9187660bd5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e960153c5abc4b34a8b7fa04082061a9)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:41.454902 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d072fa-0c69-4603-a6ad-e9187660bd5f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:41.500381 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-55d072fa-0c69-4603-a6ad-e9187660bd5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e960153c5abc4b34a8b7fa04082061a9'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:41.501091 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-55d072fa-0c69-4603-a6ad-e9187660bd5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e960153c5abc4b34a8b7fa04082061a9'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:41.507892 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-55d072fa-0c69-4603-a6ad-e9187660bd5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e960153c5abc4b34a8b7fa04082061a9'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:41.515979 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-55d072fa-0c69-4603-a6ad-e9187660bd5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e960153c5abc4b34a8b7fa04082061a9'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:41.527497 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-55d072fa-0c69-4603-a6ad-e9187660bd5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e960153c5abc4b34a8b7fa04082061a9'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:41.535754 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1299/2602] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:41 2022] DELETE /identity/v3/users/e960153c5abc4b34a8b7fa04082061a9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:41.540399 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b6070-1266-42ae-aad3-6cd054f24728 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:41.540686 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b6070-1266-42ae-aad3-6cd054f24728 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:41.540998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b6070-1266-42ae-aad3-6cd054f24728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:41.560509 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-ff6b6070-1266-42ae-aad3-6cd054f24728 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:41.561764 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-ff6b6070-1266-42ae-aad3-6cd054f24728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:41.624104 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1304/2603] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:41 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:41.634158 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d072fa-0c69-4603-a6ad-e9187660bd5f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:41.635596 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-55d072fa-0c69-4603-a6ad-e9187660bd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:41.691545 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d072fa-0c69-4603-a6ad-e9187660bd5f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:41.695218 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50002d37-f301-4503-a864-45220d50fb8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:41.695907 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50002d37-f301-4503-a864-45220d50fb8f service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:41.696128 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50002d37-f301-4503-a864-45220d50fb8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:41.696398 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50002d37-f301-4503-a864-45220d50fb8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:41.706290 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50002d37-f301-4503-a864-45220d50fb8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:41.707712 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50002d37-f301-4503-a864-45220d50fb8f service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:41.718592 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1300/2604] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:41 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:41.738913 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b6070-1266-42ae-aad3-6cd054f24728 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:41.740571 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-ff6b6070-1266-42ae-aad3-6cd054f24728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:41.752765 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b6070-1266-42ae-aad3-6cd054f24728 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:41.756477 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a1358-e66c-465a-b240-9bd7bbad77f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:41.757242 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a1358-e66c-465a-b240-9bd7bbad77f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:41.757607 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a1358-e66c-465a-b240-9bd7bbad77f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:41.757947 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a1358-e66c-465a-b240-9bd7bbad77f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:41.759785 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a26a1358-e66c-465a-b240-9bd7bbad77f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:41.825245 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a1358-e66c-465a-b240-9bd7bbad77f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:41.827166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a1358-e66c-465a-b240-9bd7bbad77f3 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:41.837044 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1305/2605] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:41 2022] GET /identity/v3/auth/tokens => generated 3391 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:42.185319 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50002d37-f301-4503-a864-45220d50fb8f service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:42.186784 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-50002d37-f301-4503-a864-45220d50fb8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:42.203690 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50002d37-f301-4503-a864-45220d50fb8f service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:42.214858 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da5547-1fa3-480f-99da-4d8401e56a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:42.216487 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da5547-1fa3-480f-99da-4d8401e56a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:42.216917 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da5547-1fa3-480f-99da-4d8401e56a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:42.217116 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da5547-1fa3-480f-99da-4d8401e56a42 admin admin] PATH_INFO: `/v3/projects/8240b20b5be74d69b73b8616a7cbf76e` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:42.218603 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da5547-1fa3-480f-99da-4d8401e56a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8240b20b5be74d69b73b8616a7cbf76e)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:42.220785 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da5547-1fa3-480f-99da-4d8401e56a42 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:42.279893 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e3da5547-1fa3-480f-99da-4d8401e56a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8240b20b5be74d69b73b8616a7cbf76e', 'request_id': 'req-e3da5547-1fa3-480f-99da-4d8401e56a42'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:42.287604 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e3da5547-1fa3-480f-99da-4d8401e56a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8240b20b5be74d69b73b8616a7cbf76e', 'request_id': 'req-e3da5547-1fa3-480f-99da-4d8401e56a42'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:42.293171 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e3da5547-1fa3-480f-99da-4d8401e56a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8240b20b5be74d69b73b8616a7cbf76e', 'request_id': 'req-e3da5547-1fa3-480f-99da-4d8401e56a42'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:42.308933 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e3da5547-1fa3-480f-99da-4d8401e56a42 admin admin] The token cache is being invalidate because project 8240b20b5be74d69b73b8616a7cbf76e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:42.310313 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e3da5547-1fa3-480f-99da-4d8401e56a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:42.311316 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e3da5547-1fa3-480f-99da-4d8401e56a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:42.313794 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1301/2606] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:42 2022] DELETE /identity/v3/projects/8240b20b5be74d69b73b8616a7cbf76e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:42.318832 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a1358-e66c-465a-b240-9bd7bbad77f3 service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:42.330589 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a1358-e66c-465a-b240-9bd7bbad77f3 service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:42.393253 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684b73f-e4bf-4397-ad52-5a0938cb0941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:42.394273 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684b73f-e4bf-4397-ad52-5a0938cb0941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:42.394555 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684b73f-e4bf-4397-ad52-5a0938cb0941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:42.394823 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684b73f-e4bf-4397-ad52-5a0938cb0941 admin admin] PATH_INFO: `/v3/users/94dd744e35d74359a31002fb0c7524ff` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:42.396044 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684b73f-e4bf-4397-ad52-5a0938cb0941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94dd744e35d74359a31002fb0c7524ff)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:42.398180 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684b73f-e4bf-4397-ad52-5a0938cb0941 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:42.420037 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da5547-1fa3-480f-99da-4d8401e56a42 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:42.421763 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-e3da5547-1fa3-480f-99da-4d8401e56a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:42.455265 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7684b73f-e4bf-4397-ad52-5a0938cb0941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94dd744e35d74359a31002fb0c7524ff'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:42.455889 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7684b73f-e4bf-4397-ad52-5a0938cb0941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94dd744e35d74359a31002fb0c7524ff'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:42.456944 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7684b73f-e4bf-4397-ad52-5a0938cb0941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94dd744e35d74359a31002fb0c7524ff'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:42.464477 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7684b73f-e4bf-4397-ad52-5a0938cb0941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94dd744e35d74359a31002fb0c7524ff'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:42.474019 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-7684b73f-e4bf-4397-ad52-5a0938cb0941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94dd744e35d74359a31002fb0c7524ff'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:42.484777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da5547-1fa3-480f-99da-4d8401e56a42 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:42.488540 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a965f2-9dfd-4548-acf6-78774a6055c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:42.489326 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a965f2-9dfd-4548-acf6-78774a6055c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:42.489669 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a965f2-9dfd-4548-acf6-78774a6055c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:42.489952 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a965f2-9dfd-4548-acf6-78774a6055c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:42.491813 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-14a965f2-9dfd-4548-acf6-78774a6055c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:42.493986 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1306/2607] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:42 2022] DELETE /identity/v3/users/94dd744e35d74359a31002fb0c7524ff => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:42.563779 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a965f2-9dfd-4548-acf6-78774a6055c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:42.565269 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a965f2-9dfd-4548-acf6-78774a6055c7 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:42.576607 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1302/2608] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:42 2022] GET /identity/v3/auth/tokens => generated 3466 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:42.946641 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684b73f-e4bf-4397-ad52-5a0938cb0941 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:42.948891 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-7684b73f-e4bf-4397-ad52-5a0938cb0941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:43.032672 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684b73f-e4bf-4397-ad52-5a0938cb0941 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:43.040453 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a011f64-6190-4e00-806f-b60678bb509c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:43.042050 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a011f64-6190-4e00-806f-b60678bb509c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:43.042339 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a011f64-6190-4e00-806f-b60678bb509c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:43.042617 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a011f64-6190-4e00-806f-b60678bb509c admin admin] PATH_INFO: `/v3/projects/2fb731fe215d4a4ba7c6f7b31b255760` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:43.045396 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a011f64-6190-4e00-806f-b60678bb509c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fb731fe215d4a4ba7c6f7b31b255760)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:43.048759 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a011f64-6190-4e00-806f-b60678bb509c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:43.115791 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9a011f64-6190-4e00-806f-b60678bb509c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb731fe215d4a4ba7c6f7b31b255760', 'request_id': 'req-9a011f64-6190-4e00-806f-b60678bb509c'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:43.124536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9a011f64-6190-4e00-806f-b60678bb509c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb731fe215d4a4ba7c6f7b31b255760', 'request_id': 'req-9a011f64-6190-4e00-806f-b60678bb509c'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:43.134869 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9a011f64-6190-4e00-806f-b60678bb509c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb731fe215d4a4ba7c6f7b31b255760', 'request_id': 'req-9a011f64-6190-4e00-806f-b60678bb509c'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:43.151584 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9a011f64-6190-4e00-806f-b60678bb509c admin admin] The token cache is being invalidate because project 2fb731fe215d4a4ba7c6f7b31b255760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:43.154758 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9a011f64-6190-4e00-806f-b60678bb509c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:43.155956 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9a011f64-6190-4e00-806f-b60678bb509c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:43.160030 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1307/2609] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:42 2022] DELETE /identity/v3/projects/2fb731fe215d4a4ba7c6f7b31b255760 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:43.166245 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b360a-59a4-4a0d-8126-5cbc2272e924 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:43.166644 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b360a-59a4-4a0d-8126-5cbc2272e924 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:43.166820 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b360a-59a4-4a0d-8126-5cbc2272e924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:43.186269 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-835b360a-59a4-4a0d-8126-5cbc2272e924 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:43.188287 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-835b360a-59a4-4a0d-8126-5cbc2272e924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:43.261945 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1303/2610] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:43 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:43.270992 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b1f51-febd-4404-91f2-bcbd0d49f32f None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:43.271274 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b1f51-febd-4404-91f2-bcbd0d49f32f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:43.271553 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b1f51-febd-4404-91f2-bcbd0d49f32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:43.292928 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-fb0b1f51-febd-4404-91f2-bcbd0d49f32f None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:43.294952 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-fb0b1f51-febd-4404-91f2-bcbd0d49f32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:43.307465 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1308/2611] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:43 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:43.308749 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b360a-59a4-4a0d-8126-5cbc2272e924 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:43.320329 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b360a-59a4-4a0d-8126-5cbc2272e924 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:43.329413 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4a120-24bb-478f-8f48-9f81f0c641de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:43.331643 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4a120-24bb-478f-8f48-9f81f0c641de admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:43.332135 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4a120-24bb-478f-8f48-9f81f0c641de admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:43.332685 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4a120-24bb-478f-8f48-9f81f0c641de admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:43.333636 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4a120-24bb-478f-8f48-9f81f0c641de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:04:43.333948 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4a120-24bb-478f-8f48-9f81f0c641de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:43.335915 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4a120-24bb-478f-8f48-9f81f0c641de admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:43.350642 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1304/2612] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:04:43.355177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b1f51-febd-4404-91f2-bcbd0d49f32f None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:43.366368 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b1f51-febd-4404-91f2-bcbd0d49f32f None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:43.372742 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61547d5-fce5-4669-b7b5-14f91f97c381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:43.373813 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61547d5-fce5-4669-b7b5-14f91f97c381 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:43.373936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61547d5-fce5-4669-b7b5-14f91f97c381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:43.374141 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61547d5-fce5-4669-b7b5-14f91f97c381 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:43.374812 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61547d5-fce5-4669-b7b5-14f91f97c381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:43.376826 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61547d5-fce5-4669-b7b5-14f91f97c381 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:43.415299 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1309/2613] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:43 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:04:43.416220 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4a120-24bb-478f-8f48-9f81f0c641de admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:43.431008 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4a120-24bb-478f-8f48-9f81f0c641de admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:43.510052 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096afe7-4d07-4287-aedf-412555a63d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:43.510998 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096afe7-4d07-4287-aedf-412555a63d69 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:43.511605 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096afe7-4d07-4287-aedf-412555a63d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:43.511974 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096afe7-4d07-4287-aedf-412555a63d69 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:43.513309 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096afe7-4d07-4287-aedf-412555a63d69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:43.515370 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096afe7-4d07-4287-aedf-412555a63d69 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:43.543512 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1305/2614] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:43 2022] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:04:43.551043 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61547d5-fce5-4669-b7b5-14f91f97c381 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:43.563536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61547d5-fce5-4669-b7b5-14f91f97c381 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:43.569297 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698be7c-5620-4587-bff0-0bcc0599e95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:43.569968 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698be7c-5620-4587-bff0-0bcc0599e95d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:43.570250 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698be7c-5620-4587-bff0-0bcc0599e95d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:43.570525 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698be7c-5620-4587-bff0-0bcc0599e95d admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:43.571248 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698be7c-5620-4587-bff0-0bcc0599e95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:43.573480 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698be7c-5620-4587-bff0-0bcc0599e95d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:43.586262 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1310/2615] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:43.590083 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096afe7-4d07-4287-aedf-412555a63d69 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:43.600865 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096afe7-4d07-4287-aedf-412555a63d69 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:43.607729 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56ede5-a630-4aa9-b1ba-26eb8513a87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:43.608557 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56ede5-a630-4aa9-b1ba-26eb8513a87d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:43.608894 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56ede5-a630-4aa9-b1ba-26eb8513a87d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:43.609239 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56ede5-a630-4aa9-b1ba-26eb8513a87d admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:43.610062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56ede5-a630-4aa9-b1ba-26eb8513a87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:43.611693 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56ede5-a630-4aa9-b1ba-26eb8513a87d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:43.623386 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1306/2616] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:43.627494 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698be7c-5620-4587-bff0-0bcc0599e95d admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:43.638678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698be7c-5620-4587-bff0-0bcc0599e95d admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:43.644054 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf79af-9c0e-40be-b464-add2ca0ecfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:43.645482 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf79af-9c0e-40be-b464-add2ca0ecfb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:43.645482 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf79af-9c0e-40be-b464-add2ca0ecfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:43.645482 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf79af-9c0e-40be-b464-add2ca0ecfb4 admin admin] PATH_INFO: `/v3/projects/633c979bfcca4708ab2a7e8574ac4333/users/498220999a444c488cb09b54a4326674/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:43.663083 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf79af-9c0e-40be-b464-add2ca0ecfb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=633c979bfcca4708ab2a7e8574ac4333, user_id=498220999a444c488cb09b54a4326674, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:43.665733 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf79af-9c0e-40be-b464-add2ca0ecfb4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:43.681117 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1311/2617] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:43 2022] PUT /identity/v3/projects/633c979bfcca4708ab2a7e8574ac4333/users/498220999a444c488cb09b54a4326674/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:04:43.692004 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8edab0-fda8-4ef0-be60-1f9096d675bd None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:43.692532 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8edab0-fda8-4ef0-be60-1f9096d675bd None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:43.692886 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8edab0-fda8-4ef0-be60-1f9096d675bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:43.737160 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-7a8edab0-fda8-4ef0-be60-1f9096d675bd None None] MFA Rules not processed for user `498220999a444c488cb09b54a4326674`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:43.738861 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-7a8edab0-fda8-4ef0-be60-1f9096d675bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:43.809862 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1307/2618] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:43 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:43.814577 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf79af-9c0e-40be-b464-add2ca0ecfb4 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:43.883703 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf79af-9c0e-40be-b464-add2ca0ecfb4 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:43.889639 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fd701-8954-4161-a52b-4c2aed725638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:43.890427 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fd701-8954-4161-a52b-4c2aed725638 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:43.890799 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fd701-8954-4161-a52b-4c2aed725638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:43.891164 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fd701-8954-4161-a52b-4c2aed725638 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:43.892038 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fd701-8954-4161-a52b-4c2aed725638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:43.894065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fd701-8954-4161-a52b-4c2aed725638 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:43.930159 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1312/2619] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:43 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:43.931754 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8edab0-fda8-4ef0-be60-1f9096d675bd None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:43.944642 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8edab0-fda8-4ef0-be60-1f9096d675bd None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:44.025315 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bc36b-fdef-4c2f-8364-439f25429816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:44.025896 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bc36b-fdef-4c2f-8364-439f25429816 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:44.026174 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bc36b-fdef-4c2f-8364-439f25429816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:44.026443 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bc36b-fdef-4c2f-8364-439f25429816 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:44.027122 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bc36b-fdef-4c2f-8364-439f25429816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:44.029494 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bc36b-fdef-4c2f-8364-439f25429816 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:44.062631 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1308/2620] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:43 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:44.067821 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fd701-8954-4161-a52b-4c2aed725638 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:44.080521 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fd701-8954-4161-a52b-4c2aed725638 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:44.085558 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b9cad-c432-4065-95e0-ccb68550cc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:44.086424 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b9cad-c432-4065-95e0-ccb68550cc70 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:44.087406 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b9cad-c432-4065-95e0-ccb68550cc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:44.087406 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b9cad-c432-4065-95e0-ccb68550cc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:44.087970 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b9cad-c432-4065-95e0-ccb68550cc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:44.089744 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b9cad-c432-4065-95e0-ccb68550cc70 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:44.103040 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1313/2621] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:04:44.108130 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bc36b-fdef-4c2f-8364-439f25429816 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:44.120034 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bc36b-fdef-4c2f-8364-439f25429816 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:44.127557 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a9c5e-d379-4374-acc0-9a1013be3984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:44.128260 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a9c5e-d379-4374-acc0-9a1013be3984 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:44.128727 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a9c5e-d379-4374-acc0-9a1013be3984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:44.128880 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a9c5e-d379-4374-acc0-9a1013be3984 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:44.129584 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a9c5e-d379-4374-acc0-9a1013be3984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:44.131304 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a9c5e-d379-4374-acc0-9a1013be3984 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:44.143597 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1309/2622] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:44.147460 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b9cad-c432-4065-95e0-ccb68550cc70 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:44.159051 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b9cad-c432-4065-95e0-ccb68550cc70 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:44.165586 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da854c4-7f9e-4c42-89b1-64085c42d438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:44.166489 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da854c4-7f9e-4c42-89b1-64085c42d438 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:44.167094 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da854c4-7f9e-4c42-89b1-64085c42d438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:44.168230 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da854c4-7f9e-4c42-89b1-64085c42d438 admin admin] PATH_INFO: `/v3/projects/ca9e513abf2b4365924384355a57cd3a/users/4b397f0014484ad3881e63095b6f3ff2/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:44.186899 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da854c4-7f9e-4c42-89b1-64085c42d438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9e513abf2b4365924384355a57cd3a, user_id=4b397f0014484ad3881e63095b6f3ff2, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:44.189831 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da854c4-7f9e-4c42-89b1-64085c42d438 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:44.205678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1314/2623] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:44 2022] PUT /identity/v3/projects/ca9e513abf2b4365924384355a57cd3a/users/4b397f0014484ad3881e63095b6f3ff2/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:04:44.216613 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b52f7-1fbc-4452-ad22-fc97d1ae7cc9 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:44.217138 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b52f7-1fbc-4452-ad22-fc97d1ae7cc9 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:44.217618 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b52f7-1fbc-4452-ad22-fc97d1ae7cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:44.251110 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-f21b52f7-1fbc-4452-ad22-fc97d1ae7cc9 None None] MFA Rules not processed for user `4b397f0014484ad3881e63095b6f3ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:44.252337 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-f21b52f7-1fbc-4452-ad22-fc97d1ae7cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:44.324592 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1310/2624] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:44 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:04:44.330062 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da854c4-7f9e-4c42-89b1-64085c42d438 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:44.392389 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da854c4-7f9e-4c42-89b1-64085c42d438 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:44.397416 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4635a-4182-428d-9e5d-2436852fb2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:44.398075 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4635a-4182-428d-9e5d-2436852fb2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:44.398356 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4635a-4182-428d-9e5d-2436852fb2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:44.399407 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4635a-4182-428d-9e5d-2436852fb2b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:44.399407 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4635a-4182-428d-9e5d-2436852fb2b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:44.401235 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4635a-4182-428d-9e5d-2436852fb2b2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:44.428748 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1315/2625] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:44 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:44.432882 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b52f7-1fbc-4452-ad22-fc97d1ae7cc9 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:44.444126 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b52f7-1fbc-4452-ad22-fc97d1ae7cc9 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:44.514073 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065aef9-f0c3-4fa3-86f2-f1f5919d200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:44.514941 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065aef9-f0c3-4fa3-86f2-f1f5919d200b admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:44.515245 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065aef9-f0c3-4fa3-86f2-f1f5919d200b admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:44.515522 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065aef9-f0c3-4fa3-86f2-f1f5919d200b admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:44.516219 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065aef9-f0c3-4fa3-86f2-f1f5919d200b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:44.518183 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065aef9-f0c3-4fa3-86f2-f1f5919d200b admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:44.545123 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1311/2626] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:44 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:04:44.551336 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4635a-4182-428d-9e5d-2436852fb2b2 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:44.562940 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4635a-4182-428d-9e5d-2436852fb2b2 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:44.567867 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a5101-129c-4eb5-8754-74f1e6b342c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:44.568527 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a5101-129c-4eb5-8754-74f1e6b342c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:44.568832 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a5101-129c-4eb5-8754-74f1e6b342c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:44.569112 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a5101-129c-4eb5-8754-74f1e6b342c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:44.569830 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a5101-129c-4eb5-8754-74f1e6b342c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:44.571429 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a5101-129c-4eb5-8754-74f1e6b342c9 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:44.582709 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1316/2627] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:44.586973 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065aef9-f0c3-4fa3-86f2-f1f5919d200b admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:44.597292 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065aef9-f0c3-4fa3-86f2-f1f5919d200b admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:44.602172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bf2c9-421c-49d9-9b27-01ae4829e5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:44.603135 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bf2c9-421c-49d9-9b27-01ae4829e5c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:44.603584 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bf2c9-421c-49d9-9b27-01ae4829e5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:44.604130 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bf2c9-421c-49d9-9b27-01ae4829e5c8 admin admin] PATH_INFO: `/v3/projects/ea37ed5c38b14af487c23d43afc7fe91/users/a4ed9d42d60a4ccba250a861e2fa6889/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:44.620283 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bf2c9-421c-49d9-9b27-01ae4829e5c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea37ed5c38b14af487c23d43afc7fe91, user_id=a4ed9d42d60a4ccba250a861e2fa6889, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:44.623483 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bf2c9-421c-49d9-9b27-01ae4829e5c8 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:44.639027 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1312/2628] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:44 2022] PUT /identity/v3/projects/ea37ed5c38b14af487c23d43afc7fe91/users/a4ed9d42d60a4ccba250a861e2fa6889/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:44.642904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a5101-129c-4eb5-8754-74f1e6b342c9 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:44.654238 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a5101-129c-4eb5-8754-74f1e6b342c9 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:44.712616 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e06a7-9014-493e-993d-0ba6a0d70cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:44.713317 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e06a7-9014-493e-993d-0ba6a0d70cfc admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:44.713600 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e06a7-9014-493e-993d-0ba6a0d70cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:44.713871 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e06a7-9014-493e-993d-0ba6a0d70cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:44.714590 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e06a7-9014-493e-993d-0ba6a0d70cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:44.716296 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e06a7-9014-493e-993d-0ba6a0d70cfc admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:44.727691 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1317/2629] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:44.732555 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bf2c9-421c-49d9-9b27-01ae4829e5c8 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:44.744394 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bf2c9-421c-49d9-9b27-01ae4829e5c8 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:44.757371 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82f226-0f78-4990-b467-449711f1eaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:44.758532 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f226-0f78-4990-b467-449711f1eaa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:44.759084 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f226-0f78-4990-b467-449711f1eaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:44.759365 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f226-0f78-4990-b467-449711f1eaa4 admin admin] PATH_INFO: `/v3/projects/ea37ed5c38b14af487c23d43afc7fe91/users/a4ed9d42d60a4ccba250a861e2fa6889/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:44.761947 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82f226-0f78-4990-b467-449711f1eaa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea37ed5c38b14af487c23d43afc7fe91, user_id=a4ed9d42d60a4ccba250a861e2fa6889, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:44.766230 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82f226-0f78-4990-b467-449711f1eaa4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:44.784042 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1313/2630] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:44 2022] PUT /identity/v3/projects/ea37ed5c38b14af487c23d43afc7fe91/users/a4ed9d42d60a4ccba250a861e2fa6889/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:44.789702 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d000-b25c-4074-97ed-067a4d6ceb56 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:44.789987 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d000-b25c-4074-97ed-067a4d6ceb56 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:44.790260 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d000-b25c-4074-97ed-067a4d6ceb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:44.819471 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-b413d000-b25c-4074-97ed-067a4d6ceb56 None None] MFA Rules not processed for user `a4ed9d42d60a4ccba250a861e2fa6889`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:44.820941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b413d000-b25c-4074-97ed-067a4d6ceb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:44.893056 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1318/2631] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:44 2022] POST /identity/v3/auth/tokens => generated 3464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:44.903747 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82f226-0f78-4990-b467-449711f1eaa4 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:44.905601 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1d82f226-0f78-4990-b467-449711f1eaa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:44.962062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82f226-0f78-4990-b467-449711f1eaa4 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:44.965923 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e964b-66ae-47cc-9803-42d710064dc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:44.966598 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e964b-66ae-47cc-9803-42d710064dc0 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:44.966878 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e964b-66ae-47cc-9803-42d710064dc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:44.967153 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e964b-66ae-47cc-9803-42d710064dc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:44.976712 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e964b-66ae-47cc-9803-42d710064dc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:44.978176 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e964b-66ae-47cc-9803-42d710064dc0 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:44.989312 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1314/2632] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:44 2022] GET /identity/v3/auth/tokens => generated 3464 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:45.030394 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413d000-b25c-4074-97ed-067a4d6ceb56 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:45.031966 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b413d000-b25c-4074-97ed-067a4d6ceb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:45.044472 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413d000-b25c-4074-97ed-067a4d6ceb56 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:45.048075 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360065c0-f6c1-4e8e-8834-7d6df2a90315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:45.048709 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360065c0-f6c1-4e8e-8834-7d6df2a90315 service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:45.049227 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360065c0-f6c1-4e8e-8834-7d6df2a90315 service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:45.049785 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360065c0-f6c1-4e8e-8834-7d6df2a90315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:45.111824 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360065c0-f6c1-4e8e-8834-7d6df2a90315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:45.113500 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360065c0-f6c1-4e8e-8834-7d6df2a90315 service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:45.124062 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1319/2633] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:45 2022] GET /identity/v3/auth/tokens => generated 3399 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:48.062921 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e964b-66ae-47cc-9803-42d710064dc0 service cinder] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:48.121938 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e964b-66ae-47cc-9803-42d710064dc0 service cinder] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:48.126737 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c6c45-080a-4708-81b0-84f6b56bb9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:48.127602 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c6c45-080a-4708-81b0-84f6b56bb9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:48.127880 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c6c45-080a-4708-81b0-84f6b56bb9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:48.128150 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c6c45-080a-4708-81b0-84f6b56bb9c3 admin admin] PATH_INFO: `/v3/users/498220999a444c488cb09b54a4326674` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:48.129354 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c6c45-080a-4708-81b0-84f6b56bb9c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=498220999a444c488cb09b54a4326674)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:48.131252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c6c45-080a-4708-81b0-84f6b56bb9c3 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:48.177004 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-d18c6c45-080a-4708-81b0-84f6b56bb9c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '498220999a444c488cb09b54a4326674'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.177644 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-d18c6c45-080a-4708-81b0-84f6b56bb9c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '498220999a444c488cb09b54a4326674'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.184127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-d18c6c45-080a-4708-81b0-84f6b56bb9c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '498220999a444c488cb09b54a4326674'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.192159 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-d18c6c45-080a-4708-81b0-84f6b56bb9c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '498220999a444c488cb09b54a4326674'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.204853 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-d18c6c45-080a-4708-81b0-84f6b56bb9c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '498220999a444c488cb09b54a4326674'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.210539 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1315/2634] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:48 2022] DELETE /identity/v3/users/498220999a444c488cb09b54a4326674 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:48.216196 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63b113-9bd6-49ac-9271-31c7e9256e6c None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:48.216813 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63b113-9bd6-49ac-9271-31c7e9256e6c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:48.217194 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63b113-9bd6-49ac-9271-31c7e9256e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:48.234337 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-2b63b113-9bd6-49ac-9271-31c7e9256e6c None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:48.235464 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-2b63b113-9bd6-49ac-9271-31c7e9256e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:48.296510 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1320/2635] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:48.306735 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c6c45-080a-4708-81b0-84f6b56bb9c3 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:48.308153 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-d18c6c45-080a-4708-81b0-84f6b56bb9c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:48.369246 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c6c45-080a-4708-81b0-84f6b56bb9c3 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:48.373922 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56365825-74bf-4317-8d16-82858c9955fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:48.374428 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56365825-74bf-4317-8d16-82858c9955fc service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:48.374707 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56365825-74bf-4317-8d16-82858c9955fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:48.374983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56365825-74bf-4317-8d16-82858c9955fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:48.384481 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56365825-74bf-4317-8d16-82858c9955fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:48.385982 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56365825-74bf-4317-8d16-82858c9955fc service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:48.397055 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1316/2636] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:48 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:48.694188 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63b113-9bd6-49ac-9271-31c7e9256e6c None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:48.696121 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-2b63b113-9bd6-49ac-9271-31c7e9256e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:48.719398 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63b113-9bd6-49ac-9271-31c7e9256e6c None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:48.725072 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a69fc2-1ed4-4360-89b7-7ec2fa699a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:48.725942 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a69fc2-1ed4-4360-89b7-7ec2fa699a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:48.726759 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a69fc2-1ed4-4360-89b7-7ec2fa699a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:48.726759 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a69fc2-1ed4-4360-89b7-7ec2fa699a95 admin admin] PATH_INFO: `/v3/projects/633c979bfcca4708ab2a7e8574ac4333` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:48.727714 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a69fc2-1ed4-4360-89b7-7ec2fa699a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=633c979bfcca4708ab2a7e8574ac4333)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:48.729804 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a69fc2-1ed4-4360-89b7-7ec2fa699a95 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:48.777708 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56365825-74bf-4317-8d16-82858c9955fc service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:48.786695 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56365825-74bf-4317-8d16-82858c9955fc service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:48.791516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-01a69fc2-1ed4-4360-89b7-7ec2fa699a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633c979bfcca4708ab2a7e8574ac4333', 'request_id': 'req-01a69fc2-1ed4-4360-89b7-7ec2fa699a95'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.798497 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-01a69fc2-1ed4-4360-89b7-7ec2fa699a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633c979bfcca4708ab2a7e8574ac4333', 'request_id': 'req-01a69fc2-1ed4-4360-89b7-7ec2fa699a95'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.803999 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-01a69fc2-1ed4-4360-89b7-7ec2fa699a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633c979bfcca4708ab2a7e8574ac4333', 'request_id': 'req-01a69fc2-1ed4-4360-89b7-7ec2fa699a95'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.817861 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-01a69fc2-1ed4-4360-89b7-7ec2fa699a95 admin admin] The token cache is being invalidate because project 633c979bfcca4708ab2a7e8574ac4333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:48.818248 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-01a69fc2-1ed4-4360-89b7-7ec2fa699a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.818871 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-01a69fc2-1ed4-4360-89b7-7ec2fa699a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.820809 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1321/2637] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:48 2022] DELETE /identity/v3/projects/633c979bfcca4708ab2a7e8574ac4333 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:48.824997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a69fc2-1ed4-4360-89b7-7ec2fa699a95 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:48.826674 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-01a69fc2-1ed4-4360-89b7-7ec2fa699a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:48.840865 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ab65c-7a41-48eb-8557-a1c8315f36a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:48.841618 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ab65c-7a41-48eb-8557-a1c8315f36a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:48.841898 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ab65c-7a41-48eb-8557-a1c8315f36a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:48.842172 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ab65c-7a41-48eb-8557-a1c8315f36a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:48.843928 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-893ab65c-7a41-48eb-8557-a1c8315f36a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:48.890256 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a69fc2-1ed4-4360-89b7-7ec2fa699a95 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:48.895363 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0703a-89e9-4bcd-92f7-09d8ee76ff46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:48.896328 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0703a-89e9-4bcd-92f7-09d8ee76ff46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:48.896611 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0703a-89e9-4bcd-92f7-09d8ee76ff46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:48.896914 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0703a-89e9-4bcd-92f7-09d8ee76ff46 admin admin] PATH_INFO: `/v3/users/4b397f0014484ad3881e63095b6f3ff2` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:48.898095 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0703a-89e9-4bcd-92f7-09d8ee76ff46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b397f0014484ad3881e63095b6f3ff2)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:48.900023 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0703a-89e9-4bcd-92f7-09d8ee76ff46 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:48.905252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ab65c-7a41-48eb-8557-a1c8315f36a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:48.906716 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ab65c-7a41-48eb-8557-a1c8315f36a7 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:48.916502 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1317/2638] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:48 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:04:48.946608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-60c0703a-89e9-4bcd-92f7-09d8ee76ff46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b397f0014484ad3881e63095b6f3ff2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.947363 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-60c0703a-89e9-4bcd-92f7-09d8ee76ff46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b397f0014484ad3881e63095b6f3ff2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.948043 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-60c0703a-89e9-4bcd-92f7-09d8ee76ff46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b397f0014484ad3881e63095b6f3ff2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.956213 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-60c0703a-89e9-4bcd-92f7-09d8ee76ff46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b397f0014484ad3881e63095b6f3ff2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.963125 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-60c0703a-89e9-4bcd-92f7-09d8ee76ff46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b397f0014484ad3881e63095b6f3ff2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:48.980007 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1322/2639] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:48 2022] DELETE /identity/v3/users/4b397f0014484ad3881e63095b6f3ff2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:04:49.345266 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ab65c-7a41-48eb-8557-a1c8315f36a7 service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:49.355208 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ab65c-7a41-48eb-8557-a1c8315f36a7 service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:49.425521 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72ba00-616b-4f17-a74c-d24aff05db0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:49.426737 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72ba00-616b-4f17-a74c-d24aff05db0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:49.427014 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72ba00-616b-4f17-a74c-d24aff05db0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:49.427301 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72ba00-616b-4f17-a74c-d24aff05db0d admin admin] PATH_INFO: `/v3/projects/ca9e513abf2b4365924384355a57cd3a` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:49.428544 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72ba00-616b-4f17-a74c-d24aff05db0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca9e513abf2b4365924384355a57cd3a)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:49.430666 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72ba00-616b-4f17-a74c-d24aff05db0d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:49.487941 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1d72ba00-616b-4f17-a74c-d24aff05db0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca9e513abf2b4365924384355a57cd3a', 'request_id': 'req-1d72ba00-616b-4f17-a74c-d24aff05db0d'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:49.495409 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1d72ba00-616b-4f17-a74c-d24aff05db0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca9e513abf2b4365924384355a57cd3a', 'request_id': 'req-1d72ba00-616b-4f17-a74c-d24aff05db0d'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:49.501868 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1d72ba00-616b-4f17-a74c-d24aff05db0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca9e513abf2b4365924384355a57cd3a', 'request_id': 'req-1d72ba00-616b-4f17-a74c-d24aff05db0d'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:49.516242 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1d72ba00-616b-4f17-a74c-d24aff05db0d admin admin] The token cache is being invalidate because project ca9e513abf2b4365924384355a57cd3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:49.516530 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1d72ba00-616b-4f17-a74c-d24aff05db0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:49.517256 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-1d72ba00-616b-4f17-a74c-d24aff05db0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:49.518830 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1318/2640] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:49 2022] DELETE /identity/v3/projects/ca9e513abf2b4365924384355a57cd3a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:49.523229 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0703a-89e9-4bcd-92f7-09d8ee76ff46 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:49.524723 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-60c0703a-89e9-4bcd-92f7-09d8ee76ff46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:49.540213 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0703a-89e9-4bcd-92f7-09d8ee76ff46 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:49.610536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ab961-88f5-4219-a2f3-f00e857decb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:49.611760 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ab961-88f5-4219-a2f3-f00e857decb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:49.611995 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ab961-88f5-4219-a2f3-f00e857decb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:49.612128 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ab961-88f5-4219-a2f3-f00e857decb0 admin admin] PATH_INFO: `/v3/users/a4ed9d42d60a4ccba250a861e2fa6889` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:49.613717 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ab961-88f5-4219-a2f3-f00e857decb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ed9d42d60a4ccba250a861e2fa6889)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:49.615501 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ab961-88f5-4219-a2f3-f00e857decb0 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:49.669080 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-389ab961-88f5-4219-a2f3-f00e857decb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ed9d42d60a4ccba250a861e2fa6889'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:49.669997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-389ab961-88f5-4219-a2f3-f00e857decb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ed9d42d60a4ccba250a861e2fa6889'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:49.670613 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-389ab961-88f5-4219-a2f3-f00e857decb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ed9d42d60a4ccba250a861e2fa6889'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:49.679180 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-389ab961-88f5-4219-a2f3-f00e857decb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ed9d42d60a4ccba250a861e2fa6889'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:49.687302 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-389ab961-88f5-4219-a2f3-f00e857decb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ed9d42d60a4ccba250a861e2fa6889'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:49.706510 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1323/2641] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:49 2022] DELETE /identity/v3/users/a4ed9d42d60a4ccba250a861e2fa6889 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:50.003429 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72ba00-616b-4f17-a74c-d24aff05db0d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:50.005149 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1d72ba00-616b-4f17-a74c-d24aff05db0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:50.018895 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72ba00-616b-4f17-a74c-d24aff05db0d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:50.089553 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1594a93-6072-4ef6-968f-40759aec3052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:50.090337 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1594a93-6072-4ef6-968f-40759aec3052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:50.091162 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1594a93-6072-4ef6-968f-40759aec3052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:50.091451 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1594a93-6072-4ef6-968f-40759aec3052 admin admin] PATH_INFO: `/v3/projects/ea37ed5c38b14af487c23d43afc7fe91` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:50.092706 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1594a93-6072-4ef6-968f-40759aec3052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea37ed5c38b14af487c23d43afc7fe91)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:50.094653 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1594a93-6072-4ef6-968f-40759aec3052 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:50.143429 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e1594a93-6072-4ef6-968f-40759aec3052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea37ed5c38b14af487c23d43afc7fe91', 'request_id': 'req-e1594a93-6072-4ef6-968f-40759aec3052'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:50.149506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e1594a93-6072-4ef6-968f-40759aec3052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea37ed5c38b14af487c23d43afc7fe91', 'request_id': 'req-e1594a93-6072-4ef6-968f-40759aec3052'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:50.156592 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e1594a93-6072-4ef6-968f-40759aec3052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea37ed5c38b14af487c23d43afc7fe91', 'request_id': 'req-e1594a93-6072-4ef6-968f-40759aec3052'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:50.169552 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e1594a93-6072-4ef6-968f-40759aec3052 admin admin] The token cache is being invalidate because project ea37ed5c38b14af487c23d43afc7fe91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:50.169939 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e1594a93-6072-4ef6-968f-40759aec3052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:50.170467 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e1594a93-6072-4ef6-968f-40759aec3052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:50.172044 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1319/2642] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:50 2022] DELETE /identity/v3/projects/ea37ed5c38b14af487c23d43afc7fe91 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:50.179330 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6e800-6fc9-41f9-99d5-9d16bdb821e3 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:50.179728 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6e800-6fc9-41f9-99d5-9d16bdb821e3 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:50.180065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6e800-6fc9-41f9-99d5-9d16bdb821e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:50.206762 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-86a6e800-6fc9-41f9-99d5-9d16bdb821e3 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:50.208012 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-86a6e800-6fc9-41f9-99d5-9d16bdb821e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:50.284913 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1324/2643] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:50 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:50.286727 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea5b0c-a1cf-4113-800c-52d92e5f1488 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:50.287012 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea5b0c-a1cf-4113-800c-52d92e5f1488 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:50.287289 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea5b0c-a1cf-4113-800c-52d92e5f1488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:50.307905 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-a6ea5b0c-a1cf-4113-800c-52d92e5f1488 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:50.309193 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-a6ea5b0c-a1cf-4113-800c-52d92e5f1488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:50.317252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1320/2644] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:50 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:50.321692 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6e800-6fc9-41f9-99d5-9d16bdb821e3 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:50.333072 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6e800-6fc9-41f9-99d5-9d16bdb821e3 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:50.338006 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512980d9-4eb8-470b-b899-7da43515b72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:50.338790 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512980d9-4eb8-470b-b899-7da43515b72a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:50.339132 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512980d9-4eb8-470b-b899-7da43515b72a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:50.339464 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512980d9-4eb8-470b-b899-7da43515b72a admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:50.340307 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512980d9-4eb8-470b-b899-7da43515b72a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:04:50.341420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512980d9-4eb8-470b-b899-7da43515b72a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:50.343175 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512980d9-4eb8-470b-b899-7da43515b72a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:50.356028 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1325/2645] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:04:50.360310 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea5b0c-a1cf-4113-800c-52d92e5f1488 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:50.375064 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea5b0c-a1cf-4113-800c-52d92e5f1488 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:50.379904 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da9e17-7e04-4074-91fc-4628eb9652b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:50.380564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da9e17-7e04-4074-91fc-4628eb9652b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:50.380878 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da9e17-7e04-4074-91fc-4628eb9652b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:50.381156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da9e17-7e04-4074-91fc-4628eb9652b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:50.381846 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da9e17-7e04-4074-91fc-4628eb9652b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:50.383732 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da9e17-7e04-4074-91fc-4628eb9652b9 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:50.413679 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1321/2646] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:50 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:50.417803 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512980d9-4eb8-470b-b899-7da43515b72a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:50.432851 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512980d9-4eb8-470b-b899-7da43515b72a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:50.504465 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f6c5d-68e6-4adc-bd33-c2d019ecc80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:50.505191 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f6c5d-68e6-4adc-bd33-c2d019ecc80e admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:50.505447 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f6c5d-68e6-4adc-bd33-c2d019ecc80e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:50.505722 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f6c5d-68e6-4adc-bd33-c2d019ecc80e admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:50.506418 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f6c5d-68e6-4adc-bd33-c2d019ecc80e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:50.508306 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f6c5d-68e6-4adc-bd33-c2d019ecc80e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:50.531327 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1326/2647] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:50 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:50.535745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da9e17-7e04-4074-91fc-4628eb9652b9 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:50.546416 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da9e17-7e04-4074-91fc-4628eb9652b9 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:50.551529 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563071a-3806-4d45-b1f2-f2efc989032f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:50.552210 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563071a-3806-4d45-b1f2-f2efc989032f admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:50.552492 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563071a-3806-4d45-b1f2-f2efc989032f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:50.552771 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563071a-3806-4d45-b1f2-f2efc989032f admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:50.553553 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563071a-3806-4d45-b1f2-f2efc989032f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:50.555216 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563071a-3806-4d45-b1f2-f2efc989032f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:50.567145 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1322/2648] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:50.571249 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f6c5d-68e6-4adc-bd33-c2d019ecc80e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:50.582430 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f6c5d-68e6-4adc-bd33-c2d019ecc80e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:50.587491 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2cae5-1571-4585-926b-75f1d0f92b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:50.588162 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2cae5-1571-4585-926b-75f1d0f92b51 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:50.588441 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2cae5-1571-4585-926b-75f1d0f92b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:50.588713 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2cae5-1571-4585-926b-75f1d0f92b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:50.589469 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2cae5-1571-4585-926b-75f1d0f92b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:50.591629 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2cae5-1571-4585-926b-75f1d0f92b51 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:50.604773 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1327/2649] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:50.606288 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563071a-3806-4d45-b1f2-f2efc989032f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:50.617786 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563071a-3806-4d45-b1f2-f2efc989032f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:50.623075 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b883ba-cfdb-4d48-9311-5edeef89fb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:50.624063 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b883ba-cfdb-4d48-9311-5edeef89fb61 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:50.624344 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b883ba-cfdb-4d48-9311-5edeef89fb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:50.624614 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b883ba-cfdb-4d48-9311-5edeef89fb61 admin admin] PATH_INFO: `/v3/projects/0b580db2491140cb8c08cbaa71fbba63/users/37ea0db8a75d4f899d53a71ef7223a88/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:50.640258 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b883ba-cfdb-4d48-9311-5edeef89fb61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b580db2491140cb8c08cbaa71fbba63, user_id=37ea0db8a75d4f899d53a71ef7223a88, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:50.642895 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b883ba-cfdb-4d48-9311-5edeef89fb61 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:50.657260 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1323/2650] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:50 2022] PUT /identity/v3/projects/0b580db2491140cb8c08cbaa71fbba63/users/37ea0db8a75d4f899d53a71ef7223a88/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:50.670245 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b2b91-be2b-4113-aa7d-2012cbfc32d9 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:50.670528 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b2b91-be2b-4113-aa7d-2012cbfc32d9 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:50.670804 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b2b91-be2b-4113-aa7d-2012cbfc32d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:50.698992 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-942b2b91-be2b-4113-aa7d-2012cbfc32d9 None None] MFA Rules not processed for user `37ea0db8a75d4f899d53a71ef7223a88`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:50.701064 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-942b2b91-be2b-4113-aa7d-2012cbfc32d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:50.782164 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1328/2651] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:50 2022] POST /identity/v3/auth/tokens => generated 3401 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:50.787106 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b883ba-cfdb-4d48-9311-5edeef89fb61 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:50.896444 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b883ba-cfdb-4d48-9311-5edeef89fb61 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:50.902582 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce71751-3cec-4383-99dc-84b800fab4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:50.903592 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce71751-3cec-4383-99dc-84b800fab4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:50.904423 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce71751-3cec-4383-99dc-84b800fab4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:50.904906 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce71751-3cec-4383-99dc-84b800fab4f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:50.905830 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce71751-3cec-4383-99dc-84b800fab4f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:50.907878 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce71751-3cec-4383-99dc-84b800fab4f1 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:50.949024 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1324/2652] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:50 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:04:50.953474 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b2b91-be2b-4113-aa7d-2012cbfc32d9 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:50.966683 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b2b91-be2b-4113-aa7d-2012cbfc32d9 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:51.038012 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68446662-7bd4-4e7a-a3f4-cb7f67c38157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:51.038697 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68446662-7bd4-4e7a-a3f4-cb7f67c38157 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:51.038975 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68446662-7bd4-4e7a-a3f4-cb7f67c38157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:51.039248 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68446662-7bd4-4e7a-a3f4-cb7f67c38157 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:51.040040 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68446662-7bd4-4e7a-a3f4-cb7f67c38157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:51.041896 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68446662-7bd4-4e7a-a3f4-cb7f67c38157 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:51.065477 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1329/2653] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:50 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:04:51.069284 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce71751-3cec-4383-99dc-84b800fab4f1 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:51.080910 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce71751-3cec-4383-99dc-84b800fab4f1 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:51.086079 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88dd45-3557-407c-b882-24e623db7622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:51.087478 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88dd45-3557-407c-b882-24e623db7622 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:51.087478 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88dd45-3557-407c-b882-24e623db7622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:51.087478 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88dd45-3557-407c-b882-24e623db7622 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:51.088223 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88dd45-3557-407c-b882-24e623db7622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:51.090064 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88dd45-3557-407c-b882-24e623db7622 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:51.110183 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1325/2654] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:04:51.111808 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68446662-7bd4-4e7a-a3f4-cb7f67c38157 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:51.125033 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68446662-7bd4-4e7a-a3f4-cb7f67c38157 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:51.130258 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33aac6-0adf-4d1a-a5d0-948f6ca2cc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:51.131422 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33aac6-0adf-4d1a-a5d0-948f6ca2cc32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:51.131739 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33aac6-0adf-4d1a-a5d0-948f6ca2cc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:51.132085 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33aac6-0adf-4d1a-a5d0-948f6ca2cc32 admin admin] PATH_INFO: `/v3/projects/40736701ea93446b97eedbd3bda505a0/users/02b8e1fafc53431995ff53b63befed48/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:51.150407 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33aac6-0adf-4d1a-a5d0-948f6ca2cc32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40736701ea93446b97eedbd3bda505a0, user_id=02b8e1fafc53431995ff53b63befed48, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:51.154685 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33aac6-0adf-4d1a-a5d0-948f6ca2cc32 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:51.171085 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1330/2655] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:51 2022] PUT /identity/v3/projects/40736701ea93446b97eedbd3bda505a0/users/02b8e1fafc53431995ff53b63befed48/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:51.175114 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88dd45-3557-407c-b882-24e623db7622 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:51.186867 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88dd45-3557-407c-b882-24e623db7622 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:51.254593 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff448b3-bfdb-4c22-a23d-defaee4d3553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:51.255742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff448b3-bfdb-4c22-a23d-defaee4d3553 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:51.256022 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff448b3-bfdb-4c22-a23d-defaee4d3553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:51.256321 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff448b3-bfdb-4c22-a23d-defaee4d3553 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:51.257656 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff448b3-bfdb-4c22-a23d-defaee4d3553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:51.259384 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff448b3-bfdb-4c22-a23d-defaee4d3553 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:51.278956 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1326/2656] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:04:51.284246 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33aac6-0adf-4d1a-a5d0-948f6ca2cc32 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:51.298013 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33aac6-0adf-4d1a-a5d0-948f6ca2cc32 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:51.303392 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19d10d-706f-4d44-aee2-2eaff535b189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:51.304297 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19d10d-706f-4d44-aee2-2eaff535b189 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:51.304576 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19d10d-706f-4d44-aee2-2eaff535b189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:51.304914 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19d10d-706f-4d44-aee2-2eaff535b189 admin admin] PATH_INFO: `/v3/projects/40736701ea93446b97eedbd3bda505a0/users/02b8e1fafc53431995ff53b63befed48/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:51.308164 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19d10d-706f-4d44-aee2-2eaff535b189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40736701ea93446b97eedbd3bda505a0, user_id=02b8e1fafc53431995ff53b63befed48, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:51.313522 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19d10d-706f-4d44-aee2-2eaff535b189 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:51.331829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1331/2657] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:51 2022] PUT /identity/v3/projects/40736701ea93446b97eedbd3bda505a0/users/02b8e1fafc53431995ff53b63befed48/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:51.344159 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7191ec-684b-49f1-80e9-de57670fb0f5 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:51.349375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7191ec-684b-49f1-80e9-de57670fb0f5 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:51.351164 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7191ec-684b-49f1-80e9-de57670fb0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:51.383868 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-3f7191ec-684b-49f1-80e9-de57670fb0f5 None None] MFA Rules not processed for user `02b8e1fafc53431995ff53b63befed48`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:51.385158 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-3f7191ec-684b-49f1-80e9-de57670fb0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:51.466886 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1327/2658] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:51 2022] POST /identity/v3/auth/tokens => generated 3470 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:51.478693 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19d10d-706f-4d44-aee2-2eaff535b189 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:51.480529 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-fe19d10d-706f-4d44-aee2-2eaff535b189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:51.559389 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19d10d-706f-4d44-aee2-2eaff535b189 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:51.564113 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039558d9-c360-48c5-a429-74d8f96dcbea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:51.564946 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039558d9-c360-48c5-a429-74d8f96dcbea service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:51.565328 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039558d9-c360-48c5-a429-74d8f96dcbea service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:51.565735 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039558d9-c360-48c5-a429-74d8f96dcbea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:51.577157 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039558d9-c360-48c5-a429-74d8f96dcbea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:51.579439 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039558d9-c360-48c5-a429-74d8f96dcbea service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:51.595684 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1332/2659] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:51 2022] GET /identity/v3/auth/tokens => generated 3470 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:51.674664 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7191ec-684b-49f1-80e9-de57670fb0f5 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:51.686520 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7191ec-684b-49f1-80e9-de57670fb0f5 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:51.690863 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed855f04-655d-4d37-aadb-244ff98d1979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:51.691731 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed855f04-655d-4d37-aadb-244ff98d1979 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:51.692036 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed855f04-655d-4d37-aadb-244ff98d1979 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:51.692379 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed855f04-655d-4d37-aadb-244ff98d1979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:51.763624 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed855f04-655d-4d37-aadb-244ff98d1979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:51.765265 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed855f04-655d-4d37-aadb-244ff98d1979 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:51.775619 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1328/2660] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:51 2022] GET /identity/v3/auth/tokens => generated 3401 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:52.076968 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039558d9-c360-48c5-a429-74d8f96dcbea service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:52.171664 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039558d9-c360-48c5-a429-74d8f96dcbea service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:52.182221 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3079bd9-bb37-402c-901d-89d634f6adfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:52.183126 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3079bd9-bb37-402c-901d-89d634f6adfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:52.183476 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3079bd9-bb37-402c-901d-89d634f6adfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:52.183670 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3079bd9-bb37-402c-901d-89d634f6adfc admin admin] PATH_INFO: `/v3/users/37ea0db8a75d4f899d53a71ef7223a88` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:52.185694 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3079bd9-bb37-402c-901d-89d634f6adfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ea0db8a75d4f899d53a71ef7223a88)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:52.187761 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3079bd9-bb37-402c-901d-89d634f6adfc admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:52.252074 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c3079bd9-bb37-402c-901d-89d634f6adfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ea0db8a75d4f899d53a71ef7223a88'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:52.252980 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c3079bd9-bb37-402c-901d-89d634f6adfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ea0db8a75d4f899d53a71ef7223a88'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:52.253676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c3079bd9-bb37-402c-901d-89d634f6adfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ea0db8a75d4f899d53a71ef7223a88'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:52.263969 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c3079bd9-bb37-402c-901d-89d634f6adfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ea0db8a75d4f899d53a71ef7223a88'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:52.272956 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-c3079bd9-bb37-402c-901d-89d634f6adfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ea0db8a75d4f899d53a71ef7223a88'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:52.301154 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1333/2661] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:52 2022] DELETE /identity/v3/users/37ea0db8a75d4f899d53a71ef7223a88 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:52.305798 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d9d6d-913c-4cb6-818a-6ade88bd885d None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:52.306029 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d9d6d-913c-4cb6-818a-6ade88bd885d None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:52.306294 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d9d6d-913c-4cb6-818a-6ade88bd885d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:52.323738 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-b56d9d6d-913c-4cb6-818a-6ade88bd885d None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:52.325549 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b56d9d6d-913c-4cb6-818a-6ade88bd885d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:52.395137 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1329/2662] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:52 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:04:52.406217 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3079bd9-bb37-402c-901d-89d634f6adfc admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:52.409999 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-c3079bd9-bb37-402c-901d-89d634f6adfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:52.496028 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3079bd9-bb37-402c-901d-89d634f6adfc admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:52.507327 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e35ed-1a07-4936-94c6-7c3cb7746f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:52.508166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e35ed-1a07-4936-94c6-7c3cb7746f2c service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:52.508547 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e35ed-1a07-4936-94c6-7c3cb7746f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:52.508979 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e35ed-1a07-4936-94c6-7c3cb7746f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:52.524617 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e35ed-1a07-4936-94c6-7c3cb7746f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:52.530025 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e35ed-1a07-4936-94c6-7c3cb7746f2c service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:52.565846 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1334/2663] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:52 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:52.955100 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d9d6d-913c-4cb6-818a-6ade88bd885d None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:52.956634 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b56d9d6d-913c-4cb6-818a-6ade88bd885d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:52.971636 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d9d6d-913c-4cb6-818a-6ade88bd885d None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:52.979048 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189add0-62a6-4bf6-a920-b90bb00ff6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:52.979907 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189add0-62a6-4bf6-a920-b90bb00ff6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:52.980185 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189add0-62a6-4bf6-a920-b90bb00ff6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:52.980456 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189add0-62a6-4bf6-a920-b90bb00ff6cc admin admin] PATH_INFO: `/v3/projects/0b580db2491140cb8c08cbaa71fbba63` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:52.983416 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189add0-62a6-4bf6-a920-b90bb00ff6cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b580db2491140cb8c08cbaa71fbba63)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:52.985394 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189add0-62a6-4bf6-a920-b90bb00ff6cc admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:53.043108 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-2189add0-62a6-4bf6-a920-b90bb00ff6cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b580db2491140cb8c08cbaa71fbba63', 'request_id': 'req-2189add0-62a6-4bf6-a920-b90bb00ff6cc'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.050835 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-2189add0-62a6-4bf6-a920-b90bb00ff6cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b580db2491140cb8c08cbaa71fbba63', 'request_id': 'req-2189add0-62a6-4bf6-a920-b90bb00ff6cc'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.056876 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-2189add0-62a6-4bf6-a920-b90bb00ff6cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b580db2491140cb8c08cbaa71fbba63', 'request_id': 'req-2189add0-62a6-4bf6-a920-b90bb00ff6cc'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.071393 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-2189add0-62a6-4bf6-a920-b90bb00ff6cc admin admin] The token cache is being invalidate because project 0b580db2491140cb8c08cbaa71fbba63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:53.071668 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-2189add0-62a6-4bf6-a920-b90bb00ff6cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.072338 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-2189add0-62a6-4bf6-a920-b90bb00ff6cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.073961 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1330/2664] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:52 2022] DELETE /identity/v3/projects/0b580db2491140cb8c08cbaa71fbba63 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:53.086427 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e35ed-1a07-4936-94c6-7c3cb7746f2c service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:53.097480 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e35ed-1a07-4936-94c6-7c3cb7746f2c service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:53.156218 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04947297-ac6d-4171-8ed2-a9ba93ff49d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:53.157187 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04947297-ac6d-4171-8ed2-a9ba93ff49d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:53.157461 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04947297-ac6d-4171-8ed2-a9ba93ff49d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:53.157725 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04947297-ac6d-4171-8ed2-a9ba93ff49d2 admin admin] PATH_INFO: `/v3/users/02b8e1fafc53431995ff53b63befed48` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:53.159182 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04947297-ac6d-4171-8ed2-a9ba93ff49d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02b8e1fafc53431995ff53b63befed48)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:53.161144 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04947297-ac6d-4171-8ed2-a9ba93ff49d2 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:53.208255 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-04947297-ac6d-4171-8ed2-a9ba93ff49d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02b8e1fafc53431995ff53b63befed48'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.208848 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-04947297-ac6d-4171-8ed2-a9ba93ff49d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02b8e1fafc53431995ff53b63befed48'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.209365 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-04947297-ac6d-4171-8ed2-a9ba93ff49d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02b8e1fafc53431995ff53b63befed48'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.220685 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-04947297-ac6d-4171-8ed2-a9ba93ff49d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02b8e1fafc53431995ff53b63befed48'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.226618 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-04947297-ac6d-4171-8ed2-a9ba93ff49d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02b8e1fafc53431995ff53b63befed48'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:53.245045 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1335/2665] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:53 2022] DELETE /identity/v3/users/02b8e1fafc53431995ff53b63befed48 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:53.905281 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189add0-62a6-4bf6-a920-b90bb00ff6cc admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:53.907942 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2189add0-62a6-4bf6-a920-b90bb00ff6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:53.952198 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189add0-62a6-4bf6-a920-b90bb00ff6cc admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:54.018883 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd04c7-b3a0-422c-be68-c07ac58a24b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:54.019888 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd04c7-b3a0-422c-be68-c07ac58a24b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:54.020341 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd04c7-b3a0-422c-be68-c07ac58a24b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:54.020488 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd04c7-b3a0-422c-be68-c07ac58a24b4 admin admin] PATH_INFO: `/v3/projects/40736701ea93446b97eedbd3bda505a0` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:54.021987 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd04c7-b3a0-422c-be68-c07ac58a24b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40736701ea93446b97eedbd3bda505a0)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:54.023883 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd04c7-b3a0-422c-be68-c07ac58a24b4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:54.084034 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-60bd04c7-b3a0-422c-be68-c07ac58a24b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40736701ea93446b97eedbd3bda505a0', 'request_id': 'req-60bd04c7-b3a0-422c-be68-c07ac58a24b4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:54.090992 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-60bd04c7-b3a0-422c-be68-c07ac58a24b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40736701ea93446b97eedbd3bda505a0', 'request_id': 'req-60bd04c7-b3a0-422c-be68-c07ac58a24b4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:54.098723 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-60bd04c7-b3a0-422c-be68-c07ac58a24b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40736701ea93446b97eedbd3bda505a0', 'request_id': 'req-60bd04c7-b3a0-422c-be68-c07ac58a24b4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:54.129529 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-60bd04c7-b3a0-422c-be68-c07ac58a24b4 admin admin] The token cache is being invalidate because project 40736701ea93446b97eedbd3bda505a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:54.129821 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-60bd04c7-b3a0-422c-be68-c07ac58a24b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:54.130513 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-60bd04c7-b3a0-422c-be68-c07ac58a24b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:54.132307 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1331/2666] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:53 2022] DELETE /identity/v3/projects/40736701ea93446b97eedbd3bda505a0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:54.141809 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094edca2-0184-4317-9ed5-5c4a4fee4519 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:54.142377 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094edca2-0184-4317-9ed5-5c4a4fee4519 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:54.142507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094edca2-0184-4317-9ed5-5c4a4fee4519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:54.164105 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-094edca2-0184-4317-9ed5-5c4a4fee4519 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:54.165941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-094edca2-0184-4317-9ed5-5c4a4fee4519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:54.249924 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1336/2667] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:54 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:54.258499 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70f45f-d943-4c4b-8c8f-160db9d680e3 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:54.259290 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70f45f-d943-4c4b-8c8f-160db9d680e3 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:54.259785 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70f45f-d943-4c4b-8c8f-160db9d680e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:54.284575 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-6f70f45f-d943-4c4b-8c8f-160db9d680e3 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:54.285828 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-6f70f45f-d943-4c4b-8c8f-160db9d680e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:54.295545 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1332/2668] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:54 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:54.302620 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094edca2-0184-4317-9ed5-5c4a4fee4519 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:54.314449 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094edca2-0184-4317-9ed5-5c4a4fee4519 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:54.319675 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf59c37-e78f-4b9d-a44f-601a6fbe2f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:54.320771 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf59c37-e78f-4b9d-a44f-601a6fbe2f49 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:54.321145 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf59c37-e78f-4b9d-a44f-601a6fbe2f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:54.321484 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf59c37-e78f-4b9d-a44f-601a6fbe2f49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:54.322333 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf59c37-e78f-4b9d-a44f-601a6fbe2f49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:04:54.322812 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf59c37-e78f-4b9d-a44f-601a6fbe2f49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:54.324756 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf59c37-e78f-4b9d-a44f-601a6fbe2f49 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:54.347073 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1337/2669] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:04:54.352451 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70f45f-d943-4c4b-8c8f-160db9d680e3 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:54.362159 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70f45f-d943-4c4b-8c8f-160db9d680e3 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:54.366970 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551487c-e285-4d01-ba04-76fec23e50f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:54.367652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551487c-e285-4d01-ba04-76fec23e50f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:54.367907 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551487c-e285-4d01-ba04-76fec23e50f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:54.368206 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551487c-e285-4d01-ba04-76fec23e50f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:54.368887 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551487c-e285-4d01-ba04-76fec23e50f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:54.370763 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551487c-e285-4d01-ba04-76fec23e50f9 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:54.404615 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1333/2670] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:04:54 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:54.408916 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf59c37-e78f-4b9d-a44f-601a6fbe2f49 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:54.428841 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf59c37-e78f-4b9d-a44f-601a6fbe2f49 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:54.488304 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d054599-7dac-4298-bc26-728576d463c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:54.489498 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d054599-7dac-4298-bc26-728576d463c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:54.489805 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d054599-7dac-4298-bc26-728576d463c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:54.490104 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d054599-7dac-4298-bc26-728576d463c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:54.490858 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d054599-7dac-4298-bc26-728576d463c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:54.493827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d054599-7dac-4298-bc26-728576d463c4 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:54.520854 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1338/2671] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:04:54 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:04:54.523896 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551487c-e285-4d01-ba04-76fec23e50f9 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:54.537277 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551487c-e285-4d01-ba04-76fec23e50f9 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:54.542484 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de511f-5471-478f-b6e9-35d1c0ee7963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:54.543169 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de511f-5471-478f-b6e9-35d1c0ee7963 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:54.543532 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de511f-5471-478f-b6e9-35d1c0ee7963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:54.544385 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de511f-5471-478f-b6e9-35d1c0ee7963 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:54.545660 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de511f-5471-478f-b6e9-35d1c0ee7963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:54.547297 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de511f-5471-478f-b6e9-35d1c0ee7963 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:54.571108 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1334/2672] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:54.573002 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d054599-7dac-4298-bc26-728576d463c4 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:54.589469 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d054599-7dac-4298-bc26-728576d463c4 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:54.599406 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b206f-6e2b-4a08-a56a-cf3514b37f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:54.600213 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b206f-6e2b-4a08-a56a-cf3514b37f31 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:54.600564 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b206f-6e2b-4a08-a56a-cf3514b37f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:54.600868 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b206f-6e2b-4a08-a56a-cf3514b37f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:54.601680 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b206f-6e2b-4a08-a56a-cf3514b37f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:54.603509 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b206f-6e2b-4a08-a56a-cf3514b37f31 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:54.623486 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1339/2673] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:04:54.625127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de511f-5471-478f-b6e9-35d1c0ee7963 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:54.638961 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de511f-5471-478f-b6e9-35d1c0ee7963 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:54.644505 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200bc37-bee7-42ab-a7d0-c8861c9fdb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:54.645677 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200bc37-bee7-42ab-a7d0-c8861c9fdb8e admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:54.646292 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200bc37-bee7-42ab-a7d0-c8861c9fdb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:54.646712 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200bc37-bee7-42ab-a7d0-c8861c9fdb8e admin admin] PATH_INFO: `/v3/projects/6b7baf31d36345438fae082f80150062/users/7a111ac3dd444fd2bf79cc3958bded23/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:54.666240 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200bc37-bee7-42ab-a7d0-c8861c9fdb8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b7baf31d36345438fae082f80150062, user_id=7a111ac3dd444fd2bf79cc3958bded23, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:54.669372 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200bc37-bee7-42ab-a7d0-c8861c9fdb8e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:54.684429 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1335/2674] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:04:54 2022] PUT /identity/v3/projects/6b7baf31d36345438fae082f80150062/users/7a111ac3dd444fd2bf79cc3958bded23/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:54.696200 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3baac-d9bc-4675-acc5-f64e45e2661f None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:54.696582 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3baac-d9bc-4675-acc5-f64e45e2661f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:54.697135 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3baac-d9bc-4675-acc5-f64e45e2661f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:54.743267 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-6bd3baac-d9bc-4675-acc5-f64e45e2661f None None] MFA Rules not processed for user `7a111ac3dd444fd2bf79cc3958bded23`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:54.745124 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-6bd3baac-d9bc-4675-acc5-f64e45e2661f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:54.833029 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1340/2675] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:04:54 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:54.843683 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200bc37-bee7-42ab-a7d0-c8861c9fdb8e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:54.845569 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-1200bc37-bee7-42ab-a7d0-c8861c9fdb8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:54.910107 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200bc37-bee7-42ab-a7d0-c8861c9fdb8e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:54.914455 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90378b-1e1b-46ef-ab71-57191cd9cc7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:54.915296 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90378b-1e1b-46ef-ab71-57191cd9cc7c service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:54.915639 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90378b-1e1b-46ef-ab71-57191cd9cc7c service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:54.915979 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90378b-1e1b-46ef-ab71-57191cd9cc7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:54.928686 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90378b-1e1b-46ef-ab71-57191cd9cc7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:54.931643 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90378b-1e1b-46ef-ab71-57191cd9cc7c service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:54.944998 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1336/2676] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:54 2022] GET /identity/v3/auth/tokens => generated 3405 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:56.421492 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3baac-d9bc-4675-acc5-f64e45e2661f None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:56.422990 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-6bd3baac-d9bc-4675-acc5-f64e45e2661f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:56.501651 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3baac-d9bc-4675-acc5-f64e45e2661f None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:56.506286 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362a57e-6e34-4f07-8918-6576a52c2637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:56.507167 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362a57e-6e34-4f07-8918-6576a52c2637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:56.507445 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362a57e-6e34-4f07-8918-6576a52c2637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:56.507892 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362a57e-6e34-4f07-8918-6576a52c2637 admin admin] PATH_INFO: `/v3/users/a315151d7ab945cbbbe4c88adc4b7203` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:56.509479 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362a57e-6e34-4f07-8918-6576a52c2637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a315151d7ab945cbbbe4c88adc4b7203)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:56.511894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362a57e-6e34-4f07-8918-6576a52c2637 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:56.571008 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9362a57e-6e34-4f07-8918-6576a52c2637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a315151d7ab945cbbbe4c88adc4b7203'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:56.571648 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9362a57e-6e34-4f07-8918-6576a52c2637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a315151d7ab945cbbbe4c88adc4b7203'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:56.572230 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9362a57e-6e34-4f07-8918-6576a52c2637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a315151d7ab945cbbbe4c88adc4b7203'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:56.580201 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9362a57e-6e34-4f07-8918-6576a52c2637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a315151d7ab945cbbbe4c88adc4b7203'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:56.586887 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9362a57e-6e34-4f07-8918-6576a52c2637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a315151d7ab945cbbbe4c88adc4b7203'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:56.603552 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1341/2677] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:56 2022] DELETE /identity/v3/users/a315151d7ab945cbbbe4c88adc4b7203 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:56.890314 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90378b-1e1b-46ef-ab71-57191cd9cc7c service cinder] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:56.901408 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90378b-1e1b-46ef-ab71-57191cd9cc7c service cinder] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:56.962861 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82101dde-0a1c-4f9a-b58f-69c1972c099e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:56.963723 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82101dde-0a1c-4f9a-b58f-69c1972c099e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:56.964062 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82101dde-0a1c-4f9a-b58f-69c1972c099e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:56.964340 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82101dde-0a1c-4f9a-b58f-69c1972c099e admin admin] PATH_INFO: `/v3/projects/50b9208765264efbb2e25f5ba4896b4a` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:56.966127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82101dde-0a1c-4f9a-b58f-69c1972c099e admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b9208765264efbb2e25f5ba4896b4a)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:56.968087 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82101dde-0a1c-4f9a-b58f-69c1972c099e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:57.013650 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-82101dde-0a1c-4f9a-b58f-69c1972c099e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b9208765264efbb2e25f5ba4896b4a', 'request_id': 'req-82101dde-0a1c-4f9a-b58f-69c1972c099e'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:57.019763 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-82101dde-0a1c-4f9a-b58f-69c1972c099e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b9208765264efbb2e25f5ba4896b4a', 'request_id': 'req-82101dde-0a1c-4f9a-b58f-69c1972c099e'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:57.025154 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-82101dde-0a1c-4f9a-b58f-69c1972c099e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b9208765264efbb2e25f5ba4896b4a', 'request_id': 'req-82101dde-0a1c-4f9a-b58f-69c1972c099e'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:57.039101 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-82101dde-0a1c-4f9a-b58f-69c1972c099e admin admin] The token cache is being invalidate because project 50b9208765264efbb2e25f5ba4896b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:57.039388 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-82101dde-0a1c-4f9a-b58f-69c1972c099e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:57.040010 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-82101dde-0a1c-4f9a-b58f-69c1972c099e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:57.041588 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1337/2678] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:56 2022] DELETE /identity/v3/projects/50b9208765264efbb2e25f5ba4896b4a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:57.045875 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362a57e-6e34-4f07-8918-6576a52c2637 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:57.047300 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-9362a57e-6e34-4f07-8918-6576a52c2637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:57.060455 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362a57e-6e34-4f07-8918-6576a52c2637 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:57.121199 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d13ecf-7937-4ad1-bd75-e5d2628ee665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:57.122134 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d13ecf-7937-4ad1-bd75-e5d2628ee665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:57.122377 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d13ecf-7937-4ad1-bd75-e5d2628ee665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:57.122670 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d13ecf-7937-4ad1-bd75-e5d2628ee665 admin admin] PATH_INFO: `/v3/users/8e2c7de53bc7406ea4b5806362208952` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:57.124005 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d13ecf-7937-4ad1-bd75-e5d2628ee665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e2c7de53bc7406ea4b5806362208952)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:57.126026 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d13ecf-7937-4ad1-bd75-e5d2628ee665 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:57.171475 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-01d13ecf-7937-4ad1-bd75-e5d2628ee665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e2c7de53bc7406ea4b5806362208952'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:57.172106 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-01d13ecf-7937-4ad1-bd75-e5d2628ee665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e2c7de53bc7406ea4b5806362208952'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:57.172705 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-01d13ecf-7937-4ad1-bd75-e5d2628ee665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e2c7de53bc7406ea4b5806362208952'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:57.180841 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-01d13ecf-7937-4ad1-bd75-e5d2628ee665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e2c7de53bc7406ea4b5806362208952'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:57.188017 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-01d13ecf-7937-4ad1-bd75-e5d2628ee665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e2c7de53bc7406ea4b5806362208952'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:57.205083 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1342/2679] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:04:57 2022] DELETE /identity/v3/users/8e2c7de53bc7406ea4b5806362208952 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:04:57.382088 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82101dde-0a1c-4f9a-b58f-69c1972c099e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:57.384131 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-82101dde-0a1c-4f9a-b58f-69c1972c099e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:57.406634 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82101dde-0a1c-4f9a-b58f-69c1972c099e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:57.462898 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef93ef-25d3-4ec3-aae1-521f2be383d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:57.463752 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef93ef-25d3-4ec3-aae1-521f2be383d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:57.464027 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef93ef-25d3-4ec3-aae1-521f2be383d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:57.464296 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef93ef-25d3-4ec3-aae1-521f2be383d8 admin admin] PATH_INFO: `/v3/projects/61de37e2667c4b58aca1e21e283ee42c` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:57.465632 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef93ef-25d3-4ec3-aae1-521f2be383d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61de37e2667c4b58aca1e21e283ee42c)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:57.467606 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef93ef-25d3-4ec3-aae1-521f2be383d8 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:57.514465 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-12ef93ef-25d3-4ec3-aae1-521f2be383d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61de37e2667c4b58aca1e21e283ee42c', 'request_id': 'req-12ef93ef-25d3-4ec3-aae1-521f2be383d8'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:57.520786 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-12ef93ef-25d3-4ec3-aae1-521f2be383d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61de37e2667c4b58aca1e21e283ee42c', 'request_id': 'req-12ef93ef-25d3-4ec3-aae1-521f2be383d8'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:57.527270 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-12ef93ef-25d3-4ec3-aae1-521f2be383d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61de37e2667c4b58aca1e21e283ee42c', 'request_id': 'req-12ef93ef-25d3-4ec3-aae1-521f2be383d8'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:57.541117 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-12ef93ef-25d3-4ec3-aae1-521f2be383d8 admin admin] The token cache is being invalidate because project 61de37e2667c4b58aca1e21e283ee42c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:04:57.541405 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-12ef93ef-25d3-4ec3-aae1-521f2be383d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:57.542041 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-12ef93ef-25d3-4ec3-aae1-521f2be383d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:04:57.543918 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1338/2680] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:04:57 2022] DELETE /identity/v3/projects/61de37e2667c4b58aca1e21e283ee42c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:04:59.662921 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d13ecf-7937-4ad1-bd75-e5d2628ee665 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:59.664349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-01d13ecf-7937-4ad1-bd75-e5d2628ee665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:59.739801 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d13ecf-7937-4ad1-bd75-e5d2628ee665 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:59.804496 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08925a-8bc6-42e2-b303-be7552d4c563 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a16f0ecf3448428e969359be57dda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:59.805224 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08925a-8bc6-42e2-b303-be7552d4c563 service placement] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:59.805500 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08925a-8bc6-42e2-b303-be7552d4c563 service placement] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:59.805853 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08925a-8bc6-42e2-b303-be7552d4c563 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:59.807614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-1b08925a-8bc6-42e2-b303-be7552d4c563 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:59.819274 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08925a-8bc6-42e2-b303-be7552d4c563 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:59.820881 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08925a-8bc6-42e2-b303-be7552d4c563 service placement] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:59.831039 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1343/2681] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:59 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:03.386407 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef93ef-25d3-4ec3-aae1-521f2be383d8 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:03.388353 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-12ef93ef-25d3-4ec3-aae1-521f2be383d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:03.458921 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef93ef-25d3-4ec3-aae1-521f2be383d8 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:03.467004 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e99dd7-ce1c-4d27-bc6e-07ca49e7e9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:03.468512 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e99dd7-ce1c-4d27-bc6e-07ca49e7e9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:03.469066 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e99dd7-ce1c-4d27-bc6e-07ca49e7e9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:03.469577 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e99dd7-ce1c-4d27-bc6e-07ca49e7e9b8 admin admin] PATH_INFO: `/v3/users/7a111ac3dd444fd2bf79cc3958bded23` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:03.471510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e99dd7-ce1c-4d27-bc6e-07ca49e7e9b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a111ac3dd444fd2bf79cc3958bded23)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:03.475329 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e99dd7-ce1c-4d27-bc6e-07ca49e7e9b8 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:03.542351 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-25e99dd7-ce1c-4d27-bc6e-07ca49e7e9b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a111ac3dd444fd2bf79cc3958bded23'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:03.543037 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-25e99dd7-ce1c-4d27-bc6e-07ca49e7e9b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a111ac3dd444fd2bf79cc3958bded23'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:03.552447 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-25e99dd7-ce1c-4d27-bc6e-07ca49e7e9b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a111ac3dd444fd2bf79cc3958bded23'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:03.560820 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-25e99dd7-ce1c-4d27-bc6e-07ca49e7e9b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a111ac3dd444fd2bf79cc3958bded23'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:03.572607 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-25e99dd7-ce1c-4d27-bc6e-07ca49e7e9b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a111ac3dd444fd2bf79cc3958bded23'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:03.579051 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1339/2682] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:03 2022] DELETE /identity/v3/users/7a111ac3dd444fd2bf79cc3958bded23 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:03.583567 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab2172-d117-446d-94ae-9f3a2f15dc71 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:03.584067 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab2172-d117-446d-94ae-9f3a2f15dc71 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:03.584168 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab2172-d117-446d-94ae-9f3a2f15dc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:03.601884 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-27ab2172-d117-446d-94ae-9f3a2f15dc71 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:03.603203 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-27ab2172-d117-446d-94ae-9f3a2f15dc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:03.665539 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1344/2683] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:05:03 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:05:03.675401 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e99dd7-ce1c-4d27-bc6e-07ca49e7e9b8 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:03.676867 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-25e99dd7-ce1c-4d27-bc6e-07ca49e7e9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:03.716143 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487da03-b3bc-4d46-810f-d386aa8de4e2 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:03.716484 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487da03-b3bc-4d46-810f-d386aa8de4e2 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:03.716770 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487da03-b3bc-4d46-810f-d386aa8de4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:03.734327 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-4487da03-b3bc-4d46-810f-d386aa8de4e2 None None] MFA Rules not processed for user `cb4b6e4c21f34cbd8d89686ce74fe07a`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:03.735508 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-4487da03-b3bc-4d46-810f-d386aa8de4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:03.736239 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e99dd7-ce1c-4d27-bc6e-07ca49e7e9b8 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:03.739983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b88323-40c6-4781-8594-a3d43d677d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:03.740657 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b88323-40c6-4781-8594-a3d43d677d30 service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:03.740967 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b88323-40c6-4781-8594-a3d43d677d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:03.741243 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b88323-40c6-4781-8594-a3d43d677d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:03.750900 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b88323-40c6-4781-8594-a3d43d677d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:03.752332 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b88323-40c6-4781-8594-a3d43d677d30 service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:03.761859 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1340/2684] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:03 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:03.793678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1345/2685] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:05:03 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:05:04.085298 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b88323-40c6-4781-8594-a3d43d677d30 service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:04.087126 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-e9b88323-40c6-4781-8594-a3d43d677d30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:04.102310 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b88323-40c6-4781-8594-a3d43d677d30 service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:04.110295 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaa93e-a9cf-4d1f-ada3-0760d80eb552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:04.111333 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaa93e-a9cf-4d1f-ada3-0760d80eb552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:04.111623 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaa93e-a9cf-4d1f-ada3-0760d80eb552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:04.111922 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaa93e-a9cf-4d1f-ada3-0760d80eb552 admin admin] PATH_INFO: `/v3/projects/6b7baf31d36345438fae082f80150062` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:04.113161 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaa93e-a9cf-4d1f-ada3-0760d80eb552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b7baf31d36345438fae082f80150062)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:04.115082 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaa93e-a9cf-4d1f-ada3-0760d80eb552 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:04.162966 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-64aaa93e-a9cf-4d1f-ada3-0760d80eb552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b7baf31d36345438fae082f80150062', 'request_id': 'req-64aaa93e-a9cf-4d1f-ada3-0760d80eb552'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.170253 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-64aaa93e-a9cf-4d1f-ada3-0760d80eb552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b7baf31d36345438fae082f80150062', 'request_id': 'req-64aaa93e-a9cf-4d1f-ada3-0760d80eb552'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.175861 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-64aaa93e-a9cf-4d1f-ada3-0760d80eb552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b7baf31d36345438fae082f80150062', 'request_id': 'req-64aaa93e-a9cf-4d1f-ada3-0760d80eb552'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.189395 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-64aaa93e-a9cf-4d1f-ada3-0760d80eb552 admin admin] The token cache is being invalidate because project 6b7baf31d36345438fae082f80150062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:04.189685 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-64aaa93e-a9cf-4d1f-ada3-0760d80eb552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.190335 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-64aaa93e-a9cf-4d1f-ada3-0760d80eb552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:04.192085 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1341/2686] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:04 2022] DELETE /identity/v3/projects/6b7baf31d36345438fae082f80150062 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:04.197743 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a34966-61e7-4004-846a-68211db0b88c None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:04.197951 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a34966-61e7-4004-846a-68211db0b88c None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:04.198252 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a34966-61e7-4004-846a-68211db0b88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:04.218563 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-95a34966-61e7-4004-846a-68211db0b88c None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:04.219775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-95a34966-61e7-4004-846a-68211db0b88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:04.281632 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1346/2687] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:05:04 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:04.290046 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b7237-8d88-4dd2-9ebb-cfdc89cd878c None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:04.290329 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b7237-8d88-4dd2-9ebb-cfdc89cd878c None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:04.290602 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b7237-8d88-4dd2-9ebb-cfdc89cd878c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:04.309522 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-955b7237-8d88-4dd2-9ebb-cfdc89cd878c None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:04.310745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-955b7237-8d88-4dd2-9ebb-cfdc89cd878c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:04.318624 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1342/2688] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:05:04 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:04.322961 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a34966-61e7-4004-846a-68211db0b88c None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:04.333948 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a34966-61e7-4004-846a-68211db0b88c None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:04.339159 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65772b1d-10c7-43cc-b4b7-fe0a8380b555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:04.339875 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65772b1d-10c7-43cc-b4b7-fe0a8380b555 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:04.340760 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65772b1d-10c7-43cc-b4b7-fe0a8380b555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:04.340760 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65772b1d-10c7-43cc-b4b7-fe0a8380b555 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:04.341439 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65772b1d-10c7-43cc-b4b7-fe0a8380b555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:04.341818 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65772b1d-10c7-43cc-b4b7-fe0a8380b555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:04.343656 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65772b1d-10c7-43cc-b4b7-fe0a8380b555 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:04.356383 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1347/2689] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:05:04.360978 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b7237-8d88-4dd2-9ebb-cfdc89cd878c None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:04.370131 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b7237-8d88-4dd2-9ebb-cfdc89cd878c None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:04.376225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13897118-12a7-416e-9a96-94250a597d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:04.376950 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13897118-12a7-416e-9a96-94250a597d80 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:04.377211 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13897118-12a7-416e-9a96-94250a597d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:04.377484 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13897118-12a7-416e-9a96-94250a597d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:04.378156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13897118-12a7-416e-9a96-94250a597d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:04.380052 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13897118-12a7-416e-9a96-94250a597d80 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:04.406700 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1343/2690] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:04 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:04.411295 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65772b1d-10c7-43cc-b4b7-fe0a8380b555 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:04.422455 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65772b1d-10c7-43cc-b4b7-fe0a8380b555 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:04.487730 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663a7eb-a59e-4033-b3ec-416a06b43e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:04.488408 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663a7eb-a59e-4033-b3ec-416a06b43e3c admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:04.488687 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663a7eb-a59e-4033-b3ec-416a06b43e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:04.489001 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663a7eb-a59e-4033-b3ec-416a06b43e3c admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:04.489696 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663a7eb-a59e-4033-b3ec-416a06b43e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:04.492300 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663a7eb-a59e-4033-b3ec-416a06b43e3c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:04.520981 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1348/2691] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:04 2022] POST /identity/v3/users => generated 283 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:05:04.522854 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13897118-12a7-416e-9a96-94250a597d80 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:04.542030 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13897118-12a7-416e-9a96-94250a597d80 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:04.548407 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2b4bf-6ce9-4ff9-8582-56005cce6ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:04.549130 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2b4bf-6ce9-4ff9-8582-56005cce6ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:04.549440 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2b4bf-6ce9-4ff9-8582-56005cce6ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:04.551473 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2b4bf-6ce9-4ff9-8582-56005cce6ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:04.552225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2b4bf-6ce9-4ff9-8582-56005cce6ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:04.553862 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2b4bf-6ce9-4ff9-8582-56005cce6ec0 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:04.568125 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1344/2692] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:04.572004 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663a7eb-a59e-4033-b3ec-416a06b43e3c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:04.582180 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663a7eb-a59e-4033-b3ec-416a06b43e3c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:04.586881 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955beeb-3e80-4187-81ca-5124dfdd9ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:04.588764 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955beeb-3e80-4187-81ca-5124dfdd9ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:04.589083 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955beeb-3e80-4187-81ca-5124dfdd9ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:04.589357 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955beeb-3e80-4187-81ca-5124dfdd9ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:04.590067 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955beeb-3e80-4187-81ca-5124dfdd9ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:04.591897 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955beeb-3e80-4187-81ca-5124dfdd9ae0 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:04.602360 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1349/2693] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:04.607192 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2b4bf-6ce9-4ff9-8582-56005cce6ec0 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:04.618277 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2b4bf-6ce9-4ff9-8582-56005cce6ec0 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:04.623683 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0d23c-b761-438c-9ed5-f7822171a14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:04.624563 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0d23c-b761-438c-9ed5-f7822171a14c admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:04.624877 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0d23c-b761-438c-9ed5-f7822171a14c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:04.625154 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0d23c-b761-438c-9ed5-f7822171a14c admin admin] PATH_INFO: `/v3/projects/37ba558c69a6440b8a64a9196b781ac4/users/128d8d168de5424dad077c39518e35b1/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:04.640517 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0d23c-b761-438c-9ed5-f7822171a14c admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ba558c69a6440b8a64a9196b781ac4, user_id=128d8d168de5424dad077c39518e35b1, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:04.643249 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0d23c-b761-438c-9ed5-f7822171a14c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:04.657401 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1345/2694] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:04 2022] PUT /identity/v3/projects/37ba558c69a6440b8a64a9196b781ac4/users/128d8d168de5424dad077c39518e35b1/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:04.667643 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaaf9b-c4ff-4a73-8d86-8ff07a9518fb None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:04.667957 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaaf9b-c4ff-4a73-8d86-8ff07a9518fb None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:04.668232 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaaf9b-c4ff-4a73-8d86-8ff07a9518fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:04.697496 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-1fdaaf9b-c4ff-4a73-8d86-8ff07a9518fb None None] MFA Rules not processed for user `128d8d168de5424dad077c39518e35b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:04.698922 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-1fdaaf9b-c4ff-4a73-8d86-8ff07a9518fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:04.763658 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1350/2695] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:05:04 2022] POST /identity/v3/auth/tokens => generated 3385 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:04.774380 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0d23c-b761-438c-9ed5-f7822171a14c admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:04.776147 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-fae0d23c-b761-438c-9ed5-f7822171a14c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:04.835299 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0d23c-b761-438c-9ed5-f7822171a14c admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:04.839017 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae177e5a-bd59-41a9-94c5-70b5b88b3c7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:04.839662 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae177e5a-bd59-41a9-94c5-70b5b88b3c7e service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:04.840761 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae177e5a-bd59-41a9-94c5-70b5b88b3c7e service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:04.841198 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae177e5a-bd59-41a9-94c5-70b5b88b3c7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:04.850490 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae177e5a-bd59-41a9-94c5-70b5b88b3c7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:04.851908 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae177e5a-bd59-41a9-94c5-70b5b88b3c7e service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:04.862567 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1346/2696] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:04 2022] GET /identity/v3/auth/tokens => generated 3385 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:43.199937 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdaaf9b-c4ff-4a73-8d86-8ff07a9518fb None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:43.264865 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdaaf9b-c4ff-4a73-8d86-8ff07a9518fb None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:43.269784 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fa802-4924-44d5-9c43-a7599dd248bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:43.270650 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fa802-4924-44d5-9c43-a7599dd248bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:43.271112 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fa802-4924-44d5-9c43-a7599dd248bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:43.271447 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fa802-4924-44d5-9c43-a7599dd248bf admin admin] PATH_INFO: `/v3/users/128d8d168de5424dad077c39518e35b1` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:43.272770 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fa802-4924-44d5-9c43-a7599dd248bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=128d8d168de5424dad077c39518e35b1)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:43.274711 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fa802-4924-44d5-9c43-a7599dd248bf admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:43.328359 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-404fa802-4924-44d5-9c43-a7599dd248bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '128d8d168de5424dad077c39518e35b1'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:43.329052 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-404fa802-4924-44d5-9c43-a7599dd248bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '128d8d168de5424dad077c39518e35b1'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:43.329647 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-404fa802-4924-44d5-9c43-a7599dd248bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '128d8d168de5424dad077c39518e35b1'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:43.337222 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-404fa802-4924-44d5-9c43-a7599dd248bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '128d8d168de5424dad077c39518e35b1'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:43.344548 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-404fa802-4924-44d5-9c43-a7599dd248bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '128d8d168de5424dad077c39518e35b1'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:43.362003 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1351/2697] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:43 2022] DELETE /identity/v3/users/128d8d168de5424dad077c39518e35b1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:43.366673 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1177236-c129-412c-bcfd-c59b75a28131 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:43.367337 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1177236-c129-412c-bcfd-c59b75a28131 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:43.367337 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1177236-c129-412c-bcfd-c59b75a28131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:43.385006 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-d1177236-c129-412c-bcfd-c59b75a28131 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:43.386225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-d1177236-c129-412c-bcfd-c59b75a28131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:43.447692 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1347/2698] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:05:43 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:43.457697 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fa802-4924-44d5-9c43-a7599dd248bf admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:43.459158 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-404fa802-4924-44d5-9c43-a7599dd248bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:43.519023 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fa802-4924-44d5-9c43-a7599dd248bf admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:43.522804 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b11e44-1ef4-440b-8aa3-1cd239f3bba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:43.523448 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b11e44-1ef4-440b-8aa3-1cd239f3bba5 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:43.523724 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b11e44-1ef4-440b-8aa3-1cd239f3bba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:43.523996 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b11e44-1ef4-440b-8aa3-1cd239f3bba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:43.533909 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b11e44-1ef4-440b-8aa3-1cd239f3bba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:43.535613 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b11e44-1ef4-440b-8aa3-1cd239f3bba5 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:43.545907 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1352/2699] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:43 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:43.906325 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1177236-c129-412c-bcfd-c59b75a28131 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:43.908637 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-d1177236-c129-412c-bcfd-c59b75a28131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:43.928716 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1177236-c129-412c-bcfd-c59b75a28131 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:43.933823 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45cafe-477f-4c6f-a284-e9065040895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:43.934835 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45cafe-477f-4c6f-a284-e9065040895d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:43.935119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45cafe-477f-4c6f-a284-e9065040895d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:43.935388 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45cafe-477f-4c6f-a284-e9065040895d admin admin] PATH_INFO: `/v3/projects/37ba558c69a6440b8a64a9196b781ac4` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:43.937448 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45cafe-477f-4c6f-a284-e9065040895d admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ba558c69a6440b8a64a9196b781ac4)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:43.939297 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45cafe-477f-4c6f-a284-e9065040895d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:43.999510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-eb45cafe-477f-4c6f-a284-e9065040895d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ba558c69a6440b8a64a9196b781ac4', 'request_id': 'req-eb45cafe-477f-4c6f-a284-e9065040895d'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:44.007601 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-eb45cafe-477f-4c6f-a284-e9065040895d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ba558c69a6440b8a64a9196b781ac4', 'request_id': 'req-eb45cafe-477f-4c6f-a284-e9065040895d'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:44.014893 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-eb45cafe-477f-4c6f-a284-e9065040895d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ba558c69a6440b8a64a9196b781ac4', 'request_id': 'req-eb45cafe-477f-4c6f-a284-e9065040895d'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:44.030793 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-eb45cafe-477f-4c6f-a284-e9065040895d admin admin] The token cache is being invalidate because project 37ba558c69a6440b8a64a9196b781ac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:44.030793 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-eb45cafe-477f-4c6f-a284-e9065040895d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:44.031282 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-eb45cafe-477f-4c6f-a284-e9065040895d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:44.032860 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1348/2700] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:43 2022] DELETE /identity/v3/projects/37ba558c69a6440b8a64a9196b781ac4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:05:47.560121 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edb6ed-f105-4414-9b0a-84e3c0eae858 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:47.561178 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edb6ed-f105-4414-9b0a-84e3c0eae858 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:47.561178 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edb6ed-f105-4414-9b0a-84e3c0eae858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:47.578980 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-93edb6ed-f105-4414-9b0a-84e3c0eae858 None None] MFA Rules not processed for user `591d508a3867412fac76d00134e58864`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:47.580181 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-93edb6ed-f105-4414-9b0a-84e3c0eae858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:47.637521 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1353/2701] 10.222.0.96 () {58 vars in 967 bytes} [Fri Jan 28 02:05:47 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:05:47.682148 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45cafe-477f-4c6f-a284-e9065040895d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:47.683552 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-eb45cafe-477f-4c6f-a284-e9065040895d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:47.753045 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45cafe-477f-4c6f-a284-e9065040895d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:47.758436 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9bd7b-4433-40f1-a151-59a738606ac6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a2c3b2815f46b0ac27944f004c4821', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:47.759095 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9bd7b-4433-40f1-a151-59a738606ac6 service swift] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:47.759378 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9bd7b-4433-40f1-a151-59a738606ac6 service swift] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:47.759681 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9bd7b-4433-40f1-a151-59a738606ac6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:47.768350 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9bd7b-4433-40f1-a151-59a738606ac6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:47.769946 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9bd7b-4433-40f1-a151-59a738606ac6 service swift] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:47.778006 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1349/2702] 10.222.0.96 () {60 vars in 1384 bytes} [Fri Jan 28 02:05:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:05:54.843876 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edb6ed-f105-4414-9b0a-84e3c0eae858 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:54.845334 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-93edb6ed-f105-4414-9b0a-84e3c0eae858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:54.910317 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edb6ed-f105-4414-9b0a-84e3c0eae858 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:54.914972 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6097964-00fd-42cd-bb5c-06c4d2fbe2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:54.915836 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6097964-00fd-42cd-bb5c-06c4d2fbe2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:54.916111 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6097964-00fd-42cd-bb5c-06c4d2fbe2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:54.916377 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6097964-00fd-42cd-bb5c-06c4d2fbe2b5 admin admin] PATH_INFO: `/v3/users/2668984632674ed6b3d343244d92c623` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:54.917584 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6097964-00fd-42cd-bb5c-06c4d2fbe2b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2668984632674ed6b3d343244d92c623)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:54.919626 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6097964-00fd-42cd-bb5c-06c4d2fbe2b5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:54.965339 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f6097964-00fd-42cd-bb5c-06c4d2fbe2b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2668984632674ed6b3d343244d92c623'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:54.965966 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f6097964-00fd-42cd-bb5c-06c4d2fbe2b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2668984632674ed6b3d343244d92c623'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:54.966556 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f6097964-00fd-42cd-bb5c-06c4d2fbe2b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2668984632674ed6b3d343244d92c623'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:54.973904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f6097964-00fd-42cd-bb5c-06c4d2fbe2b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2668984632674ed6b3d343244d92c623'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:54.980626 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f6097964-00fd-42cd-bb5c-06c4d2fbe2b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2668984632674ed6b3d343244d92c623'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:54.997775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1354/2703] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:54 2022] DELETE /identity/v3/users/2668984632674ed6b3d343244d92c623 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:55.124962 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9bd7b-4433-40f1-a151-59a738606ac6 service swift] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:55.126409 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-7bb9bd7b-4433-40f1-a151-59a738606ac6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:55.173141 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6097964-00fd-42cd-bb5c-06c4d2fbe2b5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:55.174597 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-f6097964-00fd-42cd-bb5c-06c4d2fbe2b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:55.207724 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9bd7b-4433-40f1-a151-59a738606ac6 service swift] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:55.249513 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6097964-00fd-42cd-bb5c-06c4d2fbe2b5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:55.254281 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5136437-68c5-4d1c-85ed-06f35f500731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:55.255137 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5136437-68c5-4d1c-85ed-06f35f500731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:55.255417 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5136437-68c5-4d1c-85ed-06f35f500731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:55.255689 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5136437-68c5-4d1c-85ed-06f35f500731 admin admin] PATH_INFO: `/v3/projects/4f88b3ae05934fd8836d7e90cad61a53` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:55.256914 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5136437-68c5-4d1c-85ed-06f35f500731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f88b3ae05934fd8836d7e90cad61a53)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:55.258799 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5136437-68c5-4d1c-85ed-06f35f500731 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:55.270670 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316da8f-25f3-4526-82f5-fc30f2e42f0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:55.271484 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316da8f-25f3-4526-82f5-fc30f2e42f0e service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:55.271874 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316da8f-25f3-4526-82f5-fc30f2e42f0e service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:55.272249 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316da8f-25f3-4526-82f5-fc30f2e42f0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:55.274143 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-9316da8f-25f3-4526-82f5-fc30f2e42f0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:55.307757 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a5136437-68c5-4d1c-85ed-06f35f500731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f88b3ae05934fd8836d7e90cad61a53', 'request_id': 'req-a5136437-68c5-4d1c-85ed-06f35f500731'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:55.315163 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a5136437-68c5-4d1c-85ed-06f35f500731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f88b3ae05934fd8836d7e90cad61a53', 'request_id': 'req-a5136437-68c5-4d1c-85ed-06f35f500731'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:55.321065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a5136437-68c5-4d1c-85ed-06f35f500731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f88b3ae05934fd8836d7e90cad61a53', 'request_id': 'req-a5136437-68c5-4d1c-85ed-06f35f500731'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:55.336329 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a5136437-68c5-4d1c-85ed-06f35f500731 admin admin] The token cache is being invalidate because project 4f88b3ae05934fd8836d7e90cad61a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:55.337265 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a5136437-68c5-4d1c-85ed-06f35f500731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:55.338110 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-a5136437-68c5-4d1c-85ed-06f35f500731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:55.339889 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1355/2704] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:55 2022] DELETE /identity/v3/projects/4f88b3ae05934fd8836d7e90cad61a53 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:05:55.341747 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316da8f-25f3-4526-82f5-fc30f2e42f0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:55.343477 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316da8f-25f3-4526-82f5-fc30f2e42f0e service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:55.343879 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5136437-68c5-4d1c-85ed-06f35f500731 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:55.345398 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-a5136437-68c5-4d1c-85ed-06f35f500731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:55.355078 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1350/2705] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:55 2022] GET /identity/v3/auth/tokens => generated 3395 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:55.423863 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5136437-68c5-4d1c-85ed-06f35f500731 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:55.428494 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704905d-c4ae-4557-b39a-f5ac8d51eafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:55.429402 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704905d-c4ae-4557-b39a-f5ac8d51eafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:55.429686 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704905d-c4ae-4557-b39a-f5ac8d51eafd admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:55.429957 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704905d-c4ae-4557-b39a-f5ac8d51eafd admin admin] PATH_INFO: `/v3/users/145a684e393e42a198ae9d75b3002d97` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:55.431155 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704905d-c4ae-4557-b39a-f5ac8d51eafd admin admin] RBAC: Authorizing `identity:delete_user(user_id=145a684e393e42a198ae9d75b3002d97)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:55.433102 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704905d-c4ae-4557-b39a-f5ac8d51eafd admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:55.480847 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-8704905d-c4ae-4557-b39a-f5ac8d51eafd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145a684e393e42a198ae9d75b3002d97'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:55.481516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-8704905d-c4ae-4557-b39a-f5ac8d51eafd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145a684e393e42a198ae9d75b3002d97'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:55.482123 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-8704905d-c4ae-4557-b39a-f5ac8d51eafd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145a684e393e42a198ae9d75b3002d97'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:55.490466 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-8704905d-c4ae-4557-b39a-f5ac8d51eafd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145a684e393e42a198ae9d75b3002d97'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:55.497357 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-8704905d-c4ae-4557-b39a-f5ac8d51eafd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145a684e393e42a198ae9d75b3002d97'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:55.514621 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1356/2706] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:05:55 2022] DELETE /identity/v3/users/145a684e393e42a198ae9d75b3002d97 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:05:55.694211 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316da8f-25f3-4526-82f5-fc30f2e42f0e service nova] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:55.709766 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316da8f-25f3-4526-82f5-fc30f2e42f0e service nova] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:55.769844 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f1bab-3cfc-4b23-800f-995489a80fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:55.770719 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f1bab-3cfc-4b23-800f-995489a80fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:55.771155 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f1bab-3cfc-4b23-800f-995489a80fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:55.771442 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f1bab-3cfc-4b23-800f-995489a80fb4 admin admin] PATH_INFO: `/v3/projects/7ab185b47eee4409b1765fa2f175c958` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:55.772707 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f1bab-3cfc-4b23-800f-995489a80fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab185b47eee4409b1765fa2f175c958)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:55.774653 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f1bab-3cfc-4b23-800f-995489a80fb4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:55.824563 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-839f1bab-3cfc-4b23-800f-995489a80fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab185b47eee4409b1765fa2f175c958', 'request_id': 'req-839f1bab-3cfc-4b23-800f-995489a80fb4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:55.832193 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-839f1bab-3cfc-4b23-800f-995489a80fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab185b47eee4409b1765fa2f175c958', 'request_id': 'req-839f1bab-3cfc-4b23-800f-995489a80fb4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:55.837430 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-839f1bab-3cfc-4b23-800f-995489a80fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab185b47eee4409b1765fa2f175c958', 'request_id': 'req-839f1bab-3cfc-4b23-800f-995489a80fb4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:55.850565 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-839f1bab-3cfc-4b23-800f-995489a80fb4 admin admin] The token cache is being invalidate because project 7ab185b47eee4409b1765fa2f175c958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:05:55.850852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-839f1bab-3cfc-4b23-800f-995489a80fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:55.851522 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-839f1bab-3cfc-4b23-800f-995489a80fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:05:55.868826 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1351/2707] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:05:55 2022] DELETE /identity/v3/projects/7ab185b47eee4409b1765fa2f175c958 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:36.373215 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704905d-c4ae-4557-b39a-f5ac8d51eafd admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:36.375445 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-8704905d-c4ae-4557-b39a-f5ac8d51eafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:36.441031 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704905d-c4ae-4557-b39a-f5ac8d51eafd admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:36.494677 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31d46e-7ec8-44c7-98a2-09e8bf63a722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:36.495342 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31d46e-7ec8-44c7-98a2-09e8bf63a722 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:36.495627 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31d46e-7ec8-44c7-98a2-09e8bf63a722 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:36.495893 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31d46e-7ec8-44c7-98a2-09e8bf63a722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:36.498873 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-0a31d46e-7ec8-44c7-98a2-09e8bf63a722 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:36.575387 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31d46e-7ec8-44c7-98a2-09e8bf63a722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:36.577647 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31d46e-7ec8-44c7-98a2-09e8bf63a722 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:36.588847 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1357/2708] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:36 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:44.481104 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f1bab-3cfc-4b23-800f-995489a80fb4 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:44.484391 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-839f1bab-3cfc-4b23-800f-995489a80fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:44.506941 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f1bab-3cfc-4b23-800f-995489a80fb4 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:44.513444 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9cfcd-bbc9-46f0-a530-5b6ed415975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:44.514664 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9cfcd-bbc9-46f0-a530-5b6ed415975f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:44.515127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9cfcd-bbc9-46f0-a530-5b6ed415975f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:44.515465 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9cfcd-bbc9-46f0-a530-5b6ed415975f admin admin] PATH_INFO: `/v3/users/cd9cb4ec35524e859b828892c95130e7` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:44.517130 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9cfcd-bbc9-46f0-a530-5b6ed415975f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd9cb4ec35524e859b828892c95130e7)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:44.519549 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9cfcd-bbc9-46f0-a530-5b6ed415975f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:44.587093 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-69e9cfcd-bbc9-46f0-a530-5b6ed415975f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd9cb4ec35524e859b828892c95130e7'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:44.587911 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-69e9cfcd-bbc9-46f0-a530-5b6ed415975f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd9cb4ec35524e859b828892c95130e7'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:44.597517 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-69e9cfcd-bbc9-46f0-a530-5b6ed415975f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd9cb4ec35524e859b828892c95130e7'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:44.608732 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-69e9cfcd-bbc9-46f0-a530-5b6ed415975f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd9cb4ec35524e859b828892c95130e7'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:44.627493 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-69e9cfcd-bbc9-46f0-a530-5b6ed415975f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd9cb4ec35524e859b828892c95130e7'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:44.636029 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1352/2709] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:06:44 2022] DELETE /identity/v3/users/cd9cb4ec35524e859b828892c95130e7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:44.865896 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31d46e-7ec8-44c7-98a2-09e8bf63a722 service neutron] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:44.883371 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31d46e-7ec8-44c7-98a2-09e8bf63a722 service neutron] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:44.971661 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6a489-2087-4c46-b73d-13cfa2a1504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:44.972544 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6a489-2087-4c46-b73d-13cfa2a1504f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:44.972892 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6a489-2087-4c46-b73d-13cfa2a1504f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:44.973162 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6a489-2087-4c46-b73d-13cfa2a1504f admin admin] PATH_INFO: `/v3/projects/6e15e80496d946b4ba64c95751ebc354` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:44.974458 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6a489-2087-4c46-b73d-13cfa2a1504f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e15e80496d946b4ba64c95751ebc354)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:44.976388 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6a489-2087-4c46-b73d-13cfa2a1504f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:45.049454 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-dfc6a489-2087-4c46-b73d-13cfa2a1504f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e15e80496d946b4ba64c95751ebc354', 'request_id': 'req-dfc6a489-2087-4c46-b73d-13cfa2a1504f'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:45.059420 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-dfc6a489-2087-4c46-b73d-13cfa2a1504f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e15e80496d946b4ba64c95751ebc354', 'request_id': 'req-dfc6a489-2087-4c46-b73d-13cfa2a1504f'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:45.066825 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-dfc6a489-2087-4c46-b73d-13cfa2a1504f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e15e80496d946b4ba64c95751ebc354', 'request_id': 'req-dfc6a489-2087-4c46-b73d-13cfa2a1504f'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:45.086018 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-dfc6a489-2087-4c46-b73d-13cfa2a1504f admin admin] The token cache is being invalidate because project 6e15e80496d946b4ba64c95751ebc354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:06:45.086830 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-dfc6a489-2087-4c46-b73d-13cfa2a1504f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:45.087824 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-dfc6a489-2087-4c46-b73d-13cfa2a1504f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:45.090142 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1358/2710] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:06:44 2022] DELETE /identity/v3/projects/6e15e80496d946b4ba64c95751ebc354 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:06:45.095755 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9cfcd-bbc9-46f0-a530-5b6ed415975f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:45.097335 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-69e9cfcd-bbc9-46f0-a530-5b6ed415975f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:45.116297 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9cfcd-bbc9-46f0-a530-5b6ed415975f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:45.214787 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111c9e3-ec3f-4941-b4e6-d704efda0939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:45.216475 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111c9e3-ec3f-4941-b4e6-d704efda0939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:45.216912 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111c9e3-ec3f-4941-b4e6-d704efda0939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:45.217397 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111c9e3-ec3f-4941-b4e6-d704efda0939 admin admin] PATH_INFO: `/v3/users/8dad11600d5642d880603399a7252791` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:45.219506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111c9e3-ec3f-4941-b4e6-d704efda0939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dad11600d5642d880603399a7252791)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:45.222593 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111c9e3-ec3f-4941-b4e6-d704efda0939 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:45.292061 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-8111c9e3-ec3f-4941-b4e6-d704efda0939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dad11600d5642d880603399a7252791'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:45.292760 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-8111c9e3-ec3f-4941-b4e6-d704efda0939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dad11600d5642d880603399a7252791'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:45.301857 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-8111c9e3-ec3f-4941-b4e6-d704efda0939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dad11600d5642d880603399a7252791'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:45.313258 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-8111c9e3-ec3f-4941-b4e6-d704efda0939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dad11600d5642d880603399a7252791'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:45.337519 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-8111c9e3-ec3f-4941-b4e6-d704efda0939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dad11600d5642d880603399a7252791'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:45.350283 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1353/2711] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:06:45 2022] DELETE /identity/v3/users/8dad11600d5642d880603399a7252791 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:06:45.681206 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6a489-2087-4c46-b73d-13cfa2a1504f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:45.683396 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-dfc6a489-2087-4c46-b73d-13cfa2a1504f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:45.705952 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6a489-2087-4c46-b73d-13cfa2a1504f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:45.785362 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fbcf7-10b8-42f9-94d9-8e879473bf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:45.786554 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fbcf7-10b8-42f9-94d9-8e879473bf07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:45.786922 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fbcf7-10b8-42f9-94d9-8e879473bf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:45.787367 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fbcf7-10b8-42f9-94d9-8e879473bf07 admin admin] PATH_INFO: `/v3/projects/f201d79d2228443fae07022bc53b97b2` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:45.789111 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fbcf7-10b8-42f9-94d9-8e879473bf07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f201d79d2228443fae07022bc53b97b2)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:45.791527 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fbcf7-10b8-42f9-94d9-8e879473bf07 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:45.849246 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-258fbcf7-10b8-42f9-94d9-8e879473bf07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f201d79d2228443fae07022bc53b97b2', 'request_id': 'req-258fbcf7-10b8-42f9-94d9-8e879473bf07'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:45.856139 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-258fbcf7-10b8-42f9-94d9-8e879473bf07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f201d79d2228443fae07022bc53b97b2', 'request_id': 'req-258fbcf7-10b8-42f9-94d9-8e879473bf07'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:45.862852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-258fbcf7-10b8-42f9-94d9-8e879473bf07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f201d79d2228443fae07022bc53b97b2', 'request_id': 'req-258fbcf7-10b8-42f9-94d9-8e879473bf07'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:45.877738 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-258fbcf7-10b8-42f9-94d9-8e879473bf07 admin admin] The token cache is being invalidate because project f201d79d2228443fae07022bc53b97b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:06:45.878514 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-258fbcf7-10b8-42f9-94d9-8e879473bf07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:45.878751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-258fbcf7-10b8-42f9-94d9-8e879473bf07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:45.880396 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1359/2712] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:06:45 2022] DELETE /identity/v3/projects/f201d79d2228443fae07022bc53b97b2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:54.124040 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111c9e3-ec3f-4941-b4e6-d704efda0939 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:54.125876 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-8111c9e3-ec3f-4941-b4e6-d704efda0939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:54.194378 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111c9e3-ec3f-4941-b4e6-d704efda0939 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:54.258797 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93afed-075f-4c0d-a840-8b99a18f3a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:54.259830 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93afed-075f-4c0d-a840-8b99a18f3a3e service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:54.260327 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93afed-075f-4c0d-a840-8b99a18f3a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:54.260744 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93afed-075f-4c0d-a840-8b99a18f3a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:54.264536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-6d93afed-075f-4c0d-a840-8b99a18f3a3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:54.339405 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93afed-075f-4c0d-a840-8b99a18f3a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:54.341554 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d93afed-075f-4c0d-a840-8b99a18f3a3e service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:54.352532 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1354/2713] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:54 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:58.494581 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fbcf7-10b8-42f9-94d9-8e879473bf07 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:58.496753 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-258fbcf7-10b8-42f9-94d9-8e879473bf07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:58.522033 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fbcf7-10b8-42f9-94d9-8e879473bf07 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:58.531880 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defadbff-cc28-4441-a308-ac458e520b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:58.533787 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defadbff-cc28-4441-a308-ac458e520b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:58.534182 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defadbff-cc28-4441-a308-ac458e520b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:58.534571 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defadbff-cc28-4441-a308-ac458e520b92 admin admin] PATH_INFO: `/v3/users/cb4b6e4c21f34cbd8d89686ce74fe07a` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:58.537228 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defadbff-cc28-4441-a308-ac458e520b92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb4b6e4c21f34cbd8d89686ce74fe07a)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:58.540535 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defadbff-cc28-4441-a308-ac458e520b92 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:58.615395 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-defadbff-cc28-4441-a308-ac458e520b92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb4b6e4c21f34cbd8d89686ce74fe07a'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:58.616191 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-defadbff-cc28-4441-a308-ac458e520b92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb4b6e4c21f34cbd8d89686ce74fe07a'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:58.616960 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-defadbff-cc28-4441-a308-ac458e520b92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb4b6e4c21f34cbd8d89686ce74fe07a'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:58.627033 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-defadbff-cc28-4441-a308-ac458e520b92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb4b6e4c21f34cbd8d89686ce74fe07a'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:58.637643 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-defadbff-cc28-4441-a308-ac458e520b92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb4b6e4c21f34cbd8d89686ce74fe07a'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:58.658897 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1360/2714] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:06:58 2022] DELETE /identity/v3/users/cb4b6e4c21f34cbd8d89686ce74fe07a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:58.880917 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93afed-075f-4c0d-a840-8b99a18f3a3e service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:58.901350 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93afed-075f-4c0d-a840-8b99a18f3a3e service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:58.969885 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2830efb-7a78-4d25-911e-9990e02f95d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:58.970770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2830efb-7a78-4d25-911e-9990e02f95d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:58.971045 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2830efb-7a78-4d25-911e-9990e02f95d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:58.971316 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2830efb-7a78-4d25-911e-9990e02f95d5 admin admin] PATH_INFO: `/v3/projects/a20883c8bb00403490e966953c48afa7` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:58.972977 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2830efb-7a78-4d25-911e-9990e02f95d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a20883c8bb00403490e966953c48afa7)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:58.975006 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2830efb-7a78-4d25-911e-9990e02f95d5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:59.026664 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a2830efb-7a78-4d25-911e-9990e02f95d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a20883c8bb00403490e966953c48afa7', 'request_id': 'req-a2830efb-7a78-4d25-911e-9990e02f95d5'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:59.033801 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a2830efb-7a78-4d25-911e-9990e02f95d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a20883c8bb00403490e966953c48afa7', 'request_id': 'req-a2830efb-7a78-4d25-911e-9990e02f95d5'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:59.040221 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a2830efb-7a78-4d25-911e-9990e02f95d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a20883c8bb00403490e966953c48afa7', 'request_id': 'req-a2830efb-7a78-4d25-911e-9990e02f95d5'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:59.054469 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a2830efb-7a78-4d25-911e-9990e02f95d5 admin admin] The token cache is being invalidate because project a20883c8bb00403490e966953c48afa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:06:59.054809 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a2830efb-7a78-4d25-911e-9990e02f95d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:59.055521 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-a2830efb-7a78-4d25-911e-9990e02f95d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:59.057154 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1355/2715] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:06:58 2022] DELETE /identity/v3/projects/a20883c8bb00403490e966953c48afa7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:59.063614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a59a8-4656-4135-88c0-59061717afb8 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:59.063947 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a59a8-4656-4135-88c0-59061717afb8 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:59.064158 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a59a8-4656-4135-88c0-59061717afb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:59.085569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-532a59a8-4656-4135-88c0-59061717afb8 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:59.086997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-532a59a8-4656-4135-88c0-59061717afb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:59.151977 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1361/2716] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:06:59 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:59.160715 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accfb3f-1084-42e0-a0bd-ae6a0872e08e None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:59.161119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accfb3f-1084-42e0-a0bd-ae6a0872e08e None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:59.161440 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accfb3f-1084-42e0-a0bd-ae6a0872e08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:59.182477 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-2accfb3f-1084-42e0-a0bd-ae6a0872e08e None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:59.184397 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-2accfb3f-1084-42e0-a0bd-ae6a0872e08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:59.192768 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1356/2717] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:06:59 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:59.197676 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a59a8-4656-4135-88c0-59061717afb8 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:59.209565 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a59a8-4656-4135-88c0-59061717afb8 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:59.218093 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c2332-2da7-4535-aa1a-cc2947048f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:59.219261 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c2332-2da7-4535-aa1a-cc2947048f0a admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:59.219756 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c2332-2da7-4535-aa1a-cc2947048f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:59.220245 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c2332-2da7-4535-aa1a-cc2947048f0a admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:59.221687 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c2332-2da7-4535-aa1a-cc2947048f0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:06:59.222242 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c2332-2da7-4535-aa1a-cc2947048f0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:59.224122 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c2332-2da7-4535-aa1a-cc2947048f0a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:59.242585 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1362/2718] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:06:59.248047 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accfb3f-1084-42e0-a0bd-ae6a0872e08e None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:59.257759 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accfb3f-1084-42e0-a0bd-ae6a0872e08e None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:59.263742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f6261-cae4-472b-9254-32aeb1d81266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:59.264425 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f6261-cae4-472b-9254-32aeb1d81266 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:59.264698 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f6261-cae4-472b-9254-32aeb1d81266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:59.265005 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f6261-cae4-472b-9254-32aeb1d81266 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:59.265725 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f6261-cae4-472b-9254-32aeb1d81266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:59.267772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f6261-cae4-472b-9254-32aeb1d81266 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:59.296959 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1357/2719] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:06:59 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:06:59.301900 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c2332-2da7-4535-aa1a-cc2947048f0a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:59.313118 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c2332-2da7-4535-aa1a-cc2947048f0a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:59.405174 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a0af8-6269-4766-9f5c-8ab22a607c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:59.406036 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a0af8-6269-4766-9f5c-8ab22a607c8e admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:59.406421 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a0af8-6269-4766-9f5c-8ab22a607c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:59.406790 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a0af8-6269-4766-9f5c-8ab22a607c8e admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:59.407719 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a0af8-6269-4766-9f5c-8ab22a607c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:59.410850 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a0af8-6269-4766-9f5c-8ab22a607c8e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:59.439279 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1363/2720] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:59 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:06:59.443952 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f6261-cae4-472b-9254-32aeb1d81266 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:59.455734 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f6261-cae4-472b-9254-32aeb1d81266 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:59.461661 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d5729-16be-406f-9728-797a737c7a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:59.462484 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d5729-16be-406f-9728-797a737c7a17 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:59.462833 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d5729-16be-406f-9728-797a737c7a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:59.463174 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d5729-16be-406f-9728-797a737c7a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:59.464520 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d5729-16be-406f-9728-797a737c7a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:59.468545 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d5729-16be-406f-9728-797a737c7a17 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:59.491741 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1358/2721] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:59.496006 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a0af8-6269-4766-9f5c-8ab22a607c8e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:59.507984 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a0af8-6269-4766-9f5c-8ab22a607c8e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:59.514877 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2e7c5-f79a-4b26-8c07-fbb68a541a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:59.515791 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2e7c5-f79a-4b26-8c07-fbb68a541a89 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:59.516070 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2e7c5-f79a-4b26-8c07-fbb68a541a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:59.516352 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2e7c5-f79a-4b26-8c07-fbb68a541a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:59.517138 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2e7c5-f79a-4b26-8c07-fbb68a541a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:59.518914 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2e7c5-f79a-4b26-8c07-fbb68a541a89 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:59.533140 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1364/2722] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:59.538990 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d5729-16be-406f-9728-797a737c7a17 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:59.551024 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d5729-16be-406f-9728-797a737c7a17 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:59.556318 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685e0ef-dff0-42d9-935a-f2259ae0896f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:59.557281 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685e0ef-dff0-42d9-935a-f2259ae0896f admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:59.557585 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685e0ef-dff0-42d9-935a-f2259ae0896f admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:59.557801 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685e0ef-dff0-42d9-935a-f2259ae0896f admin admin] PATH_INFO: `/v3/projects/fb13a48ae3b841c594597c09cc15a453/users/564f04f73a0f4f5aa0131dad11ff91ed/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:59.577295 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685e0ef-dff0-42d9-935a-f2259ae0896f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb13a48ae3b841c594597c09cc15a453, user_id=564f04f73a0f4f5aa0131dad11ff91ed, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:59.580919 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685e0ef-dff0-42d9-935a-f2259ae0896f admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:59.598827 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1359/2723] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:59 2022] PUT /identity/v3/projects/fb13a48ae3b841c594597c09cc15a453/users/564f04f73a0f4f5aa0131dad11ff91ed/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:06:59.618640 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6fc3f-b451-4ef8-8634-5b5b85238e41 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:59.618999 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6fc3f-b451-4ef8-8634-5b5b85238e41 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:59.619440 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6fc3f-b451-4ef8-8634-5b5b85238e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:59.650087 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-4dc6fc3f-b451-4ef8-8634-5b5b85238e41 None None] MFA Rules not processed for user `564f04f73a0f4f5aa0131dad11ff91ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:59.651320 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-4dc6fc3f-b451-4ef8-8634-5b5b85238e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:59.727737 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1365/2724] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:06:59 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:59.749917 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685e0ef-dff0-42d9-935a-f2259ae0896f admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:59.751814 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-5685e0ef-dff0-42d9-935a-f2259ae0896f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:59.833334 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685e0ef-dff0-42d9-935a-f2259ae0896f admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:59.839089 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00001c32-7198-4738-b84a-66ff5126b28e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85f5db9c3c47fca68ebab33b0bb73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:59.839762 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00001c32-7198-4738-b84a-66ff5126b28e service nova] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:59.840711 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00001c32-7198-4738-b84a-66ff5126b28e service nova] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:59.841026 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00001c32-7198-4738-b84a-66ff5126b28e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:59.850196 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00001c32-7198-4738-b84a-66ff5126b28e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:59.851947 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00001c32-7198-4738-b84a-66ff5126b28e service nova] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:59.862035 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1360/2725] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:59 2022] GET /identity/v3/auth/tokens => generated 3391 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:06:59.933423 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6fc3f-b451-4ef8-8634-5b5b85238e41 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:59.935443 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-4dc6fc3f-b451-4ef8-8634-5b5b85238e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:59.999919 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6fc3f-b451-4ef8-8634-5b5b85238e41 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:00.004281 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ecbd5-3eab-4afd-a540-a69ea78a570f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:00.005050 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ecbd5-3eab-4afd-a540-a69ea78a570f service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:00.005342 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ecbd5-3eab-4afd-a540-a69ea78a570f service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:00.005605 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ecbd5-3eab-4afd-a540-a69ea78a570f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:00.007459 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-2e9ecbd5-3eab-4afd-a540-a69ea78a570f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:00.024113 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ecbd5-3eab-4afd-a540-a69ea78a570f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:00.025922 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ecbd5-3eab-4afd-a540-a69ea78a570f service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:00.040387 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1366/2726] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:59 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:00.118753 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00001c32-7198-4738-b84a-66ff5126b28e service nova] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:00.120232 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-00001c32-7198-4738-b84a-66ff5126b28e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:00.134605 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00001c32-7198-4738-b84a-66ff5126b28e service nova] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:00.138797 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338bbe4-eb63-450d-ad8b-854a6eb7fd3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:00.139455 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338bbe4-eb63-450d-ad8b-854a6eb7fd3d service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:00.139735 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338bbe4-eb63-450d-ad8b-854a6eb7fd3d service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:00.140007 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338bbe4-eb63-450d-ad8b-854a6eb7fd3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:00.141958 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-8338bbe4-eb63-450d-ad8b-854a6eb7fd3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:00.157307 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338bbe4-eb63-450d-ad8b-854a6eb7fd3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:00.158774 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338bbe4-eb63-450d-ad8b-854a6eb7fd3d service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:00.172903 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1361/2727] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:00 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:00.260994 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ecbd5-3eab-4afd-a540-a69ea78a570f service cinder] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:00.353526 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ecbd5-3eab-4afd-a540-a69ea78a570f service cinder] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:00.359209 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a60e7-7a47-4ccd-acfc-8f23de940644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:00.360092 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a60e7-7a47-4ccd-acfc-8f23de940644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:00.360367 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a60e7-7a47-4ccd-acfc-8f23de940644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:00.360637 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a60e7-7a47-4ccd-acfc-8f23de940644 admin admin] PATH_INFO: `/v3/users/564f04f73a0f4f5aa0131dad11ff91ed` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:00.361941 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a60e7-7a47-4ccd-acfc-8f23de940644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=564f04f73a0f4f5aa0131dad11ff91ed)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:00.364195 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a60e7-7a47-4ccd-acfc-8f23de940644 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:00.428830 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f35a60e7-7a47-4ccd-acfc-8f23de940644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564f04f73a0f4f5aa0131dad11ff91ed'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:00.429780 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f35a60e7-7a47-4ccd-acfc-8f23de940644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564f04f73a0f4f5aa0131dad11ff91ed'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:00.430717 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f35a60e7-7a47-4ccd-acfc-8f23de940644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564f04f73a0f4f5aa0131dad11ff91ed'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:00.442793 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f35a60e7-7a47-4ccd-acfc-8f23de940644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564f04f73a0f4f5aa0131dad11ff91ed'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:00.457457 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-f35a60e7-7a47-4ccd-acfc-8f23de940644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564f04f73a0f4f5aa0131dad11ff91ed'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:00.478980 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1367/2728] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:00 2022] DELETE /identity/v3/users/564f04f73a0f4f5aa0131dad11ff91ed => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:00.484894 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d701dd3-280a-4617-951d-c03d3f2150c7 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:00.485390 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d701dd3-280a-4617-951d-c03d3f2150c7 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:00.485877 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d701dd3-280a-4617-951d-c03d3f2150c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:00.517417 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-7d701dd3-280a-4617-951d-c03d3f2150c7 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:00.519397 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-7d701dd3-280a-4617-951d-c03d3f2150c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:00.599213 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1362/2729] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:00 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:00.610793 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a60e7-7a47-4ccd-acfc-8f23de940644 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:00.612335 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-f35a60e7-7a47-4ccd-acfc-8f23de940644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:00.713862 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a60e7-7a47-4ccd-acfc-8f23de940644 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:00.719565 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03acf15-9f07-4ae8-b847-da64923ca3da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:00.720314 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03acf15-9f07-4ae8-b847-da64923ca3da service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:00.720755 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03acf15-9f07-4ae8-b847-da64923ca3da service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:00.721136 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03acf15-9f07-4ae8-b847-da64923ca3da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:00.733123 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03acf15-9f07-4ae8-b847-da64923ca3da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:00.734622 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03acf15-9f07-4ae8-b847-da64923ca3da service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:00.745490 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1368/2730] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:00 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:01.112691 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d701dd3-280a-4617-951d-c03d3f2150c7 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:01.115127 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-7d701dd3-280a-4617-951d-c03d3f2150c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:01.139598 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d701dd3-280a-4617-951d-c03d3f2150c7 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:01.144641 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144914f-2fa2-419f-81e3-1ce1a1a40d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:01.145560 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144914f-2fa2-419f-81e3-1ce1a1a40d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:01.145839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144914f-2fa2-419f-81e3-1ce1a1a40d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:01.146134 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144914f-2fa2-419f-81e3-1ce1a1a40d89 admin admin] PATH_INFO: `/v3/projects/fb13a48ae3b841c594597c09cc15a453` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:01.147743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144914f-2fa2-419f-81e3-1ce1a1a40d89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb13a48ae3b841c594597c09cc15a453)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:01.150020 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144914f-2fa2-419f-81e3-1ce1a1a40d89 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:01.207892 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6144914f-2fa2-419f-81e3-1ce1a1a40d89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb13a48ae3b841c594597c09cc15a453', 'request_id': 'req-6144914f-2fa2-419f-81e3-1ce1a1a40d89'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:01.215020 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6144914f-2fa2-419f-81e3-1ce1a1a40d89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb13a48ae3b841c594597c09cc15a453', 'request_id': 'req-6144914f-2fa2-419f-81e3-1ce1a1a40d89'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:01.221233 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6144914f-2fa2-419f-81e3-1ce1a1a40d89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb13a48ae3b841c594597c09cc15a453', 'request_id': 'req-6144914f-2fa2-419f-81e3-1ce1a1a40d89'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:01.236829 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6144914f-2fa2-419f-81e3-1ce1a1a40d89 admin admin] The token cache is being invalidate because project fb13a48ae3b841c594597c09cc15a453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:01.237202 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6144914f-2fa2-419f-81e3-1ce1a1a40d89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:01.237960 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-6144914f-2fa2-419f-81e3-1ce1a1a40d89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:01.239686 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1363/2731] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:01 2022] DELETE /identity/v3/projects/fb13a48ae3b841c594597c09cc15a453 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:01.246761 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b9599-b332-45c0-960e-7769789b7434 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:01.247122 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b9599-b332-45c0-960e-7769789b7434 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:01.247393 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b9599-b332-45c0-960e-7769789b7434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:01.267989 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-4d3b9599-b332-45c0-960e-7769789b7434 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:01.269290 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-4d3b9599-b332-45c0-960e-7769789b7434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:01.341379 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1369/2732] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:01 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:01.350714 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79fd30-537d-4cc2-83a8-0c122184b5b2 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:01.351090 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79fd30-537d-4cc2-83a8-0c122184b5b2 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:01.351488 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79fd30-537d-4cc2-83a8-0c122184b5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:01.373356 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-4e79fd30-537d-4cc2-83a8-0c122184b5b2 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:01.374599 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-4e79fd30-537d-4cc2-83a8-0c122184b5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:01.383152 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1364/2733] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:01 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:01.387811 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b9599-b332-45c0-960e-7769789b7434 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:01.398170 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b9599-b332-45c0-960e-7769789b7434 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:01.403249 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db4503-a33c-4b86-9e84-dee1f1090e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:01.403932 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db4503-a33c-4b86-9e84-dee1f1090e04 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:01.404217 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db4503-a33c-4b86-9e84-dee1f1090e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:01.404484 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db4503-a33c-4b86-9e84-dee1f1090e04 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:01.405280 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db4503-a33c-4b86-9e84-dee1f1090e04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:07:01.405589 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db4503-a33c-4b86-9e84-dee1f1090e04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:01.407315 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db4503-a33c-4b86-9e84-dee1f1090e04 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:01.421867 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1370/2734] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:07:01.427016 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79fd30-537d-4cc2-83a8-0c122184b5b2 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:01.437940 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79fd30-537d-4cc2-83a8-0c122184b5b2 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:01.443984 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742c88e-7c7e-420d-ac89-289e9fbeced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:01.444945 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742c88e-7c7e-420d-ac89-289e9fbeced4 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:01.445276 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742c88e-7c7e-420d-ac89-289e9fbeced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:01.445594 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742c88e-7c7e-420d-ac89-289e9fbeced4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:01.446496 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742c88e-7c7e-420d-ac89-289e9fbeced4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:01.448510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742c88e-7c7e-420d-ac89-289e9fbeced4 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:01.477599 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1365/2735] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:01 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:01.482716 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db4503-a33c-4b86-9e84-dee1f1090e04 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:01.493812 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db4503-a33c-4b86-9e84-dee1f1090e04 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:01.575203 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a94858-4d10-4203-a20f-17e1ed186d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:01.575889 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a94858-4d10-4203-a20f-17e1ed186d44 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:01.576168 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a94858-4d10-4203-a20f-17e1ed186d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:01.576440 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a94858-4d10-4203-a20f-17e1ed186d44 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:01.577204 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a94858-4d10-4203-a20f-17e1ed186d44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:01.579205 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a94858-4d10-4203-a20f-17e1ed186d44 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:01.603117 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1371/2736] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:01 2022] POST /identity/v3/users => generated 303 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:01.607456 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742c88e-7c7e-420d-ac89-289e9fbeced4 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:01.620722 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742c88e-7c7e-420d-ac89-289e9fbeced4 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:01.627248 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414070a3-2673-4801-a897-73c8b6d54edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:01.628147 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414070a3-2673-4801-a897-73c8b6d54edb admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:01.628509 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414070a3-2673-4801-a897-73c8b6d54edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:01.628965 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414070a3-2673-4801-a897-73c8b6d54edb admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:01.629932 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414070a3-2673-4801-a897-73c8b6d54edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:01.631859 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414070a3-2673-4801-a897-73c8b6d54edb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:01.646175 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1366/2737] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:01.651054 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a94858-4d10-4203-a20f-17e1ed186d44 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:01.663040 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a94858-4d10-4203-a20f-17e1ed186d44 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:01.669539 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc204d-521c-4f2d-8050-17c72536a432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:01.670224 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc204d-521c-4f2d-8050-17c72536a432 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:01.670504 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc204d-521c-4f2d-8050-17c72536a432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:01.670776 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc204d-521c-4f2d-8050-17c72536a432 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:01.671516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc204d-521c-4f2d-8050-17c72536a432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:01.673229 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc204d-521c-4f2d-8050-17c72536a432 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:01.685463 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1372/2738] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:01.692382 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414070a3-2673-4801-a897-73c8b6d54edb admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:01.710246 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414070a3-2673-4801-a897-73c8b6d54edb admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:01.720106 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e6057-d5d8-4894-b8e3-3bba6569dd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:01.721724 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e6057-d5d8-4894-b8e3-3bba6569dd07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:01.722245 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e6057-d5d8-4894-b8e3-3bba6569dd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:01.722767 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e6057-d5d8-4894-b8e3-3bba6569dd07 admin admin] PATH_INFO: `/v3/projects/8ff864b571a44427959cf9fd0f496cbf/users/11950bb83fbf4213828f7af0d8d53d5b/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:01.752242 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e6057-d5d8-4894-b8e3-3bba6569dd07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff864b571a44427959cf9fd0f496cbf, user_id=11950bb83fbf4213828f7af0d8d53d5b, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:01.757761 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e6057-d5d8-4894-b8e3-3bba6569dd07 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:01.781929 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1367/2739] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:01 2022] PUT /identity/v3/projects/8ff864b571a44427959cf9fd0f496cbf/users/11950bb83fbf4213828f7af0d8d53d5b/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:01.789607 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1f7de-8b09-487a-857e-4a67e6e97bc4 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:01.789877 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1f7de-8b09-487a-857e-4a67e6e97bc4 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:01.790150 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1f7de-8b09-487a-857e-4a67e6e97bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:01.811544 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-bab1f7de-8b09-487a-857e-4a67e6e97bc4 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:01.812923 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-bab1f7de-8b09-487a-857e-4a67e6e97bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:01.884429 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1373/2740] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:01 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:01.895317 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e6057-d5d8-4894-b8e3-3bba6569dd07 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:01.897148 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b03e6057-d5d8-4894-b8e3-3bba6569dd07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:01.970183 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e6057-d5d8-4894-b8e3-3bba6569dd07 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:01.975111 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf9cae-c13f-4725-a9b7-a35b2afb2ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:01.975851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf9cae-c13f-4725-a9b7-a35b2afb2ced service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:01.976196 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf9cae-c13f-4725-a9b7-a35b2afb2ced service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:01.976506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf9cae-c13f-4725-a9b7-a35b2afb2ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:01.986895 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf9cae-c13f-4725-a9b7-a35b2afb2ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:01.988616 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf9cae-c13f-4725-a9b7-a35b2afb2ced service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:02.001459 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1368/2741] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:01 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:02.926710 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94c0ac-9ebd-4a84-8915-f69e0100a068 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:02.928115 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94c0ac-9ebd-4a84-8915-f69e0100a068 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:02.928596 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94c0ac-9ebd-4a84-8915-f69e0100a068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:02.977919 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-7d94c0ac-9ebd-4a84-8915-f69e0100a068 None None] MFA Rules not processed for user `11950bb83fbf4213828f7af0d8d53d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:02.979174 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-7d94c0ac-9ebd-4a84-8915-f69e0100a068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:03.060349 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1374/2742] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:02 2022] POST /identity/v3/auth/tokens => generated 3425 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:03.066129 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf9cae-c13f-4725-a9b7-a35b2afb2ced service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:03.082791 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf9cae-c13f-4725-a9b7-a35b2afb2ced service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:03.088415 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5077e-e785-4e56-8226-727c28887b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:03.089345 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5077e-e785-4e56-8226-727c28887b50 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:03.089838 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5077e-e785-4e56-8226-727c28887b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:03.090774 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5077e-e785-4e56-8226-727c28887b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:03.091683 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5077e-e785-4e56-8226-727c28887b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:03.093968 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5077e-e785-4e56-8226-727c28887b50 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:03.142849 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1369/2743] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:03 2022] POST /identity/v3/projects => generated 405 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:03.144285 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94c0ac-9ebd-4a84-8915-f69e0100a068 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:03.157375 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94c0ac-9ebd-4a84-8915-f69e0100a068 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:03.247415 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a297aa-fdf1-4474-bc62-9704b5249c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:03.248317 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a297aa-fdf1-4474-bc62-9704b5249c48 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:03.248596 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a297aa-fdf1-4474-bc62-9704b5249c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:03.248900 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a297aa-fdf1-4474-bc62-9704b5249c48 admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:03.249589 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a297aa-fdf1-4474-bc62-9704b5249c48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:03.251523 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a297aa-fdf1-4474-bc62-9704b5249c48 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:03.274977 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1375/2744] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:03 2022] POST /identity/v3/users => generated 309 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:03.279651 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5077e-e785-4e56-8226-727c28887b50 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:03.290852 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5077e-e785-4e56-8226-727c28887b50 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:03.295860 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5644c96-c8e8-470e-a667-400a71ccaa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:03.296573 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5644c96-c8e8-470e-a667-400a71ccaa1e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:03.296945 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5644c96-c8e8-470e-a667-400a71ccaa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:03.297262 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5644c96-c8e8-470e-a667-400a71ccaa1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:03.298043 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5644c96-c8e8-470e-a667-400a71ccaa1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:03.299881 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5644c96-c8e8-470e-a667-400a71ccaa1e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:03.312993 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1370/2745] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:03.318807 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a297aa-fdf1-4474-bc62-9704b5249c48 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:03.337131 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a297aa-fdf1-4474-bc62-9704b5249c48 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:03.342822 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f999db7-7900-4cfb-9e4b-7ded5f0ade43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:03.343867 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f999db7-7900-4cfb-9e4b-7ded5f0ade43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:03.344076 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f999db7-7900-4cfb-9e4b-7ded5f0ade43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:03.344443 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f999db7-7900-4cfb-9e4b-7ded5f0ade43 admin admin] PATH_INFO: `/v3/projects/ae2ac6b1b5d44290bd4bebb4b684216e/users/63327506140f4c038c4231b158c5e4e2/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:03.361999 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f999db7-7900-4cfb-9e4b-7ded5f0ade43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae2ac6b1b5d44290bd4bebb4b684216e, user_id=63327506140f4c038c4231b158c5e4e2, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:03.364726 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f999db7-7900-4cfb-9e4b-7ded5f0ade43 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:03.381477 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1376/2746] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:03 2022] PUT /identity/v3/projects/ae2ac6b1b5d44290bd4bebb4b684216e/users/63327506140f4c038c4231b158c5e4e2/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:03.385810 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5644c96-c8e8-470e-a667-400a71ccaa1e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:03.397415 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5644c96-c8e8-470e-a667-400a71ccaa1e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:03.462258 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870108a-e8cd-46c8-bc73-8e1187d9dcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:03.462943 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870108a-e8cd-46c8-bc73-8e1187d9dcee admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:03.463279 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870108a-e8cd-46c8-bc73-8e1187d9dcee admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:03.463557 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870108a-e8cd-46c8-bc73-8e1187d9dcee admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:03.464303 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870108a-e8cd-46c8-bc73-8e1187d9dcee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:03.466593 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870108a-e8cd-46c8-bc73-8e1187d9dcee admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:03.478534 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1371/2747] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:03.484061 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f999db7-7900-4cfb-9e4b-7ded5f0ade43 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:03.495530 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f999db7-7900-4cfb-9e4b-7ded5f0ade43 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:03.501527 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5bf4b-6523-43e0-a40e-e82500fa92fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:03.502590 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5bf4b-6523-43e0-a40e-e82500fa92fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:03.502972 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5bf4b-6523-43e0-a40e-e82500fa92fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:03.503347 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5bf4b-6523-43e0-a40e-e82500fa92fd admin admin] PATH_INFO: `/v3/projects/ae2ac6b1b5d44290bd4bebb4b684216e/users/63327506140f4c038c4231b158c5e4e2/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:03.505735 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5bf4b-6523-43e0-a40e-e82500fa92fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae2ac6b1b5d44290bd4bebb4b684216e, user_id=63327506140f4c038c4231b158c5e4e2, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:03.509222 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5bf4b-6523-43e0-a40e-e82500fa92fd admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:03.522920 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1377/2748] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:03 2022] PUT /identity/v3/projects/ae2ac6b1b5d44290bd4bebb4b684216e/users/63327506140f4c038c4231b158c5e4e2/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:04.269555 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb2eb4-ae9e-49d0-912e-4c3785ea43c1 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:04.270428 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb2eb4-ae9e-49d0-912e-4c3785ea43c1 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:04.270610 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb2eb4-ae9e-49d0-912e-4c3785ea43c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:04.312763 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-9fbb2eb4-ae9e-49d0-912e-4c3785ea43c1 None None] MFA Rules not processed for user `63327506140f4c038c4231b158c5e4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:04.314839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-9fbb2eb4-ae9e-49d0-912e-4c3785ea43c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:04.428096 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1372/2749] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:04 2022] POST /identity/v3/auth/tokens => generated 3492 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:05.684378 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5bf4b-6523-43e0-a40e-e82500fa92fd admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:05.768528 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5bf4b-6523-43e0-a40e-e82500fa92fd admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:05.773607 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a4363-8ca7-4b0a-9f9e-d5e6a5d5c888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:05.774509 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a4363-8ca7-4b0a-9f9e-d5e6a5d5c888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:05.774791 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a4363-8ca7-4b0a-9f9e-d5e6a5d5c888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:05.775065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a4363-8ca7-4b0a-9f9e-d5e6a5d5c888 admin admin] PATH_INFO: `/v3/users/11950bb83fbf4213828f7af0d8d53d5b` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:05.776360 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a4363-8ca7-4b0a-9f9e-d5e6a5d5c888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11950bb83fbf4213828f7af0d8d53d5b)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:05.778962 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a4363-8ca7-4b0a-9f9e-d5e6a5d5c888 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:05.834583 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9b4a4363-8ca7-4b0a-9f9e-d5e6a5d5c888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11950bb83fbf4213828f7af0d8d53d5b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:05.835264 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9b4a4363-8ca7-4b0a-9f9e-d5e6a5d5c888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11950bb83fbf4213828f7af0d8d53d5b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:05.835886 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9b4a4363-8ca7-4b0a-9f9e-d5e6a5d5c888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11950bb83fbf4213828f7af0d8d53d5b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:05.844944 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9b4a4363-8ca7-4b0a-9f9e-d5e6a5d5c888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11950bb83fbf4213828f7af0d8d53d5b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:05.853357 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-9b4a4363-8ca7-4b0a-9f9e-d5e6a5d5c888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11950bb83fbf4213828f7af0d8d53d5b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:05.874708 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1378/2750] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:05 2022] DELETE /identity/v3/users/11950bb83fbf4213828f7af0d8d53d5b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:06.112310 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb2eb4-ae9e-49d0-912e-4c3785ea43c1 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:06.125701 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb2eb4-ae9e-49d0-912e-4c3785ea43c1 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:06.192960 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cb5c1-4c9f-4726-a5e0-eb25a7275519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:06.193980 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cb5c1-4c9f-4726-a5e0-eb25a7275519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:06.194376 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cb5c1-4c9f-4726-a5e0-eb25a7275519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:06.194756 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cb5c1-4c9f-4726-a5e0-eb25a7275519 admin admin] PATH_INFO: `/v3/projects/8ff864b571a44427959cf9fd0f496cbf` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:06.196180 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cb5c1-4c9f-4726-a5e0-eb25a7275519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ff864b571a44427959cf9fd0f496cbf)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:06.198404 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cb5c1-4c9f-4726-a5e0-eb25a7275519 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:06.253282 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e83cb5c1-4c9f-4726-a5e0-eb25a7275519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ff864b571a44427959cf9fd0f496cbf', 'request_id': 'req-e83cb5c1-4c9f-4726-a5e0-eb25a7275519'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:06.260008 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e83cb5c1-4c9f-4726-a5e0-eb25a7275519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ff864b571a44427959cf9fd0f496cbf', 'request_id': 'req-e83cb5c1-4c9f-4726-a5e0-eb25a7275519'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:06.267166 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e83cb5c1-4c9f-4726-a5e0-eb25a7275519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ff864b571a44427959cf9fd0f496cbf', 'request_id': 'req-e83cb5c1-4c9f-4726-a5e0-eb25a7275519'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:06.282524 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e83cb5c1-4c9f-4726-a5e0-eb25a7275519 admin admin] The token cache is being invalidate because project 8ff864b571a44427959cf9fd0f496cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:06.282870 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e83cb5c1-4c9f-4726-a5e0-eb25a7275519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:06.283642 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-e83cb5c1-4c9f-4726-a5e0-eb25a7275519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:06.285795 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1373/2751] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:06 2022] DELETE /identity/v3/projects/8ff864b571a44427959cf9fd0f496cbf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:06.290266 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a4363-8ca7-4b0a-9f9e-d5e6a5d5c888 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:06.291829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-9b4a4363-8ca7-4b0a-9f9e-d5e6a5d5c888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:06.305961 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a4363-8ca7-4b0a-9f9e-d5e6a5d5c888 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:06.376116 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cc067-597c-4492-b7c6-3f49a162c12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:06.377063 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cc067-597c-4492-b7c6-3f49a162c12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:06.377345 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cc067-597c-4492-b7c6-3f49a162c12e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:06.377614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cc067-597c-4492-b7c6-3f49a162c12e admin admin] PATH_INFO: `/v3/users/63327506140f4c038c4231b158c5e4e2` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:06.378967 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cc067-597c-4492-b7c6-3f49a162c12e admin admin] RBAC: Authorizing `identity:delete_user(user_id=63327506140f4c038c4231b158c5e4e2)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:06.381325 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cc067-597c-4492-b7c6-3f49a162c12e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:06.450250 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-137cc067-597c-4492-b7c6-3f49a162c12e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63327506140f4c038c4231b158c5e4e2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:06.450998 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-137cc067-597c-4492-b7c6-3f49a162c12e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63327506140f4c038c4231b158c5e4e2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:06.451673 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-137cc067-597c-4492-b7c6-3f49a162c12e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63327506140f4c038c4231b158c5e4e2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:06.462023 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-137cc067-597c-4492-b7c6-3f49a162c12e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63327506140f4c038c4231b158c5e4e2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:06.474855 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-137cc067-597c-4492-b7c6-3f49a162c12e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63327506140f4c038c4231b158c5e4e2'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:06.494413 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1379/2752] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:06 2022] DELETE /identity/v3/users/63327506140f4c038c4231b158c5e4e2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:06.711284 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cb5c1-4c9f-4726-a5e0-eb25a7275519 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:06.713670 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-e83cb5c1-4c9f-4726-a5e0-eb25a7275519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:06.731999 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cb5c1-4c9f-4726-a5e0-eb25a7275519 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:06.803504 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83970553-1dfe-4e1f-9784-1daaa6a7902a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:06.804537 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83970553-1dfe-4e1f-9784-1daaa6a7902a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:06.804976 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83970553-1dfe-4e1f-9784-1daaa6a7902a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:06.805345 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83970553-1dfe-4e1f-9784-1daaa6a7902a admin admin] PATH_INFO: `/v3/projects/ae2ac6b1b5d44290bd4bebb4b684216e` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:06.806846 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83970553-1dfe-4e1f-9784-1daaa6a7902a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae2ac6b1b5d44290bd4bebb4b684216e)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:06.809983 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83970553-1dfe-4e1f-9784-1daaa6a7902a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:06.862203 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-83970553-1dfe-4e1f-9784-1daaa6a7902a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae2ac6b1b5d44290bd4bebb4b684216e', 'request_id': 'req-83970553-1dfe-4e1f-9784-1daaa6a7902a'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:06.868924 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-83970553-1dfe-4e1f-9784-1daaa6a7902a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae2ac6b1b5d44290bd4bebb4b684216e', 'request_id': 'req-83970553-1dfe-4e1f-9784-1daaa6a7902a'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:06.875228 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-83970553-1dfe-4e1f-9784-1daaa6a7902a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae2ac6b1b5d44290bd4bebb4b684216e', 'request_id': 'req-83970553-1dfe-4e1f-9784-1daaa6a7902a'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:06.889518 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-83970553-1dfe-4e1f-9784-1daaa6a7902a admin admin] The token cache is being invalidate because project ae2ac6b1b5d44290bd4bebb4b684216e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:06.889803 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-83970553-1dfe-4e1f-9784-1daaa6a7902a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:06.890474 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-83970553-1dfe-4e1f-9784-1daaa6a7902a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:06.892088 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1374/2753] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:06 2022] DELETE /identity/v3/projects/ae2ac6b1b5d44290bd4bebb4b684216e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:06.898634 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22111a6c-6780-4421-8661-0bc5a95475c4 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:06.899230 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22111a6c-6780-4421-8661-0bc5a95475c4 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:06.899230 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22111a6c-6780-4421-8661-0bc5a95475c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:06.921080 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-22111a6c-6780-4421-8661-0bc5a95475c4 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:06.922487 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-22111a6c-6780-4421-8661-0bc5a95475c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:06.991951 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1380/2754] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:06 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:07.000623 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42516cfe-e408-4b31-84fb-ecf2f7bbdc40 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:07.000995 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42516cfe-e408-4b31-84fb-ecf2f7bbdc40 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:07.001320 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42516cfe-e408-4b31-84fb-ecf2f7bbdc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:07.021363 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-42516cfe-e408-4b31-84fb-ecf2f7bbdc40 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:07.022689 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-42516cfe-e408-4b31-84fb-ecf2f7bbdc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:07.033094 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1375/2755] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:06 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:07.037972 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22111a6c-6780-4421-8661-0bc5a95475c4 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:07.048773 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22111a6c-6780-4421-8661-0bc5a95475c4 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:07.054171 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba462f-4a67-4a69-9cc6-05856a24a2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:07.054916 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba462f-4a67-4a69-9cc6-05856a24a2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:07.055326 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba462f-4a67-4a69-9cc6-05856a24a2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:07.055653 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba462f-4a67-4a69-9cc6-05856a24a2d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:07.056446 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba462f-4a67-4a69-9cc6-05856a24a2d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:07:07.056905 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba462f-4a67-4a69-9cc6-05856a24a2d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:07.058637 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba462f-4a67-4a69-9cc6-05856a24a2d5 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:07.072113 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1381/2756] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:07:07.077431 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42516cfe-e408-4b31-84fb-ecf2f7bbdc40 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:07.087429 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42516cfe-e408-4b31-84fb-ecf2f7bbdc40 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:07.093095 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd3af6-7d90-49f7-9829-2df07f14c501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:07.093835 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd3af6-7d90-49f7-9829-2df07f14c501 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:07.094119 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd3af6-7d90-49f7-9829-2df07f14c501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:07.094394 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd3af6-7d90-49f7-9829-2df07f14c501 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:07.095114 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd3af6-7d90-49f7-9829-2df07f14c501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:07.097116 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd3af6-7d90-49f7-9829-2df07f14c501 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:07.138954 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1376/2757] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:07 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:07:07.143867 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba462f-4a67-4a69-9cc6-05856a24a2d5 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:07.155211 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba462f-4a67-4a69-9cc6-05856a24a2d5 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:07.221414 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048f665-9142-4d19-8778-0bce0ca3b72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:07.222313 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048f665-9142-4d19-8778-0bce0ca3b72f admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:07.222780 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048f665-9142-4d19-8778-0bce0ca3b72f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:07.223173 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048f665-9142-4d19-8778-0bce0ca3b72f admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:07.224004 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048f665-9142-4d19-8778-0bce0ca3b72f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:07.226172 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048f665-9142-4d19-8778-0bce0ca3b72f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:07.250252 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1382/2758] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:07 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:07.254955 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd3af6-7d90-49f7-9829-2df07f14c501 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:07.266482 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd3af6-7d90-49f7-9829-2df07f14c501 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:07.271375 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b9d98-94d9-4164-a0ff-18cf46131d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:07.272063 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b9d98-94d9-4164-a0ff-18cf46131d58 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:07.272352 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b9d98-94d9-4164-a0ff-18cf46131d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:07.272617 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b9d98-94d9-4164-a0ff-18cf46131d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:07.273381 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b9d98-94d9-4164-a0ff-18cf46131d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:07.274993 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b9d98-94d9-4164-a0ff-18cf46131d58 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:07.287874 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1377/2759] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:07.292251 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048f665-9142-4d19-8778-0bce0ca3b72f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:07.303837 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048f665-9142-4d19-8778-0bce0ca3b72f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:07.309607 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6e348-553e-4f6c-b30c-3d4997dadcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:07.310507 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6e348-553e-4f6c-b30c-3d4997dadcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:07.310780 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6e348-553e-4f6c-b30c-3d4997dadcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:07.311049 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6e348-553e-4f6c-b30c-3d4997dadcb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:07.311780 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6e348-553e-4f6c-b30c-3d4997dadcb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:07.313496 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6e348-553e-4f6c-b30c-3d4997dadcb6 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:07.326416 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1383/2760] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:07:07.331152 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b9d98-94d9-4164-a0ff-18cf46131d58 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:07.342813 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b9d98-94d9-4164-a0ff-18cf46131d58 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:07.347858 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6d247-9984-432f-9e09-887c0246b191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:07.348786 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6d247-9984-432f-9e09-887c0246b191 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:07.349099 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6d247-9984-432f-9e09-887c0246b191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:07.349378 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6d247-9984-432f-9e09-887c0246b191 admin admin] PATH_INFO: `/v3/projects/52fd32e2e26e4dae9e6ed9de7805264e/users/a43db03c9c434a5aa14ddc53c909342e/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:07.367839 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6d247-9984-432f-9e09-887c0246b191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52fd32e2e26e4dae9e6ed9de7805264e, user_id=a43db03c9c434a5aa14ddc53c909342e, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:07.370643 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6d247-9984-432f-9e09-887c0246b191 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:07.392539 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1378/2761] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:07 2022] PUT /identity/v3/projects/52fd32e2e26e4dae9e6ed9de7805264e/users/a43db03c9c434a5aa14ddc53c909342e/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:07.412642 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95ba72-4b01-480c-9e2b-279231db7727 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:07.412949 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95ba72-4b01-480c-9e2b-279231db7727 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:07.413177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95ba72-4b01-480c-9e2b-279231db7727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:07.445008 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-ef95ba72-4b01-480c-9e2b-279231db7727 None None] MFA Rules not processed for user `a43db03c9c434a5aa14ddc53c909342e`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:07.446377 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-ef95ba72-4b01-480c-9e2b-279231db7727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:07.553543 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1384/2762] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:07 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:07.566323 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6d247-9984-432f-9e09-887c0246b191 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:07.568145 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-98a6d247-9984-432f-9e09-887c0246b191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:07.633857 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6d247-9984-432f-9e09-887c0246b191 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:07.637888 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb21b6b-54e7-4129-a67b-dc86ace2b198 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07298acc960e4154be7c79f2368a1952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:07.638552 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb21b6b-54e7-4129-a67b-dc86ace2b198 service glance] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:07.638837 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb21b6b-54e7-4129-a67b-dc86ace2b198 service glance] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:07.639115 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb21b6b-54e7-4129-a67b-dc86ace2b198 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:07.648611 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb21b6b-54e7-4129-a67b-dc86ace2b198 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:07.650216 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb21b6b-54e7-4129-a67b-dc86ace2b198 service glance] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:07.661199 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1379/2763] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:07 2022] GET /identity/v3/auth/tokens => generated 3395 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:07:23.558366 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95ba72-4b01-480c-9e2b-279231db7727 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:23.638221 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95ba72-4b01-480c-9e2b-279231db7727 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:23.642798 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43dacf-18b7-4d83-9951-260c03ab9498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:23.643678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43dacf-18b7-4d83-9951-260c03ab9498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:23.643959 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43dacf-18b7-4d83-9951-260c03ab9498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:23.644301 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43dacf-18b7-4d83-9951-260c03ab9498 admin admin] PATH_INFO: `/v3/users/a43db03c9c434a5aa14ddc53c909342e` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:23.645548 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43dacf-18b7-4d83-9951-260c03ab9498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43db03c9c434a5aa14ddc53c909342e)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:23.647511 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43dacf-18b7-4d83-9951-260c03ab9498 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:23.703796 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-2a43dacf-18b7-4d83-9951-260c03ab9498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43db03c9c434a5aa14ddc53c909342e'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:23.704487 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-2a43dacf-18b7-4d83-9951-260c03ab9498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43db03c9c434a5aa14ddc53c909342e'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:23.705116 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-2a43dacf-18b7-4d83-9951-260c03ab9498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43db03c9c434a5aa14ddc53c909342e'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:23.714433 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-2a43dacf-18b7-4d83-9951-260c03ab9498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43db03c9c434a5aa14ddc53c909342e'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:23.722377 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-2a43dacf-18b7-4d83-9951-260c03ab9498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43db03c9c434a5aa14ddc53c909342e'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:23.747044 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1385/2764] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:23 2022] DELETE /identity/v3/users/a43db03c9c434a5aa14ddc53c909342e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:23.751882 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa71a1-6661-464a-a30e-74506e556cb3 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:23.752460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa71a1-6661-464a-a30e-74506e556cb3 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:23.752460 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa71a1-6661-464a-a30e-74506e556cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:23.770613 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-caaa71a1-6661-464a-a30e-74506e556cb3 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:23.771848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-caaa71a1-6661-464a-a30e-74506e556cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:23.842951 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1380/2765] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:23 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:23.854939 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43dacf-18b7-4d83-9951-260c03ab9498 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:23.856827 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-2a43dacf-18b7-4d83-9951-260c03ab9498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:23.951899 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43dacf-18b7-4d83-9951-260c03ab9498 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:23.959264 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae314ec-1643-43bf-8312-7a922458b2c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:23.960158 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae314ec-1643-43bf-8312-7a922458b2c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:23.960542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae314ec-1643-43bf-8312-7a922458b2c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:23.960971 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae314ec-1643-43bf-8312-7a922458b2c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:23.973028 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae314ec-1643-43bf-8312-7a922458b2c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:23.974516 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae314ec-1643-43bf-8312-7a922458b2c4 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:23.991460 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1386/2766] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:23 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:24.361321 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa71a1-6661-464a-a30e-74506e556cb3 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:24.363662 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-caaa71a1-6661-464a-a30e-74506e556cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:24.388981 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa71a1-6661-464a-a30e-74506e556cb3 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:24.404334 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2a520-6f71-4753-92f5-b3c05031bd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:24.405261 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2a520-6f71-4753-92f5-b3c05031bd5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:24.405543 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2a520-6f71-4753-92f5-b3c05031bd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:24.405851 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2a520-6f71-4753-92f5-b3c05031bd5c admin admin] PATH_INFO: `/v3/projects/52fd32e2e26e4dae9e6ed9de7805264e` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:24.407105 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2a520-6f71-4753-92f5-b3c05031bd5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=52fd32e2e26e4dae9e6ed9de7805264e)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:24.409972 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2a520-6f71-4753-92f5-b3c05031bd5c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:24.462032 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-89d2a520-6f71-4753-92f5-b3c05031bd5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52fd32e2e26e4dae9e6ed9de7805264e', 'request_id': 'req-89d2a520-6f71-4753-92f5-b3c05031bd5c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:24.469510 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-89d2a520-6f71-4753-92f5-b3c05031bd5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52fd32e2e26e4dae9e6ed9de7805264e', 'request_id': 'req-89d2a520-6f71-4753-92f5-b3c05031bd5c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:24.476143 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-89d2a520-6f71-4753-92f5-b3c05031bd5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52fd32e2e26e4dae9e6ed9de7805264e', 'request_id': 'req-89d2a520-6f71-4753-92f5-b3c05031bd5c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:24.491468 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-89d2a520-6f71-4753-92f5-b3c05031bd5c admin admin] The token cache is being invalidate because project 52fd32e2e26e4dae9e6ed9de7805264e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:24.491767 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-89d2a520-6f71-4753-92f5-b3c05031bd5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:24.492420 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-89d2a520-6f71-4753-92f5-b3c05031bd5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:24.494132 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1381/2767] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:24 2022] DELETE /identity/v3/projects/52fd32e2e26e4dae9e6ed9de7805264e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:24.500896 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3995-0c41-4860-8879-b4b1698bfef2 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:24.501218 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3995-0c41-4860-8879-b4b1698bfef2 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:24.501513 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3995-0c41-4860-8879-b4b1698bfef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:24.522569 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-adae3995-0c41-4860-8879-b4b1698bfef2 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:24.523815 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-adae3995-0c41-4860-8879-b4b1698bfef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:24.594368 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1387/2768] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:24 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:24.602423 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4022a7-9fa2-4c1a-a2bb-d69f19577073 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:24.602702 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4022a7-9fa2-4c1a-a2bb-d69f19577073 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:24.602976 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4022a7-9fa2-4c1a-a2bb-d69f19577073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:24.623390 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-dd4022a7-9fa2-4c1a-a2bb-d69f19577073 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:24.624621 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-dd4022a7-9fa2-4c1a-a2bb-d69f19577073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:24.632748 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1382/2769] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:24 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:24.637774 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae3995-0c41-4860-8879-b4b1698bfef2 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:24.647737 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae3995-0c41-4860-8879-b4b1698bfef2 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:24.653064 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af63e2-fbc5-48a3-a5a3-31c367a702f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:24.653718 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af63e2-fbc5-48a3-a5a3-31c367a702f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:24.653994 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af63e2-fbc5-48a3-a5a3-31c367a702f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:24.654260 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af63e2-fbc5-48a3-a5a3-31c367a702f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:24.654984 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af63e2-fbc5-48a3-a5a3-31c367a702f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:07:24.655292 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af63e2-fbc5-48a3-a5a3-31c367a702f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:24.656892 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af63e2-fbc5-48a3-a5a3-31c367a702f6 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:24.669443 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1388/2770] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:07:24.674027 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4022a7-9fa2-4c1a-a2bb-d69f19577073 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:24.683952 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4022a7-9fa2-4c1a-a2bb-d69f19577073 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:24.688922 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bdb14-408e-4983-adf6-80b7d24ee7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:24.689593 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bdb14-408e-4983-adf6-80b7d24ee7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:24.689889 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bdb14-408e-4983-adf6-80b7d24ee7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:24.690156 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bdb14-408e-4983-adf6-80b7d24ee7a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:24.690849 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bdb14-408e-4983-adf6-80b7d24ee7a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:24.692754 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bdb14-408e-4983-adf6-80b7d24ee7a5 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:24.726278 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1383/2771] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:24 2022] POST /identity/v3/projects => generated 359 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:24.727945 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af63e2-fbc5-48a3-a5a3-31c367a702f6 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:24.740177 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af63e2-fbc5-48a3-a5a3-31c367a702f6 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:24.804315 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc57422-0d72-47de-bcb8-a22c75ea245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:24.804959 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc57422-0d72-47de-bcb8-a22c75ea245e admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:24.805254 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc57422-0d72-47de-bcb8-a22c75ea245e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:24.805534 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc57422-0d72-47de-bcb8-a22c75ea245e admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:24.806217 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc57422-0d72-47de-bcb8-a22c75ea245e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:24.808954 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc57422-0d72-47de-bcb8-a22c75ea245e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:24.832475 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1389/2772] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:24 2022] POST /identity/v3/users => generated 280 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:24.837114 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bdb14-408e-4983-adf6-80b7d24ee7a5 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:24.849405 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bdb14-408e-4983-adf6-80b7d24ee7a5 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:24.855373 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da0b3c-a552-48d1-90b9-e46f5861adeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:24.856064 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da0b3c-a552-48d1-90b9-e46f5861adeb admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:24.856347 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da0b3c-a552-48d1-90b9-e46f5861adeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:24.856652 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da0b3c-a552-48d1-90b9-e46f5861adeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:24.857406 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da0b3c-a552-48d1-90b9-e46f5861adeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:24.859043 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da0b3c-a552-48d1-90b9-e46f5861adeb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:24.872626 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1384/2773] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:24.877065 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc57422-0d72-47de-bcb8-a22c75ea245e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:24.889157 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc57422-0d72-47de-bcb8-a22c75ea245e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:24.894160 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed05002-f82e-4d65-9921-5d5886b17e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:24.894836 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed05002-f82e-4d65-9921-5d5886b17e7d admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:24.895116 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed05002-f82e-4d65-9921-5d5886b17e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:24.895386 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed05002-f82e-4d65-9921-5d5886b17e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:24.896118 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed05002-f82e-4d65-9921-5d5886b17e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:24.897763 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed05002-f82e-4d65-9921-5d5886b17e7d admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:24.910422 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1390/2774] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:07:24.917157 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da0b3c-a552-48d1-90b9-e46f5861adeb admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:24.931841 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da0b3c-a552-48d1-90b9-e46f5861adeb admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:24.937506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7054c4c-a18f-4399-964d-f8b6046c4f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:24.938453 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7054c4c-a18f-4399-964d-f8b6046c4f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:24.938727 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7054c4c-a18f-4399-964d-f8b6046c4f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:24.938999 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7054c4c-a18f-4399-964d-f8b6046c4f47 admin admin] PATH_INFO: `/v3/projects/15022e3d9d01484da44522677fb2d608/users/60ad5123816c4afab719cff25b771c1b/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:24.956961 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7054c4c-a18f-4399-964d-f8b6046c4f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15022e3d9d01484da44522677fb2d608, user_id=60ad5123816c4afab719cff25b771c1b, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:24.959770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7054c4c-a18f-4399-964d-f8b6046c4f47 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:24.974617 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1385/2775] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:24 2022] PUT /identity/v3/projects/15022e3d9d01484da44522677fb2d608/users/60ad5123816c4afab719cff25b771c1b/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:24.992777 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf628ae0-1abb-4659-9c19-58eba302363f None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:24.993246 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf628ae0-1abb-4659-9c19-58eba302363f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:24.993647 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf628ae0-1abb-4659-9c19-58eba302363f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:25.037253 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-bf628ae0-1abb-4659-9c19-58eba302363f None None] MFA Rules not processed for user `60ad5123816c4afab719cff25b771c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:25.039193 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-bf628ae0-1abb-4659-9c19-58eba302363f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:25.147644 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1391/2776] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:24 2022] POST /identity/v3/auth/tokens => generated 3379 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:25.181032 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7054c4c-a18f-4399-964d-f8b6046c4f47 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:25.184277 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b7054c4c-a18f-4399-964d-f8b6046c4f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:25.250553 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7054c4c-a18f-4399-964d-f8b6046c4f47 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:25.254577 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91c7f0-1a78-4346-85eb-c9658477ef33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:25.255350 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91c7f0-1a78-4346-85eb-c9658477ef33 service cinder] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:25.255743 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91c7f0-1a78-4346-85eb-c9658477ef33 service cinder] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:25.256131 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91c7f0-1a78-4346-85eb-c9658477ef33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:25.267262 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91c7f0-1a78-4346-85eb-c9658477ef33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:25.269007 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91c7f0-1a78-4346-85eb-c9658477ef33 service cinder] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:25.280696 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1386/2777] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:25 2022] GET /identity/v3/auth/tokens => generated 3379 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:25.296228 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf628ae0-1abb-4659-9c19-58eba302363f None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:25.367633 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf628ae0-1abb-4659-9c19-58eba302363f None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:25.373542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877d531-5111-4391-bfdb-56d277e7e454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:25.374430 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877d531-5111-4391-bfdb-56d277e7e454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:25.374713 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877d531-5111-4391-bfdb-56d277e7e454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:25.374984 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877d531-5111-4391-bfdb-56d277e7e454 admin admin] PATH_INFO: `/v3/users/60ad5123816c4afab719cff25b771c1b` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:25.376264 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877d531-5111-4391-bfdb-56d277e7e454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60ad5123816c4afab719cff25b771c1b)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:25.378247 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877d531-5111-4391-bfdb-56d277e7e454 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:25.435095 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3877d531-5111-4391-bfdb-56d277e7e454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60ad5123816c4afab719cff25b771c1b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:25.435746 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3877d531-5111-4391-bfdb-56d277e7e454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60ad5123816c4afab719cff25b771c1b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:25.436456 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3877d531-5111-4391-bfdb-56d277e7e454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60ad5123816c4afab719cff25b771c1b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:25.445331 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3877d531-5111-4391-bfdb-56d277e7e454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60ad5123816c4afab719cff25b771c1b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:25.454992 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-3877d531-5111-4391-bfdb-56d277e7e454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60ad5123816c4afab719cff25b771c1b'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:25.477633 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1392/2778] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:25 2022] DELETE /identity/v3/users/60ad5123816c4afab719cff25b771c1b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:25.485350 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b47511-c2ff-45ac-9931-80ad770fd4d0 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:25.485816 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b47511-c2ff-45ac-9931-80ad770fd4d0 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:25.486298 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b47511-c2ff-45ac-9931-80ad770fd4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:25.513622 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-c5b47511-c2ff-45ac-9931-80ad770fd4d0 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:25.515157 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c5b47511-c2ff-45ac-9931-80ad770fd4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:25.585365 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1387/2779] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:25 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:25.597505 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877d531-5111-4391-bfdb-56d277e7e454 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:25.599387 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-3877d531-5111-4391-bfdb-56d277e7e454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:25.674108 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877d531-5111-4391-bfdb-56d277e7e454 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:25.680706 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af256ee-0f1f-4a77-9172-715669fcf4d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:25.681901 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af256ee-0f1f-4a77-9172-715669fcf4d3 service neutron] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:25.683108 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af256ee-0f1f-4a77-9172-715669fcf4d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:25.683594 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af256ee-0f1f-4a77-9172-715669fcf4d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:25.699331 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af256ee-0f1f-4a77-9172-715669fcf4d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:25.702262 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af256ee-0f1f-4a77-9172-715669fcf4d3 service neutron] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:25.723032 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1393/2780] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:25 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:07:26.071433 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b47511-c2ff-45ac-9931-80ad770fd4d0 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:26.073479 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c5b47511-c2ff-45ac-9931-80ad770fd4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:26.086630 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b47511-c2ff-45ac-9931-80ad770fd4d0 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:26.092283 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75c463-7398-4170-8f38-4b3ef120715c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:26.093202 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75c463-7398-4170-8f38-4b3ef120715c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:26.093483 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75c463-7398-4170-8f38-4b3ef120715c admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:26.093757 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75c463-7398-4170-8f38-4b3ef120715c admin admin] PATH_INFO: `/v3/projects/15022e3d9d01484da44522677fb2d608` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:26.095070 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75c463-7398-4170-8f38-4b3ef120715c admin admin] RBAC: Authorizing `identity:delete_project(project_id=15022e3d9d01484da44522677fb2d608)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:26.097122 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75c463-7398-4170-8f38-4b3ef120715c admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:26.170099 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9d75c463-7398-4170-8f38-4b3ef120715c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15022e3d9d01484da44522677fb2d608', 'request_id': 'req-9d75c463-7398-4170-8f38-4b3ef120715c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:26.182048 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9d75c463-7398-4170-8f38-4b3ef120715c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15022e3d9d01484da44522677fb2d608', 'request_id': 'req-9d75c463-7398-4170-8f38-4b3ef120715c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:26.188626 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9d75c463-7398-4170-8f38-4b3ef120715c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15022e3d9d01484da44522677fb2d608', 'request_id': 'req-9d75c463-7398-4170-8f38-4b3ef120715c'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:26.202811 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9d75c463-7398-4170-8f38-4b3ef120715c admin admin] The token cache is being invalidate because project 15022e3d9d01484da44522677fb2d608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:26.203081 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9d75c463-7398-4170-8f38-4b3ef120715c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:26.203747 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-9d75c463-7398-4170-8f38-4b3ef120715c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:26.205360 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1388/2781] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:26 2022] DELETE /identity/v3/projects/15022e3d9d01484da44522677fb2d608 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:26.212032 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a2f81-1975-4b56-82dd-11faa5f71add None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:26.212317 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a2f81-1975-4b56-82dd-11faa5f71add None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:26.212773 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a2f81-1975-4b56-82dd-11faa5f71add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:26.232304 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-006a2f81-1975-4b56-82dd-11faa5f71add None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:26.233542 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-006a2f81-1975-4b56-82dd-11faa5f71add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:26.302674 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1394/2782] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:26 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:26.311990 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92e4e4-07f6-4fac-9d5f-282ac88b05d1 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:26.312255 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92e4e4-07f6-4fac-9d5f-282ac88b05d1 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:26.312535 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92e4e4-07f6-4fac-9d5f-282ac88b05d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:26.334535 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-ec92e4e4-07f6-4fac-9d5f-282ac88b05d1 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:26.335756 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-ec92e4e4-07f6-4fac-9d5f-282ac88b05d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:26.344644 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1389/2783] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:26 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:26.348961 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a2f81-1975-4b56-82dd-11faa5f71add None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:26.359131 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a2f81-1975-4b56-82dd-11faa5f71add None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:26.363883 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b484bbc-41a8-4c43-809a-e1786a60c95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:26.364568 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b484bbc-41a8-4c43-809a-e1786a60c95e admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:26.364867 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b484bbc-41a8-4c43-809a-e1786a60c95e admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:26.365136 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b484bbc-41a8-4c43-809a-e1786a60c95e admin admin] PATH_INFO: `/v3/domains` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:26.365866 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b484bbc-41a8-4c43-809a-e1786a60c95e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:07:26.366161 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b484bbc-41a8-4c43-809a-e1786a60c95e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:26.367845 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b484bbc-41a8-4c43-809a-e1786a60c95e admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:26.380308 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1395/2784] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:07:26.385884 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92e4e4-07f6-4fac-9d5f-282ac88b05d1 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:26.395794 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92e4e4-07f6-4fac-9d5f-282ac88b05d1 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:26.401847 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41212812-e38d-40c3-b0a1-c31058fad0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:26.402564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41212812-e38d-40c3-b0a1-c31058fad0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:26.402844 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41212812-e38d-40c3-b0a1-c31058fad0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:26.403115 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41212812-e38d-40c3-b0a1-c31058fad0b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:26.403820 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41212812-e38d-40c3-b0a1-c31058fad0b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:26.405872 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41212812-e38d-40c3-b0a1-c31058fad0b2 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:26.435507 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1390/2785] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:26 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:07:26.439959 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b484bbc-41a8-4c43-809a-e1786a60c95e admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:26.450894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b484bbc-41a8-4c43-809a-e1786a60c95e admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:26.517206 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0dd23-71a5-451f-873f-111ee35c349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:26.517938 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0dd23-71a5-451f-873f-111ee35c349c admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:26.518218 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0dd23-71a5-451f-873f-111ee35c349c admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:26.518517 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0dd23-71a5-451f-873f-111ee35c349c admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:26.519184 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0dd23-71a5-451f-873f-111ee35c349c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:26.521141 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0dd23-71a5-451f-873f-111ee35c349c admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:26.543448 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1396/2786] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:26 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:26.549848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41212812-e38d-40c3-b0a1-c31058fad0b2 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:26.562189 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41212812-e38d-40c3-b0a1-c31058fad0b2 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:26.567258 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81835e9-a436-4148-9dcf-dd56e8cf6d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:26.567943 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81835e9-a436-4148-9dcf-dd56e8cf6d7d admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:26.568225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81835e9-a436-4148-9dcf-dd56e8cf6d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:26.568501 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81835e9-a436-4148-9dcf-dd56e8cf6d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:26.569340 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81835e9-a436-4148-9dcf-dd56e8cf6d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:26.570969 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81835e9-a436-4148-9dcf-dd56e8cf6d7d admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:26.583938 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1391/2787] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:26.588123 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0dd23-71a5-451f-873f-111ee35c349c admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:26.599365 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0dd23-71a5-451f-873f-111ee35c349c admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:26.604307 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a754c26-b20a-4f64-b755-2c6e6a816c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:26.605030 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a754c26-b20a-4f64-b755-2c6e6a816c17 admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:26.605336 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a754c26-b20a-4f64-b755-2c6e6a816c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:26.605601 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a754c26-b20a-4f64-b755-2c6e6a816c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:26.606326 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a754c26-b20a-4f64-b755-2c6e6a816c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:26.607925 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a754c26-b20a-4f64-b755-2c6e6a816c17 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:26.618638 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1397/2788] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:26.624777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81835e9-a436-4148-9dcf-dd56e8cf6d7d admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:26.634871 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81835e9-a436-4148-9dcf-dd56e8cf6d7d admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:26.640344 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00274b2c-d5e5-4d27-ada2-2407f93662eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:26.641310 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00274b2c-d5e5-4d27-ada2-2407f93662eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:26.641586 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00274b2c-d5e5-4d27-ada2-2407f93662eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:26.641853 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00274b2c-d5e5-4d27-ada2-2407f93662eb admin admin] PATH_INFO: `/v3/projects/2613a6a405164773b355a8b89f0d9c13/users/66b039e0f97745618641b261f286fa75/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:26.658175 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00274b2c-d5e5-4d27-ada2-2407f93662eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2613a6a405164773b355a8b89f0d9c13, user_id=66b039e0f97745618641b261f286fa75, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:26.661131 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00274b2c-d5e5-4d27-ada2-2407f93662eb admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:26.676564 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1392/2789] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:26 2022] PUT /identity/v3/projects/2613a6a405164773b355a8b89f0d9c13/users/66b039e0f97745618641b261f286fa75/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:26.688108 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8533426-7f59-4abf-b430-77c459415951 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:26.688430 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8533426-7f59-4abf-b430-77c459415951 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:26.688602 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8533426-7f59-4abf-b430-77c459415951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:26.718716 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-d8533426-7f59-4abf-b430-77c459415951 None None] MFA Rules not processed for user `66b039e0f97745618641b261f286fa75`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:26.719936 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-d8533426-7f59-4abf-b430-77c459415951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:26.790408 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1398/2790] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:26 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:26.796382 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00274b2c-d5e5-4d27-ada2-2407f93662eb admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:26.874237 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00274b2c-d5e5-4d27-ada2-2407f93662eb admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:26.879144 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bceb0-e37d-41ce-8df8-e634eaff4f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:26.879817 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bceb0-e37d-41ce-8df8-e634eaff4f25 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:26.880091 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bceb0-e37d-41ce-8df8-e634eaff4f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:26.880363 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bceb0-e37d-41ce-8df8-e634eaff4f25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:26.881101 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bceb0-e37d-41ce-8df8-e634eaff4f25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:26.883079 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bceb0-e37d-41ce-8df8-e634eaff4f25 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:26.915770 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1393/2791] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:26 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:26.920113 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8533426-7f59-4abf-b430-77c459415951 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:26.931744 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8533426-7f59-4abf-b430-77c459415951 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:26.997352 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2d67c-1827-4d78-a27f-265d6003834f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:26.998046 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2d67c-1827-4d78-a27f-265d6003834f admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:26.998332 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2d67c-1827-4d78-a27f-265d6003834f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:26.998606 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2d67c-1827-4d78-a27f-265d6003834f admin admin] PATH_INFO: `/v3/users` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:26.999306 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2d67c-1827-4d78-a27f-265d6003834f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:27.001314 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2d67c-1827-4d78-a27f-265d6003834f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:27.024230 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1399/2792] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:26 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:27.030103 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bceb0-e37d-41ce-8df8-e634eaff4f25 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:27.042016 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bceb0-e37d-41ce-8df8-e634eaff4f25 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:27.047063 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f1788-b113-4177-84b0-bbac300aa702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:27.047719 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f1788-b113-4177-84b0-bbac300aa702 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:27.047997 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f1788-b113-4177-84b0-bbac300aa702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:27.048267 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f1788-b113-4177-84b0-bbac300aa702 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:27.049023 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f1788-b113-4177-84b0-bbac300aa702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:27.050630 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f1788-b113-4177-84b0-bbac300aa702 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:27.062475 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1394/2793] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:07:27.066949 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2d67c-1827-4d78-a27f-265d6003834f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:27.078775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2d67c-1827-4d78-a27f-265d6003834f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:27.083938 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d7c1d-4d40-4069-a462-10b07076a97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:27.084879 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d7c1d-4d40-4069-a462-10b07076a97a admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:27.085156 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d7c1d-4d40-4069-a462-10b07076a97a admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:27.085441 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d7c1d-4d40-4069-a462-10b07076a97a admin admin] PATH_INFO: `/v3/projects/1acd265f8c5646c6a8a8ecc0d5eb96f1/users/44117c30c5f140d0b0d936a286009a18/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:27.103057 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d7c1d-4d40-4069-a462-10b07076a97a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1acd265f8c5646c6a8a8ecc0d5eb96f1, user_id=44117c30c5f140d0b0d936a286009a18, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:27.105829 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d7c1d-4d40-4069-a462-10b07076a97a admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:27.121672 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1400/2794] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:27 2022] PUT /identity/v3/projects/1acd265f8c5646c6a8a8ecc0d5eb96f1/users/44117c30c5f140d0b0d936a286009a18/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:27.126081 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f1788-b113-4177-84b0-bbac300aa702 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:27.139536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f1788-b113-4177-84b0-bbac300aa702 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:27.203849 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b285c-69e9-42bd-91ff-10d277b8c17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:27.204630 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b285c-69e9-42bd-91ff-10d277b8c17e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:27.204952 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b285c-69e9-42bd-91ff-10d277b8c17e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:27.205234 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b285c-69e9-42bd-91ff-10d277b8c17e admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:27.206045 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b285c-69e9-42bd-91ff-10d277b8c17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:27.207696 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b285c-69e9-42bd-91ff-10d277b8c17e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:27.219440 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1395/2795] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:27.224248 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d7c1d-4d40-4069-a462-10b07076a97a admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:27.237479 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d7c1d-4d40-4069-a462-10b07076a97a admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:27.242729 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d5afd-af4e-458d-9c7d-b3cf5281aadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:27.243629 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d5afd-af4e-458d-9c7d-b3cf5281aadb admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:27.243904 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d5afd-af4e-458d-9c7d-b3cf5281aadb admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:27.244173 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d5afd-af4e-458d-9c7d-b3cf5281aadb admin admin] PATH_INFO: `/v3/projects/1acd265f8c5646c6a8a8ecc0d5eb96f1/users/44117c30c5f140d0b0d936a286009a18/roles/253c0a1dc8d6421298a7987caaa55676` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:27.247056 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d5afd-af4e-458d-9c7d-b3cf5281aadb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1acd265f8c5646c6a8a8ecc0d5eb96f1, user_id=44117c30c5f140d0b0d936a286009a18, role_id=253c0a1dc8d6421298a7987caaa55676)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:27.249886 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d5afd-af4e-458d-9c7d-b3cf5281aadb admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:27.263236 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1401/2796] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:27 2022] PUT /identity/v3/projects/1acd265f8c5646c6a8a8ecc0d5eb96f1/users/44117c30c5f140d0b0d936a286009a18/roles/253c0a1dc8d6421298a7987caaa55676 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:27.274688 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734ccdb-7df7-4095-8f3a-254952439fca None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:27.274982 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734ccdb-7df7-4095-8f3a-254952439fca None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:27.275321 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734ccdb-7df7-4095-8f3a-254952439fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:27.305418 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-c734ccdb-7df7-4095-8f3a-254952439fca None None] MFA Rules not processed for user `44117c30c5f140d0b0d936a286009a18`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:27.306567 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-c734ccdb-7df7-4095-8f3a-254952439fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:27.386812 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1396/2797] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:27 2022] POST /identity/v3/auth/tokens => generated 3460 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:27.399296 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d5afd-af4e-458d-9c7d-b3cf5281aadb admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:27.402920 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-343d5afd-af4e-458d-9c7d-b3cf5281aadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:27.470767 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d5afd-af4e-458d-9c7d-b3cf5281aadb admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:27.474678 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ffeff-ac5d-4944-9427-29a5c8ef858b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:27.475337 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ffeff-ac5d-4944-9427-29a5c8ef858b service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:27.475614 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ffeff-ac5d-4944-9427-29a5c8ef858b service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:27.475896 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ffeff-ac5d-4944-9427-29a5c8ef858b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:27.558871 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ffeff-ac5d-4944-9427-29a5c8ef858b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:27.560278 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ffeff-ac5d-4944-9427-29a5c8ef858b service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:27.571001 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1402/2798] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:27 2022] GET /identity/v3/auth/tokens => generated 3395 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:30.202103 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734ccdb-7df7-4095-8f3a-254952439fca None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:30.269512 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734ccdb-7df7-4095-8f3a-254952439fca None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:30.274524 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb4050-8ebf-420a-a446-b6d737f2a3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:30.275506 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb4050-8ebf-420a-a446-b6d737f2a3d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:30.275728 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb4050-8ebf-420a-a446-b6d737f2a3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:30.276032 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb4050-8ebf-420a-a446-b6d737f2a3d9 admin admin] PATH_INFO: `/v3/users/66b039e0f97745618641b261f286fa75` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:30.277297 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb4050-8ebf-420a-a446-b6d737f2a3d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b039e0f97745618641b261f286fa75)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:30.279241 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb4050-8ebf-420a-a446-b6d737f2a3d9 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:30.335859 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-aceb4050-8ebf-420a-a446-b6d737f2a3d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b039e0f97745618641b261f286fa75'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:30.336655 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-aceb4050-8ebf-420a-a446-b6d737f2a3d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b039e0f97745618641b261f286fa75'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:30.344425 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-aceb4050-8ebf-420a-a446-b6d737f2a3d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b039e0f97745618641b261f286fa75'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:30.352513 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-aceb4050-8ebf-420a-a446-b6d737f2a3d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b039e0f97745618641b261f286fa75'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:30.365530 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-aceb4050-8ebf-420a-a446-b6d737f2a3d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b039e0f97745618641b261f286fa75'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:30.372772 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1397/2799] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:30 2022] DELETE /identity/v3/users/66b039e0f97745618641b261f286fa75 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:30.377570 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500c334-68a3-4c42-95d1-ea408b117f7a None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:30.378093 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500c334-68a3-4c42-95d1-ea408b117f7a None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:30.378211 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500c334-68a3-4c42-95d1-ea408b117f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:30.395783 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-8500c334-68a3-4c42-95d1-ea408b117f7a None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:30.397038 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-8500c334-68a3-4c42-95d1-ea408b117f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:30.462166 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1403/2800] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:30 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:30.473419 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb4050-8ebf-420a-a446-b6d737f2a3d9 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:30.474866 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-aceb4050-8ebf-420a-a446-b6d737f2a3d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:30.543865 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb4050-8ebf-420a-a446-b6d737f2a3d9 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:30.547777 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b83aa8-d864-4724-9688-7243438932bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:30.548445 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b83aa8-d864-4724-9688-7243438932bd service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:30.549253 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b83aa8-d864-4724-9688-7243438932bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:30.549545 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b83aa8-d864-4724-9688-7243438932bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:30.564440 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b83aa8-d864-4724-9688-7243438932bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:30.565917 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b83aa8-d864-4724-9688-7243438932bd service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:30.577705 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1398/2801] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:30 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:30.882851 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500c334-68a3-4c42-95d1-ea408b117f7a None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:30.884717 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-8500c334-68a3-4c42-95d1-ea408b117f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:30.902060 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500c334-68a3-4c42-95d1-ea408b117f7a None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:30.908226 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4637e-0452-422f-89cf-0b2833a720ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:30.909608 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4637e-0452-422f-89cf-0b2833a720ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:30.910024 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4637e-0452-422f-89cf-0b2833a720ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:30.910408 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4637e-0452-422f-89cf-0b2833a720ff admin admin] PATH_INFO: `/v3/projects/2613a6a405164773b355a8b89f0d9c13` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:30.911963 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4637e-0452-422f-89cf-0b2833a720ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2613a6a405164773b355a8b89f0d9c13)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:30.914264 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4637e-0452-422f-89cf-0b2833a720ff admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:30.977408 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-e7d4637e-0452-422f-89cf-0b2833a720ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2613a6a405164773b355a8b89f0d9c13', 'request_id': 'req-e7d4637e-0452-422f-89cf-0b2833a720ff'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:30.985342 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-e7d4637e-0452-422f-89cf-0b2833a720ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2613a6a405164773b355a8b89f0d9c13', 'request_id': 'req-e7d4637e-0452-422f-89cf-0b2833a720ff'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:30.991447 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-e7d4637e-0452-422f-89cf-0b2833a720ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2613a6a405164773b355a8b89f0d9c13', 'request_id': 'req-e7d4637e-0452-422f-89cf-0b2833a720ff'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.005894 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-e7d4637e-0452-422f-89cf-0b2833a720ff admin admin] The token cache is being invalidate because project 2613a6a405164773b355a8b89f0d9c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:31.006205 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-e7d4637e-0452-422f-89cf-0b2833a720ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.006852 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-e7d4637e-0452-422f-89cf-0b2833a720ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.008435 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1404/2802] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:30 2022] DELETE /identity/v3/projects/2613a6a405164773b355a8b89f0d9c13 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:31.013482 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b83aa8-d864-4724-9688-7243438932bd service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:31.032551 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b83aa8-d864-4724-9688-7243438932bd service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:31.134567 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9975c3-6056-458f-8d6e-8c7bf97790bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:31.136596 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9975c3-6056-458f-8d6e-8c7bf97790bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:31.137124 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9975c3-6056-458f-8d6e-8c7bf97790bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:31.137601 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9975c3-6056-458f-8d6e-8c7bf97790bd admin admin] PATH_INFO: `/v3/users/44117c30c5f140d0b0d936a286009a18` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:31.139817 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9975c3-6056-458f-8d6e-8c7bf97790bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=44117c30c5f140d0b0d936a286009a18)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:31.143647 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9975c3-6056-458f-8d6e-8c7bf97790bd admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:31.215559 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-ed9975c3-6056-458f-8d6e-8c7bf97790bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44117c30c5f140d0b0d936a286009a18'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.216374 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-ed9975c3-6056-458f-8d6e-8c7bf97790bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44117c30c5f140d0b0d936a286009a18'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.224742 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-ed9975c3-6056-458f-8d6e-8c7bf97790bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44117c30c5f140d0b0d936a286009a18'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.234903 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-ed9975c3-6056-458f-8d6e-8c7bf97790bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44117c30c5f140d0b0d936a286009a18'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.249736 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-ed9975c3-6056-458f-8d6e-8c7bf97790bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44117c30c5f140d0b0d936a286009a18'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.255862 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1399/2803] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:31 2022] DELETE /identity/v3/users/44117c30c5f140d0b0d936a286009a18 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:31.623997 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4637e-0452-422f-89cf-0b2833a720ff admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:31.626294 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-e7d4637e-0452-422f-89cf-0b2833a720ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:31.642751 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4637e-0452-422f-89cf-0b2833a720ff admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:31.710041 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff650fe7-a6ff-4f76-90b7-08d864cefdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:31.710929 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff650fe7-a6ff-4f76-90b7-08d864cefdfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:31.711212 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff650fe7-a6ff-4f76-90b7-08d864cefdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:31.711487 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff650fe7-a6ff-4f76-90b7-08d864cefdfe admin admin] PATH_INFO: `/v3/projects/1acd265f8c5646c6a8a8ecc0d5eb96f1` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:31.712820 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff650fe7-a6ff-4f76-90b7-08d864cefdfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=1acd265f8c5646c6a8a8ecc0d5eb96f1)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:31.715303 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff650fe7-a6ff-4f76-90b7-08d864cefdfe admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:31.766912 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-ff650fe7-a6ff-4f76-90b7-08d864cefdfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1acd265f8c5646c6a8a8ecc0d5eb96f1', 'request_id': 'req-ff650fe7-a6ff-4f76-90b7-08d864cefdfe'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.773312 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-ff650fe7-a6ff-4f76-90b7-08d864cefdfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1acd265f8c5646c6a8a8ecc0d5eb96f1', 'request_id': 'req-ff650fe7-a6ff-4f76-90b7-08d864cefdfe'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.779467 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-ff650fe7-a6ff-4f76-90b7-08d864cefdfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1acd265f8c5646c6a8a8ecc0d5eb96f1', 'request_id': 'req-ff650fe7-a6ff-4f76-90b7-08d864cefdfe'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.793527 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-ff650fe7-a6ff-4f76-90b7-08d864cefdfe admin admin] The token cache is being invalidate because project 1acd265f8c5646c6a8a8ecc0d5eb96f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:31.793811 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-ff650fe7-a6ff-4f76-90b7-08d864cefdfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.794458 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-ff650fe7-a6ff-4f76-90b7-08d864cefdfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.796049 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1405/2804] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:31 2022] DELETE /identity/v3/projects/1acd265f8c5646c6a8a8ecc0d5eb96f1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:31.801972 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00081969-a0df-401f-a88e-bee58981e4c6 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:31.802250 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00081969-a0df-401f-a88e-bee58981e4c6 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:31.802537 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00081969-a0df-401f-a88e-bee58981e4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:31.822586 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-00081969-a0df-401f-a88e-bee58981e4c6 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:31.823848 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-00081969-a0df-401f-a88e-bee58981e4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:31.887471 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1400/2805] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:31 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:31.896956 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dfdad-547e-48bc-8937-061c18a0cba2 None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:31.897269 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dfdad-547e-48bc-8937-061c18a0cba2 None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:31.897543 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dfdad-547e-48bc-8937-061c18a0cba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:31.919100 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-5b9dfdad-547e-48bc-8937-061c18a0cba2 None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:31.920333 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-5b9dfdad-547e-48bc-8937-061c18a0cba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:31.928454 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1406/2806] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:31 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:31.933381 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00081969-a0df-401f-a88e-bee58981e4c6 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:31.946505 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00081969-a0df-401f-a88e-bee58981e4c6 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:31.952615 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aa725-f5ff-4251-b7e0-6b0a88e03c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:31.953758 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aa725-f5ff-4251-b7e0-6b0a88e03c0e admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:31.954053 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aa725-f5ff-4251-b7e0-6b0a88e03c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:31.954331 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aa725-f5ff-4251-b7e0-6b0a88e03c0e admin admin] PATH_INFO: `/v3/domains` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:31.955070 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300aa725-f5ff-4251-b7e0-6b0a88e03c0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:07:31.955380 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300aa725-f5ff-4251-b7e0-6b0a88e03c0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:31.957028 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300aa725-f5ff-4251-b7e0-6b0a88e03c0e admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:31.970855 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1401/2807] 10.222.0.96 () {58 vars in 1152 bytes} [Fri Jan 28 02:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:07:31.975733 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dfdad-547e-48bc-8937-061c18a0cba2 None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:31.985914 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dfdad-547e-48bc-8937-061c18a0cba2 None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:31.990848 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609af69-da9c-4e31-81ad-4f56fcf4aa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:31.991517 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609af69-da9c-4e31-81ad-4f56fcf4aa04 admin admin] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:31.991793 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609af69-da9c-4e31-81ad-4f56fcf4aa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:31.992064 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609af69-da9c-4e31-81ad-4f56fcf4aa04 admin admin] PATH_INFO: `/v3/projects` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:31.992744 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609af69-da9c-4e31-81ad-4f56fcf4aa04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:31.994674 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609af69-da9c-4e31-81ad-4f56fcf4aa04 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:32.023878 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1407/2808] 10.222.0.96 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:31 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:32.029419 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aa725-f5ff-4251-b7e0-6b0a88e03c0e admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:32.039922 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aa725-f5ff-4251-b7e0-6b0a88e03c0e admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:32.098641 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a66f39-aa8c-4a3a-b8a0-4f5dbbefa549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:32.099420 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a66f39-aa8c-4a3a-b8a0-4f5dbbefa549 admin admin] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.099745 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a66f39-aa8c-4a3a-b8a0-4f5dbbefa549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.100077 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a66f39-aa8c-4a3a-b8a0-4f5dbbefa549 admin admin] PATH_INFO: `/v3/users` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.100833 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a66f39-aa8c-4a3a-b8a0-4f5dbbefa549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:32.102854 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a66f39-aa8c-4a3a-b8a0-4f5dbbefa549 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:32.125202 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1402/2809] 10.222.0.96 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:32 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:32.130043 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609af69-da9c-4e31-81ad-4f56fcf4aa04 admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:32.141761 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609af69-da9c-4e31-81ad-4f56fcf4aa04 admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:32.146860 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70bb68-0b9b-492d-abd1-406f94ff407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:32.147536 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70bb68-0b9b-492d-abd1-406f94ff407f admin admin] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.147819 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70bb68-0b9b-492d-abd1-406f94ff407f admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.148092 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70bb68-0b9b-492d-abd1-406f94ff407f admin admin] PATH_INFO: `/v3/roles` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.148846 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70bb68-0b9b-492d-abd1-406f94ff407f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:32.150473 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70bb68-0b9b-492d-abd1-406f94ff407f admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:32.163885 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1408/2810] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:32.168208 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a66f39-aa8c-4a3a-b8a0-4f5dbbefa549 admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:32.180185 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a66f39-aa8c-4a3a-b8a0-4f5dbbefa549 admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:32.185225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c1851-dee7-48c2-94da-479632060406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:32.185944 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c1851-dee7-48c2-94da-479632060406 admin admin] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.186220 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c1851-dee7-48c2-94da-479632060406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.186496 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c1851-dee7-48c2-94da-479632060406 admin admin] PATH_INFO: `/v3/roles` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.187243 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c1851-dee7-48c2-94da-479632060406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:32.188882 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c1851-dee7-48c2-94da-479632060406 admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:32.200387 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1403/2811] 10.222.0.96 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:32.205292 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70bb68-0b9b-492d-abd1-406f94ff407f admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:32.216230 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70bb68-0b9b-492d-abd1-406f94ff407f admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:32.221450 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fe8d4-e5a8-4165-a5af-8d378bcf00ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:32.222353 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fe8d4-e5a8-4165-a5af-8d378bcf00ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.222636 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fe8d4-e5a8-4165-a5af-8d378bcf00ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.223149 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fe8d4-e5a8-4165-a5af-8d378bcf00ad admin admin] PATH_INFO: `/v3/projects/31f905a59a1e41189a098bc98b0ec30d/users/34fd9f42a05a4322bb308c5017e4c7f4/roles/0a6e12c9b8034527a8aa1988febe09ac` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.239914 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88fe8d4-e5a8-4165-a5af-8d378bcf00ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=31f905a59a1e41189a098bc98b0ec30d, user_id=34fd9f42a05a4322bb308c5017e4c7f4, role_id=0a6e12c9b8034527a8aa1988febe09ac)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:32.242628 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88fe8d4-e5a8-4165-a5af-8d378bcf00ad admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:32.257526 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1409/2812] 10.222.0.96 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:32 2022] PUT /identity/v3/projects/31f905a59a1e41189a098bc98b0ec30d/users/34fd9f42a05a4322bb308c5017e4c7f4/roles/0a6e12c9b8034527a8aa1988febe09ac => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:32.268758 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e521e-476f-431b-afd4-7b592114f770 None None] REQUEST_METHOD: `POST` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.269536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e521e-476f-431b-afd4-7b592114f770 None None] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.269536 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e521e-476f-431b-afd4-7b592114f770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.299439 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.auth.core [None req-7b5e521e-476f-431b-afd4-7b592114f770 None None] MFA Rules not processed for user `34fd9f42a05a4322bb308c5017e4c7f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:32.300736 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-7b5e521e-476f-431b-afd4-7b592114f770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:32.368789 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1404/2813] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:32 2022] POST /identity/v3/auth/tokens => generated 3407 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:32.379442 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fe8d4-e5a8-4165-a5af-8d378bcf00ad admin admin] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:32.381658 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-b88fe8d4-e5a8-4165-a5af-8d378bcf00ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:32.446148 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fe8d4-e5a8-4165-a5af-8d378bcf00ad admin admin] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:32.450977 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417af37e-e033-42e2-9b3a-180751184059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb36af30d0fe4369b4459f333cb64a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:32.451637 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af37e-e033-42e2-9b3a-180751184059 service cinder] REQUEST_METHOD: `GET` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.451976 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af37e-e033-42e2-9b3a-180751184059 service cinder] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.452255 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af37e-e033-42e2-9b3a-180751184059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.461415 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417af37e-e033-42e2-9b3a-180751184059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:32.462869 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417af37e-e033-42e2-9b3a-180751184059 service cinder] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:32.472956 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1410/2814] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:32 2022] GET /identity/v3/auth/tokens => generated 3407 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:49.057961 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e521e-476f-431b-afd4-7b592114f770 None None] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:49.160243 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e521e-476f-431b-afd4-7b592114f770 None None] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:49.165001 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483afbe0-e879-4942-b24e-c43018c8036a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:49.165940 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483afbe0-e879-4942-b24e-c43018c8036a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:49.166216 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483afbe0-e879-4942-b24e-c43018c8036a admin admin] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:49.166482 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483afbe0-e879-4942-b24e-c43018c8036a admin admin] PATH_INFO: `/v3/users/34fd9f42a05a4322bb308c5017e4c7f4` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:49.167898 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483afbe0-e879-4942-b24e-c43018c8036a admin admin] RBAC: Authorizing `identity:delete_user(user_id=34fd9f42a05a4322bb308c5017e4c7f4)` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:49.170049 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483afbe0-e879-4942-b24e-c43018c8036a admin admin] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:49.225941 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-483afbe0-e879-4942-b24e-c43018c8036a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34fd9f42a05a4322bb308c5017e4c7f4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:49.226795 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-483afbe0-e879-4942-b24e-c43018c8036a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34fd9f42a05a4322bb308c5017e4c7f4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:49.235878 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-483afbe0-e879-4942-b24e-c43018c8036a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34fd9f42a05a4322bb308c5017e4c7f4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:49.245414 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-483afbe0-e879-4942-b24e-c43018c8036a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34fd9f42a05a4322bb308c5017e4c7f4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:49.259738 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.notifications [None req-483afbe0-e879-4942-b24e-c43018c8036a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34fd9f42a05a4322bb308c5017e4c7f4'} {{(pid=79481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:49.266363 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1405/2815] 10.222.0.96 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:49 2022] DELETE /identity/v3/users/34fd9f42a05a4322bb308c5017e4c7f4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:49.272189 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b27c3a-00fb-4aaf-80a4-837293f3483f None None] REQUEST_METHOD: `POST` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:49.272760 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b27c3a-00fb-4aaf-80a4-837293f3483f None None] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:49.273186 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b27c3a-00fb-4aaf-80a4-837293f3483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:49.297278 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.auth.core [None req-89b27c3a-00fb-4aaf-80a4-837293f3483f None None] MFA Rules not processed for user `4d8d6d5762e340d2aeb3219a15d43128`. Rule list: `[]` (Enabled: `True`). {{(pid=79482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:49.298414 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-89b27c3a-00fb-4aaf-80a4-837293f3483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:49.370268 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1411/2816] 10.222.0.96 () {58 vars in 957 bytes} [Fri Jan 28 02:07:49 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:49.381283 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483afbe0-e879-4942-b24e-c43018c8036a admin admin] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:49.383029 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-483afbe0-e879-4942-b24e-c43018c8036a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:49.447719 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483afbe0-e879-4942-b24e-c43018c8036a admin admin] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:49.452225 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365568d-e4c1-4daf-a03e-7fbd6ff3e71c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4acc32735f0a418ba5620f6225500402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:49.453235 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365568d-e4c1-4daf-a03e-7fbd6ff3e71c service neutron] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:49.453641 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365568d-e4c1-4daf-a03e-7fbd6ff3e71c service neutron] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:49.454019 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365568d-e4c1-4daf-a03e-7fbd6ff3e71c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:49.464704 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365568d-e4c1-4daf-a03e-7fbd6ff3e71c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:49.466210 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365568d-e4c1-4daf-a03e-7fbd6ff3e71c service neutron] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:49.476968 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1406/2817] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:49 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:49.804362 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b27c3a-00fb-4aaf-80a4-837293f3483f None None] Authenticating user token {{(pid=79482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:49.806582 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.fernet_utils [None req-89b27c3a-00fb-4aaf-80a4-837293f3483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:49.821291 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b27c3a-00fb-4aaf-80a4-837293f3483f None None] Validating token access rules against request {{(pid=79482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:49.827994 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f6b0a-46b2-4ab5-ac78-51b6e5a06177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d8d6d5762e340d2aeb3219a15d43128', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ed2a96df227403c8d2cdfcff229008d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:49.829148 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f6b0a-46b2-4ab5-ac78-51b6e5a06177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:49.829510 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f6b0a-46b2-4ab5-ac78-51b6e5a06177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:49.830123 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f6b0a-46b2-4ab5-ac78-51b6e5a06177 admin admin] PATH_INFO: `/v3/projects/31f905a59a1e41189a098bc98b0ec30d` {{(pid=79482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:49.832183 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f6b0a-46b2-4ab5-ac78-51b6e5a06177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31f905a59a1e41189a098bc98b0ec30d)` {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:49.836202 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f6b0a-46b2-4ab5-ac78-51b6e5a06177 admin admin] RBAC: Authorization granted {{(pid=79482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:49.904644 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-043f6b0a-46b2-4ab5-ac78-51b6e5a06177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31f905a59a1e41189a098bc98b0ec30d', 'request_id': 'req-043f6b0a-46b2-4ab5-ac78-51b6e5a06177'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:49.912026 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-043f6b0a-46b2-4ab5-ac78-51b6e5a06177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31f905a59a1e41189a098bc98b0ec30d', 'request_id': 'req-043f6b0a-46b2-4ab5-ac78-51b6e5a06177'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:49.918788 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-043f6b0a-46b2-4ab5-ac78-51b6e5a06177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31f905a59a1e41189a098bc98b0ec30d', 'request_id': 'req-043f6b0a-46b2-4ab5-ac78-51b6e5a06177'} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:49.932775 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-043f6b0a-46b2-4ab5-ac78-51b6e5a06177 admin admin] The token cache is being invalidate because project 31f905a59a1e41189a098bc98b0ec30d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:49.933098 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-043f6b0a-46b2-4ab5-ac78-51b6e5a06177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:49.933698 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: DEBUG keystone.notifications [None req-043f6b0a-46b2-4ab5-ac78-51b6e5a06177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:49.935253 dv-cinder-824978-1-iscsi devstack@keystone.service[79482]: [pid: 79482|app: 0|req: 1412/2818] 10.222.0.96 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:49 2022] DELETE /identity/v3/projects/31f905a59a1e41189a098bc98b0ec30d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:10:59.451917 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365568d-e4c1-4daf-a03e-7fbd6ff3e71c service neutron] Authenticating user token {{(pid=79481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:59.453994 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-b365568d-e4c1-4daf-a03e-7fbd6ff3e71c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:59.639603 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365568d-e4c1-4daf-a03e-7fbd6ff3e71c service neutron] Validating token access rules against request {{(pid=79481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:59.710139 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46228e-7163-4ca0-993b-5ef1b95ec30d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a16f0ecf3448428e969359be57dda8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356ecb479ba24136a7c38cb5a58a0a18', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:59.710803 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46228e-7163-4ca0-993b-5ef1b95ec30d service placement] REQUEST_METHOD: `GET` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:59.711084 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46228e-7163-4ca0-993b-5ef1b95ec30d service placement] SCRIPT_NAME: `/identity` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:59.711357 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46228e-7163-4ca0-993b-5ef1b95ec30d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:59.713252 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.fernet_utils [None req-9c46228e-7163-4ca0-993b-5ef1b95ec30d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:59.726820 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46228e-7163-4ca0-993b-5ef1b95ec30d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:59.728419 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46228e-7163-4ca0-993b-5ef1b95ec30d service placement] RBAC: Authorization granted {{(pid=79481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:59.740034 dv-cinder-824978-1-iscsi devstack@keystone.service[79481]: [pid: 79481|app: 0|req: 1407/2819] 10.222.0.96 () {60 vars in 1365 bytes} [Fri Jan 28 02:10:59 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)